2024-08-17T02:11:29.035 INFO:root:teuthology version: 1.2.0 2024-08-17T02:11:29.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:11:29.143 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858279 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858279' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: enable_coprs: - ceph/el9 flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEoN7S83P3smBUhqCGzLTLqKVMb06h1Y3Cp4LqisX27w7CDKhhhhPxE1kBYqc0nnxYfkNW5J2Wtj7aboqxGWZvI= smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFZzJue/8sAA7PuLC0WJVsuYqo/0zi5yUKdC+Da3FbWIOI/qqqwYnfYepYzwM01MG5wJGak6xNyoF3k5ug76JtI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:02:08 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:11:29.143 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:11:29.144 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:11:29.144 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:11:29.145 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:11:29.167 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:11:29.167 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:11:29.167 INFO:teuthology.packaging:ref: None 2024-08-17T02:11:29.168 INFO:teuthology.packaging:tag: None 2024-08-17T02:11:29.168 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:11:29.168 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:11:29.168 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:11:29.313 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375.g2577e813 2024-08-17T02:11:29.315 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:11:29.321 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:11:29.321 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:11:29.337 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:11:29.353 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:11:29.360 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:11:29.396 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:59.500273', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEoN7S83P3smBUhqCGzLTLqKVMb06h1Y3Cp4LqisX27w7CDKhhhhPxE1kBYqc0nnxYfkNW5J2Wtj7aboqxGWZvI='} 2024-08-17T02:11:29.415 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:59.501856', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFZzJue/8sAA7PuLC0WJVsuYqo/0zi5yUKdC+Da3FbWIOI/qqqwYnfYepYzwM01MG5wJGak6xNyoF3k5ug76JtI='} 2024-08-17T02:11:29.415 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:11:29.422 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:11:29.422 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:11:29.422 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:11:29.480 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb5a9287ac0>, signals=[15]) 2024-08-17T02:11:29.480 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:11:29.486 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:11:29.487 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:11:29.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:11:29.564 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2024-08-17T02:11:29.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:11:29.639 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:11:29.645 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-08-17T02:11:29.664 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-08-17T02:11:29.664 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-08-17T02:11:29.722 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-08-17T02:11:29.722 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-08-17T02:11:29.722 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-08-17T02:11:29.723 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:11:29.723 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-08-17T02:11:29.723 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:11:29.723 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:11:29.723 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-08-17T02:11:29.723 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:11:29.723 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:11:29.723 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:11:29.723 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:11:29.724 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:11:29.724 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:11:29.724 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-08-17T02:11:29.757 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-08-17T02:11:29.774 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-08-17T02:11:29.775 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-08-17T02:11:29.832 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2024-08-17T02:11:29.832 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9" 2024-08-17T02:11:29.832 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2024-08-17T02:11:29.832 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:11:29.832 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9" 2024-08-17T02:11:29.833 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:11:29.833 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:11:29.833 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2024-08-17T02:11:29.833 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:11:29.833 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:11:29.833 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:11:29.833 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:11:29.833 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:11:29.833 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:11:29.834 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-08-17T02:11:29.856 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:11:29.865 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:11:29.869 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:11:29.870 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:11:29.872 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:11:29.888 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:11:29.893 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:11:29.893 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:11:29.929 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:11:30.002 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:11:30.050 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:11:30.066 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:11:30.067 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-08-17T02:11:30.067 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-08-17T02:11:30.067 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:11:30.068 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:11:30.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:11:30.084 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:11:30.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:11:30.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:11:30.249 DEBUG:teuthology.task.kernel:sha1 for client.1 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:11:30.249 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:11:30.249 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-08-17T02:11:30.255 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:11:30.255 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:11:30.255 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-08-17T02:11:30.266 INFO:teuthology.orchestra.run.smithi087.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:11:30.267 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:11:30.267 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:11:30.268 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum upgrade -y linux-firmware 2024-08-17T02:11:30.274 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:11:30.274 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:11:30.274 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:11:30.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum upgrade -y linux-firmware 2024-08-17T02:11:32.658 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-08-17T02:11:33.294 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 5.8 MB/s | 8.2 MB 00:01 2024-08-17T02:11:34.458 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-08-17T02:11:35.243 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-08-17T02:11:39.067 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 6.6 MB 00:00 2024-08-17T02:11:39.920 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.6 MB 00:00 2024-08-17T02:11:40.626 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 18 kB 00:00 2024-08-17T02:11:41.679 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 18 kB 00:00 2024-08-17T02:11:41.713 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 23 MB/s | 22 MB 00:00 2024-08-17T02:11:42.641 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 27 MB/s | 22 MB 00:00 2024-08-17T02:11:47.420 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-08-17T02:11:48.022 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-08-17T02:11:49.595 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-08-17T02:11:49.601 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-08-17T02:11:49.602 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-08-17T02:11:49.602 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-08-17T02:11:49.602 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2024-08-17T02:11:49.602 INFO:teuthology.orchestra.run.smithi005.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:11:49.602 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:11:49.602 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-08-17T02:11:49.602 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-08-17T02:11:49.602 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 1 Package 2024-08-17T02:11:49.602 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:11:49.603 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 383 M 2024-08-17T02:11:49.603 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-08-17T02:11:50.107 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-08-17T02:11:50.114 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-08-17T02:11:50.114 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-08-17T02:11:50.114 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-08-17T02:11:50.115 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrading: 2024-08-17T02:11:50.115 INFO:teuthology.orchestra.run.smithi087.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:11:50.115 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:11:50.115 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-08-17T02:11:50.115 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-08-17T02:11:50.115 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrade 1 Package 2024-08-17T02:11:50.115 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:11:50.115 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 383 M 2024-08-17T02:11:50.115 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-08-17T02:11:55.745 INFO:teuthology.orchestra.run.smithi005.stdout:linux-firmware-20240716-145.el9.noarch.rpm 63 MB/s | 383 MB 00:06 2024-08-17T02:11:55.746 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:11:55.746 INFO:teuthology.orchestra.run.smithi005.stdout:Total 62 MB/s | 383 MB 00:06 2024-08-17T02:11:56.099 INFO:teuthology.orchestra.run.smithi087.stdout:linux-firmware-20240716-145.el9.noarch.rpm 65 MB/s | 383 MB 00:05 2024-08-17T02:11:56.099 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:11:56.099 INFO:teuthology.orchestra.run.smithi087.stdout:Total 64 MB/s | 383 MB 00:05 2024-08-17T02:11:58.971 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-08-17T02:11:59.053 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-08-17T02:11:59.053 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-08-17T02:11:59.174 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-08-17T02:11:59.253 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-08-17T02:11:59.253 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-08-17T02:12:02.457 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-08-17T02:12:02.458 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-08-17T02:12:02.501 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-08-17T02:12:02.502 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-08-17T02:12:11.671 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-08-17T02:12:11.747 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-08-17T02:12:12.432 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:12:12.514 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:12:12.516 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:12:12.600 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:12:13.300 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:12:13.300 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:12:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:12:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:12:14.052 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:12:14.052 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:12:14.052 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2024-08-17T02:12:14.053 INFO:teuthology.orchestra.run.smithi005.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:12:14.053 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:12:14.053 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-08-17T02:12:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:12:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:12:14.153 INFO:teuthology.orchestra.run.smithi087.stdout:Upgraded: 2024-08-17T02:12:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:12:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:12:14.153 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-08-17T02:12:14.382 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:12:14.382 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:12:14.442 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:12:14.442 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:12:14.536 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:12:14.536 DEBUG:teuthology.orchestra.run.smithi005:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:12:14.539 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi005.front.sepia.ceph.com to complete... 2024-08-17T02:12:14.586 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:12:14.586 DEBUG:teuthology.orchestra.run.smithi087:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:12:14.589 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi087.front.sepia.ceph.com to complete... 2024-08-17T02:12:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17 02:12:25 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:12:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:FINISHED --2024-08-17 02:12:25-- 2024-08-17T02:12:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:Total wall clock time: 11s 2024-08-17T02:12:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:Downloaded: 1 files, 344M in 11s (31.2 MB/s) 2024-08-17T02:12:25.844 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:12:25.844 DEBUG:teuthology.orchestra.run.smithi005:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:12:28.011 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying... ######################################## 2024-08-17T02:12:28.081 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing... ######################################## 2024-08-17T02:12:28.134 INFO:teuthology.orchestra.run.smithi005.stdout:Updating / installing... 2024-08-17T02:12:28.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17 02:12:28 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:12:28.417 INFO:teuthology.orchestra.run.smithi087.stderr:FINISHED --2024-08-17 02:12:28-- 2024-08-17T02:12:28.417 INFO:teuthology.orchestra.run.smithi087.stderr:Total wall clock time: 14s 2024-08-17T02:12:28.417 INFO:teuthology.orchestra.run.smithi087.stderr:Downloaded: 1 files, 344M in 14s (25.4 MB/s) 2024-08-17T02:12:28.421 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:12:28.421 DEBUG:teuthology.orchestra.run.smithi087:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:12:30.496 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying... ######################################## 2024-08-17T02:12:30.540 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing... ######################################## 2024-08-17T02:12:30.590 INFO:teuthology.orchestra.run.smithi087.stdout:Updating / installing... 2024-08-17T02:12:36.490 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:12:38.656 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:13:17.668 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi005.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:13:17.668 DEBUG:teuthology.orchestra.run.smithi005:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:13:17.789 INFO:teuthology.orchestra.run.smithi005.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:17.789 INFO:teuthology.orchestra.run.smithi005.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:17.789 INFO:teuthology.orchestra.run.smithi005.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:17.789 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:17.789 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:13:17.789 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:13:17.789 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:13:17.789 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:13:17.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:13:17.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:13:17.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:13:17.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:13:17.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:13:17.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:13:17.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:13:17.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:13:17.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:13:17.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:13:17.790 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:13:17.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:13:17.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:13:17.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:13:17.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:13:17.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:13:17.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:13:17.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:13:17.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:13:17.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:13:17.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:13:17.791 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:13:17.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:13:17.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:13:17.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:13:17.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:13:17.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:13:17.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:13:17.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:13:17.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:13:17.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:13:17.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:13:17.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:13:17.792 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:13:17.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:13:17.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:13:17.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:13:17.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:13:17.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:13:17.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:13:17.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:13:17.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:13:17.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:13:17.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:13:17.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:13:17.793 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:13:17.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:13:17.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:13:17.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:13:17.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:13:17.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:13:17.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:13:17.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:13:17.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:13:17.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:13:17.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:13:17.794 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:13:17.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:13:17.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:13:17.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:13:17.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:13:17.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:13:17.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:13:17.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:13:17.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:13:17.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:13:17.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:13:17.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:13:17.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:13:17.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:13:17.795 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:13:17.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:13:17.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:13:17.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:13:17.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:13:17.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:13:17.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:13:17.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:13:17.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:13:17.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:13:17.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:13:17.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:13:17.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:13:17.796 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:13:17.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:13:17.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:13:17.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:13:17.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:13:17.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:13:17.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:13:17.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:13:17.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:13:17.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:13:17.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:13:17.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:13:17.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:13:17.797 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:13:17.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:13:17.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:13:17.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:13:17.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:13:17.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:13:17.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:13:17.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:13:17.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:13:17.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:13:17.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:13:17.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:13:17.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:13:17.798 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:13:17.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:13:17.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:13:17.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:13:17.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:13:17.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:13:17.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:13:17.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:13:17.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:13:17.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:13:17.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:13:17.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:13:17.799 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:13:17.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:13:17.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:13:17.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:13:17.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:13:17.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:13:17.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:13:17.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:13:17.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:13:17.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:13:17.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:13:17.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:13:17.800 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:13:17.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:13:17.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:13:17.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:13:17.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:13:17.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:13:17.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:13:17.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:13:17.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:13:17.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:13:17.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:13:17.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:13:17.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:13:17.801 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:13:17.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:13:17.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:13:17.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:13:17.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:13:17.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:13:17.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:13:17.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:13:17.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:13:17.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:13:17.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:13:17.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:13:17.802 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:13:17.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:13:17.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:13:17.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:13:17.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:13:17.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:13:17.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:13:17.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:13:17.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:13:17.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:13:17.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:13:17.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:13:17.803 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:13:17.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:13:17.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:13:17.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:13:17.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:13:17.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:13:17.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:13:17.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:13:17.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:13:17.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:13:17.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:13:17.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:13:17.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:13:17.804 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:13:17.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:13:17.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:13:17.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:13:17.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:13:17.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:13:17.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:13:17.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:13:17.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:13:17.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:13:17.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:13:17.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:13:17.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:13:17.805 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:13:17.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:13:17.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:13:17.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:13:17.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:13:17.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:13:17.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:13:17.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:13:17.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:13:17.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:13:17.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:13:17.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:13:17.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:13:17.806 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:13:17.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:13:17.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:13:17.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:13:17.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:13:17.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:13:17.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:13:17.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:13:17.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:13:17.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:13:17.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:13:17.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:13:17.807 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:13:17.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:13:17.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:13:17.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:13:17.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:13:17.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:13:17.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:13:17.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:13:17.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:13:17.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:13:17.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:13:17.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:13:17.808 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:13:17.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:13:17.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:13:17.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:13:17.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:13:17.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:13:17.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:13:17.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:13:17.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:13:17.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:13:17.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:13:17.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:13:17.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:13:17.809 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:13:17.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:13:17.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:13:17.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:13:17.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:13:17.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:13:17.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:13:17.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:13:17.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:13:17.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:13:17.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:13:17.810 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:13:17.811 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:13:17.811 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:13:17.811 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:13:17.811 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:13:17.811 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:13:17.811 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:13:17.811 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:13:17.811 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:13:17.811 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:13:17.811 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:13:17.811 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:13:17.811 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:13:17.811 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:13:17.812 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:13:17.812 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:13:17.812 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:13:17.812 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:13:17.812 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:13:17.812 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:13:17.812 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:13:17.812 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:13:17.812 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:13:17.812 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:13:17.812 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:13:17.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:13:17.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:13:17.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:13:17.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:13:17.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:13:17.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:13:17.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:13:17.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:13:17.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:13:17.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:13:17.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:13:17.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:13:17.813 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:13:17.814 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:13:17.814 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:13:17.814 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:13:17.814 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:13:17.814 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:13:17.814 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:13:17.814 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:13:17.814 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:13:17.814 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:13:17.814 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:13:17.814 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:13:17.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:13:17.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:13:17.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:13:17.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:13:17.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:13:17.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:13:17.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:13:17.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:13:17.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:13:17.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:13:17.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:13:17.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:13:17.815 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:13:17.816 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:13:17.816 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:13:17.816 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:13:17.816 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:13:17.816 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:13:17.816 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:13:17.816 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:13:17.816 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:13:17.816 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:13:17.816 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:13:17.816 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:13:17.816 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:13:17.816 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:13:17.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:13:17.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:13:17.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:13:17.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:13:17.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:13:17.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:13:17.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:13:17.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:13:17.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:13:17.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:13:17.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:13:17.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:13:17.817 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:13:17.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:13:17.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:13:17.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:13:17.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:13:17.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:13:17.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:13:17.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:13:17.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:13:17.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:13:17.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:13:17.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:13:17.818 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:13:17.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:13:17.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:13:17.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:13:17.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:13:17.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:13:17.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:13:17.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:13:17.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:13:17.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:13:17.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:13:17.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:13:17.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:13:17.819 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:13:17.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:13:17.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:13:17.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:13:17.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:13:17.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:13:17.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:13:17.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:13:17.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:13:17.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:13:17.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:13:17.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:13:17.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:13:17.820 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:13:17.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:13:17.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:13:17.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:13:17.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:13:17.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:13:17.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:13:17.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:13:17.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:13:17.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:13:17.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:13:17.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:13:17.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:13:17.821 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:13:17.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:13:17.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:13:17.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:13:17.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:13:17.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:13:17.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:13:17.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:13:17.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:13:17.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:13:17.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:13:17.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:13:17.822 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:13:17.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:13:17.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:13:17.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:13:17.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:13:17.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:13:17.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:13:17.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:13:17.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:13:17.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:13:17.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:13:17.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:13:17.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:13:17.823 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:13:17.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:13:17.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:13:17.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:13:17.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:13:17.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:13:17.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:13:17.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:13:17.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:13:17.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:13:17.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:13:17.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:13:17.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:13:17.824 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:13:17.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:13:17.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:13:17.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:13:17.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:13:17.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:13:17.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:13:17.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:13:17.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:13:17.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:13:17.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:13:17.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:13:17.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:13:17.825 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:13:17.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:13:17.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:13:17.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:13:17.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:13:17.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:13:17.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:13:17.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:13:17.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:13:17.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:13:17.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:13:17.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:13:17.826 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:13:17.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:13:17.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:13:17.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:13:17.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:13:17.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:13:17.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:13:17.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:13:17.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:13:17.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:13:17.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:13:17.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:13:17.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:13:17.827 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:13:17.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:13:17.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:13:17.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:13:17.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:13:17.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:13:17.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:13:17.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:13:17.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:13:17.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:13:17.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:13:17.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:13:17.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:13:17.828 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:13:17.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:13:17.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:13:17.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:13:17.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:13:17.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:13:17.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:13:17.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:13:17.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:13:17.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:13:17.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:13:17.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:13:17.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:13:17.829 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:13:17.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:13:17.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:13:17.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:13:17.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:13:17.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:13:17.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:13:17.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:13:17.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:13:17.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:13:17.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:13:17.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:13:17.830 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:13:17.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:13:17.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:13:17.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:13:17.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:13:17.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:13:17.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:13:17.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:13:17.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:13:17.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:13:17.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:13:17.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:13:17.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:13:17.831 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:13:17.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:13:17.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:13:17.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:13:17.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:13:17.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:13:17.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:13:17.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:13:17.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:13:17.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:13:17.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:13:17.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:13:17.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:13:17.832 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:13:17.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:13:17.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:13:17.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:13:17.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:13:17.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:13:17.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:13:17.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:13:17.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:13:17.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:13:17.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:13:17.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:13:17.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:13:17.833 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:13:17.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:13:17.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:13:17.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:13:17.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:13:17.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:13:17.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:13:17.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:13:17.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:13:17.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:13:17.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:13:17.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:13:17.834 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:13:17.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:13:17.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:13:17.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:13:17.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:13:17.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:13:17.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:13:17.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:13:17.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:13:17.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:13:17.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:13:17.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:13:17.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:13:17.835 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:13:17.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:13:17.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:13:17.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:13:17.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:13:17.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:13:17.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:13:17.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:13:17.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:13:17.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:13:17.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:13:17.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:13:17.836 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:13:17.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:13:17.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:13:17.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:13:17.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:13:17.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:13:17.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:13:17.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:13:17.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:13:17.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:13:17.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:13:17.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:13:17.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:13:17.837 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:13:17.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:13:17.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:13:17.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:13:17.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:13:17.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:13:17.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:13:17.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:13:17.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:13:17.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:13:17.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:13:17.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:13:17.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:13:17.838 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:13:17.839 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:13:17.839 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:13:17.839 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:13:17.839 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:13:17.839 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:13:17.841 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:13:17.841 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:13:17.841 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:13:17.841 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:13:17.841 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:13:17.841 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:13:17.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:13:17.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:13:17.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:13:17.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:13:17.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:13:17.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:13:17.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:13:17.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:13:17.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:13:17.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:13:17.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:13:17.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:13:17.842 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:13:17.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:13:17.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:13:17.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:13:17.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:13:17.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:13:17.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:13:17.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:13:17.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:13:17.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:13:17.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:13:17.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:13:17.843 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:13:17.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:13:17.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:13:17.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:13:17.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:13:17.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:13:17.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:13:17.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:13:17.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:13:17.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:13:17.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:13:17.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:13:17.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:13:17.844 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:13:17.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:13:17.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:13:17.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:13:17.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:13:17.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:13:17.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:13:17.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:13:17.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:13:17.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:13:17.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:13:17.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:13:17.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:13:17.845 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:13:17.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:13:17.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:13:17.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:13:17.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:13:17.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:13:17.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:13:17.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:13:17.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:13:17.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:13:17.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:13:17.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:13:17.846 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:13:17.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:13:17.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:13:17.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:13:17.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:13:17.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:13:17.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:13:17.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:13:17.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:13:17.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:13:17.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:13:17.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:13:17.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:13:17.847 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:13:17.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:13:17.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:13:17.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:13:17.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:13:17.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:13:17.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:13:17.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:13:17.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:13:17.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:13:17.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:13:17.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:13:17.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:13:17.848 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:13:17.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:13:17.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:13:17.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:13:17.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:13:17.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:13:17.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:13:17.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:13:17.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:13:17.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:13:17.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:13:17.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:13:17.849 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:13:17.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:13:17.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:13:17.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:13:17.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:13:17.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:13:17.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:13:17.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:13:17.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:13:17.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:13:17.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:13:17.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:13:17.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:13:17.850 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:13:17.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:13:17.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:13:17.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:13:17.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:13:17.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:13:17.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:13:17.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:13:17.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:13:17.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:13:17.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:13:17.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:13:17.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:13:17.851 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:13:17.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:13:17.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:13:17.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:13:17.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:13:17.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:13:17.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:13:17.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:13:17.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:13:17.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:13:17.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:13:17.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:13:17.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:13:17.852 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:13:17.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:13:17.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:13:17.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:13:17.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:13:17.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:13:17.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:13:17.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:13:17.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:13:17.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:13:17.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:13:17.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:13:17.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:13:17.853 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:13:17.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:13:17.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:13:17.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:13:17.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:13:17.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:13:17.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:13:17.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:13:17.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:13:17.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:13:17.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:13:17.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:13:17.854 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:13:17.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:13:17.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:13:17.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:13:17.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:13:17.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:13:17.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:13:17.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:13:17.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:13:17.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:13:17.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:13:17.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:13:17.855 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:13:17.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:13:17.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:13:17.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:13:17.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:13:17.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:13:17.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:13:17.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:13:17.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:13:17.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:13:17.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:13:17.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:13:17.856 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:13:17.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:13:17.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:13:17.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:13:17.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:13:17.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:13:17.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:13:17.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:13:17.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:13:17.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:13:17.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:13:17.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:13:17.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:13:17.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:13:17.857 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:13:17.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:13:17.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:13:17.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:13:17.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:13:17.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:13:17.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:13:17.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:13:17.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:13:17.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:13:17.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:13:17.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:13:17.858 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:13:17.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:13:17.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:13:17.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:13:17.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:13:17.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:13:17.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:13:17.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:13:17.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:13:17.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:13:17.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:13:17.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:13:17.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:13:17.859 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:13:17.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:13:17.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:13:17.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:13:17.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:13:17.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:13:17.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:13:17.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:13:17.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:13:17.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:13:17.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:13:17.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:13:17.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:13:17.860 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:13:17.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:13:17.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:13:17.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:13:17.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:13:17.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:13:17.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:13:17.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:13:17.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:13:17.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:13:17.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:13:17.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:13:17.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:13:17.861 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:13:17.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:13:17.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:13:17.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:13:17.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:13:17.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:13:17.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:13:17.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:13:17.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:13:17.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:13:17.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:13:17.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:13:17.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:13:17.862 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:13:17.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:13:17.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:13:17.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:13:17.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:13:17.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:13:17.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:13:17.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:13:17.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:13:17.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:13:17.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:13:17.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:13:17.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:13:17.863 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:13:17.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:13:17.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:13:17.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:13:17.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:13:17.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:13:17.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:13:17.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:13:17.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:13:17.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:13:17.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:13:17.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:13:17.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:13:17.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:13:17.864 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:13:17.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:13:17.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:13:17.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:13:17.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:13:17.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:13:17.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:13:17.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:13:17.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:13:17.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:13:17.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:13:17.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:13:17.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:13:17.865 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:13:17.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:13:17.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:13:17.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:13:17.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:13:17.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:13:17.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:13:17.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:13:17.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:13:17.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:13:17.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:13:17.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:13:17.866 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:13:17.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:13:17.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:13:17.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:13:17.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:13:17.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:13:17.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:13:17.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:13:17.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:13:17.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:13:17.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:13:17.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:13:17.867 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:13:17.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:13:17.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:13:17.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:13:17.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:13:17.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:13:17.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:13:17.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:13:17.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:13:17.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:13:17.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:13:17.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:13:17.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:13:17.868 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:13:17.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:13:17.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:13:17.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:13:17.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:13:17.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:13:17.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:13:17.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:13:17.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:13:17.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:13:17.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:13:17.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:13:17.869 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:13:17.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:13:17.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:13:17.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:13:17.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:13:17.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:13:17.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:13:17.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:13:17.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:13:17.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:13:17.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:13:17.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:13:17.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:13:17.870 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:13:17.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:13:17.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:13:17.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:13:17.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:13:17.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:13:17.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:13:17.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:13:17.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:13:17.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:13:17.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:13:17.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:13:17.871 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:13:17.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:13:17.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:13:17.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:13:17.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:13:17.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:13:17.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:13:17.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:13:17.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:13:17.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:13:17.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:13:17.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:13:17.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:13:17.872 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:13:17.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:13:17.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:13:17.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:13:17.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:13:17.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:13:17.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:13:17.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:13:17.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:13:17.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:13:17.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:13:17.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:13:17.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:13:17.873 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:13:17.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:13:17.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:13:17.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:13:17.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:13:17.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:13:17.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:13:17.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:13:17.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:13:17.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:13:17.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:13:17.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:13:17.874 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:13:17.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:13:17.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:13:17.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:13:17.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:13:17.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:13:17.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:13:17.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:13:17.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:13:17.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:13:17.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:13:17.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:13:17.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:13:17.875 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:13:17.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:13:17.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:13:17.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:13:17.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:13:17.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:13:17.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:13:17.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:13:17.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:13:17.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:13:17.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:13:17.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:13:17.876 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:13:17.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:13:17.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:13:17.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:13:17.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:13:17.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:13:17.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:13:17.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:13:17.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:13:17.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:13:17.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:13:17.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:13:17.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:13:17.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:13:17.877 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:13:17.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:13:17.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:13:17.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:13:17.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:13:17.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:13:17.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:13:17.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:13:17.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:13:17.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:13:17.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:13:17.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:13:17.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:13:17.878 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:13:17.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:13:17.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:13:17.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:13:17.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:13:17.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:13:17.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:13:17.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:13:17.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:13:17.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:13:17.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:13:17.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:13:17.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:13:17.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:13:17.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:13:17.879 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:13:17.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:13:17.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:13:17.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:13:17.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:13:17.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:13:17.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:13:17.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:13:17.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:13:17.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:13:17.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:13:17.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:13:17.880 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:13:17.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:13:17.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:13:17.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:13:17.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:13:17.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:13:17.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:13:17.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:13:17.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:13:17.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:13:17.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:13:17.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:13:17.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:13:17.881 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:13:17.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:13:17.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:13:17.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:13:17.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:13:17.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:13:17.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:13:17.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:13:17.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:13:17.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:13:17.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:13:17.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:13:17.882 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:13:17.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:13:17.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:13:17.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:13:17.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:13:17.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:13:17.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:13:17.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:13:17.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:13:17.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:13:17.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:13:17.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:13:17.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:13:17.883 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:13:17.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:13:17.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:13:17.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:13:17.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:13:17.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:13:17.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:13:17.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:13:17.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:13:17.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:13:17.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:13:17.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:13:17.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:13:17.884 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:13:17.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:13:17.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:13:17.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:13:17.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:13:17.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:13:17.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:13:17.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:13:17.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:13:17.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:13:17.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:13:17.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:13:17.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:13:17.885 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:13:17.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:13:17.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:13:17.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:13:17.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:13:17.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:13:17.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:13:17.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:13:17.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:13:17.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:13:17.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:13:17.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:13:17.886 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:13:17.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:13:17.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:13:17.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:13:17.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:13:17.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:13:17.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:13:17.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:13:17.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:13:17.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:13:17.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:13:17.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:13:17.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:13:17.887 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:13:17.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:13:17.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:13:17.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:13:17.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:13:17.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:13:17.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:13:17.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:13:17.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:13:17.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:13:17.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:13:17.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:13:17.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:13:17.888 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:13:17.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:13:17.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:13:17.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:13:17.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:13:17.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:13:17.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:13:17.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:13:17.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:13:17.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:13:17.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:13:17.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:13:17.889 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:13:17.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:13:17.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:13:17.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:13:17.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:13:17.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:13:17.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:13:17.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:13:17.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:13:17.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:13:17.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:13:17.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:13:17.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:13:17.890 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:13:17.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:13:17.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:13:17.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:13:17.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:13:17.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:13:17.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:13:17.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:13:17.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:13:17.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:13:17.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:13:17.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:13:17.891 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:13:17.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:13:17.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:13:17.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:13:17.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:13:17.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:13:17.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:13:17.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:13:17.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:13:17.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:13:17.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:13:17.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:13:17.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:13:17.892 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:13:17.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:13:17.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:13:17.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:13:17.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:13:17.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:13:17.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:13:17.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:13:17.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:13:17.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:13:17.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:13:17.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:13:17.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:13:17.893 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:13:17.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:13:17.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:13:17.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:13:17.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:13:17.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:13:17.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:13:17.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:13:17.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:13:17.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:13:17.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:13:17.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:13:17.894 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:13:17.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:13:17.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:13:17.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:13:17.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:13:17.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:13:17.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:13:17.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:13:17.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:13:17.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:13:17.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:13:17.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:13:17.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:13:17.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:13:17.895 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:13:17.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:13:17.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:13:17.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:13:17.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:13:17.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:13:17.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:13:17.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:13:17.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:13:17.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:13:17.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:13:17.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:13:17.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:13:17.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:13:17.896 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:13:17.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:13:17.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:13:17.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:13:17.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:13:17.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:13:17.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:13:17.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:13:17.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:13:17.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:13:17.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:13:17.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:13:17.897 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:13:17.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:13:17.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:13:17.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:13:17.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:13:17.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:13:17.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:13:17.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:13:17.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:13:17.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:13:17.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:13:17.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:13:17.898 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:13:17.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:13:17.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:13:17.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:13:17.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:13:17.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:13:17.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:13:17.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:13:17.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:13:17.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:13:17.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:13:17.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:13:17.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:13:17.899 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:13:17.900 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:13:17.900 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:13:17.900 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:13:17.900 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:13:17.900 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:13:17.900 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:13:17.900 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:13:17.900 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:13:17.900 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:13:17.900 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:13:17.900 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:13:17.900 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:13:17.900 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:13:17.900 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:13:17.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:13:17.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:13:17.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:13:17.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:13:17.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:13:17.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:13:17.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:13:17.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:13:17.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:13:17.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:13:17.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:13:17.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:13:17.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:13:17.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:13:17.901 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:13:17.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:13:17.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:13:17.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:13:17.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:13:17.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:13:17.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:13:17.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:13:17.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:13:17.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:13:17.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:13:17.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:13:17.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:13:17.902 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:13:17.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:13:17.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:13:17.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:13:17.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:13:17.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:13:17.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:13:17.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:13:17.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:13:17.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:13:17.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:13:17.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:13:17.903 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:13:17.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:13:17.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:13:17.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:13:17.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:13:17.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:13:17.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:13:17.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:13:17.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:13:17.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:13:17.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:13:17.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:13:17.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:13:17.904 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:13:17.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:13:17.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:13:17.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:13:17.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:13:17.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:13:17.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:13:17.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:13:17.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:13:17.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:13:17.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:13:17.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:13:17.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:13:17.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:13:17.905 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:13:17.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:13:17.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:13:17.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:13:17.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:13:17.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:13:17.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:13:17.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:13:17.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:13:17.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:13:17.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:13:17.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:13:17.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:13:17.906 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:13:17.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:13:17.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:13:17.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:13:17.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:13:17.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:13:17.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:13:17.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:13:17.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:13:17.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:13:17.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:13:17.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:13:17.907 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:13:17.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:13:17.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:13:17.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:13:17.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:13:17.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:13:17.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:13:17.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:13:17.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:13:17.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:13:17.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:13:17.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:13:17.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:13:17.908 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:13:17.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:13:17.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:13:17.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:13:17.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:13:17.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:13:17.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:13:17.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:13:17.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:13:17.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:13:17.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:13:17.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:13:17.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:13:17.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:13:17.909 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:13:17.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:13:17.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:13:17.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:13:17.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:13:17.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:13:17.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:13:17.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:13:17.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:13:17.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:13:17.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:13:17.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:13:17.910 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:13:17.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:13:17.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:13:17.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:13:17.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:13:17.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:13:17.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:13:17.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:13:17.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:13:17.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:13:17.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:13:17.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:13:17.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:13:17.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:13:17.911 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:13:17.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:13:17.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:13:17.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:13:17.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:13:17.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:13:17.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:13:17.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:13:17.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:13:17.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:13:17.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:13:17.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:13:17.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:13:17.912 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:13:17.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:13:17.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:13:17.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:13:17.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:13:17.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:13:17.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:13:17.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:13:17.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:13:17.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:13:17.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:13:17.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:13:17.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:13:17.913 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:13:17.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:13:17.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:13:17.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:13:17.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:13:17.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:13:17.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:13:17.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:13:17.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:13:17.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:13:17.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:13:17.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:13:17.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:13:17.914 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:13:17.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:13:17.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:13:17.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:13:17.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:13:17.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:13:17.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:13:17.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:13:17.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:13:17.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:13:17.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:13:17.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:13:17.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:13:17.915 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:13:17.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:13:17.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:13:17.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:13:17.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:13:17.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:13:17.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:13:17.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:13:17.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:13:17.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:13:17.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:13:17.916 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:13:17.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:13:17.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:13:17.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:13:17.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:13:17.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:13:17.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:13:17.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:13:17.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:13:17.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:13:17.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:13:17.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:13:17.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:13:17.917 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:13:17.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:13:17.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:13:17.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:13:17.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:13:17.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:13:17.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:13:17.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:13:17.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:13:17.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:13:17.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:13:17.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:13:17.918 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:13:17.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:13:17.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:13:17.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:13:17.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:13:17.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:13:17.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:13:17.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:13:17.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:13:17.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:13:17.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:13:17.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:13:17.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:13:17.919 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:13:17.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:13:17.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:13:17.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:13:17.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:13:17.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:13:17.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:13:17.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:13:17.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:13:17.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:13:17.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:13:17.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:13:17.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:13:17.920 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:13:17.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:13:17.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:13:17.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:13:17.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:13:17.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:13:17.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:13:17.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:13:17.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:13:17.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:13:17.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:13:17.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:13:17.921 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:13:17.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:13:17.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:13:17.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:13:17.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:13:17.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:13:17.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:13:17.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:13:17.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:13:17.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:13:17.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:13:17.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:13:17.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:13:17.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:13:17.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:13:17.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:13:17.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:13:17.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:13:17.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:13:17.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:13:17.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:13:17.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:13:17.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:13:17.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:13:17.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:13:17.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:13:17.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:13:17.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:13:17.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:13:17.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:13:17.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:13:17.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:13:17.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:13:17.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:13:17.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:13:17.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:13:17.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:13:17.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:13:17.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:13:17.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:13:17.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:13:17.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:13:17.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:13:17.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:13:17.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:13:17.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:13:17.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:13:17.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:13:17.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:13:17.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:13:17.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:13:17.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:13:17.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:13:17.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:13:17.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:13:17.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:13:17.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:13:17.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:13:17.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:13:17.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:13:17.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:13:17.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:13:17.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:13:17.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:13:17.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:13:17.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:13:17.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:13:17.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:13:17.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:13:17.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:13:17.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:13:17.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:13:17.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:13:17.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:13:17.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:13:17.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:13:17.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:13:17.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:13:17.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:13:17.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:13:17.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:13:17.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:13:17.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:13:17.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:13:17.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:13:17.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:13:17.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:13:17.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:13:17.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:13:17.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:13:17.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:13:17.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:13:17.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:13:17.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:13:17.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:13:17.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:13:17.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:13:17.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:13:17.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:13:17.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:13:17.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:13:17.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:13:17.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:13:17.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:13:17.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:13:17.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:13:17.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:13:17.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:13:17.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:13:17.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:13:17.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:13:17.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:13:17.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:13:17.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:13:17.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:13:17.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:13:17.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:13:17.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:13:17.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:13:17.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:13:17.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:13:17.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:13:17.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:13:17.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:13:17.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:13:17.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:13:17.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:13:17.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:13:17.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:13:17.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:13:17.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:13:17.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:13:17.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:13:17.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:13:17.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:13:17.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:13:17.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:13:17.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:13:17.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:13:17.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:13:17.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:13:17.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:13:17.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:13:17.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:13:17.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:13:17.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:13:17.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:13:17.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:13:17.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:13:17.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:13:17.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:13:17.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:13:17.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:13:17.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:13:17.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:13:17.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:13:17.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:13:17.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:13:17.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:13:17.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:13:17.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:13:17.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:13:17.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:13:17.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:13:17.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:13:17.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:13:17.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:13:17.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:13:17.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:13:17.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:13:17.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:13:17.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:13:17.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:13:17.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:13:17.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:13:17.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:13:17.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:13:17.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:13:17.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:13:17.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:13:17.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:13:17.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:13:17.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:13:17.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:13:17.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:13:17.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:13:17.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:13:17.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:13:17.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:13:17.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:13:17.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:13:17.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:13:17.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:13:17.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:13:17.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:13:17.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:13:17.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:13:17.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:13:17.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:13:17.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:13:17.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:13:17.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:13:17.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:13:17.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:13:17.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:13:17.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:13:17.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:13:17.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:13:17.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:13:17.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:13:17.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:13:17.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:13:17.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:13:17.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:13:17.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:13:17.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:13:17.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:13:17.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:13:17.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:13:17.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:13:17.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:13:17.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:13:17.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:13:17.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:13:17.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:13:17.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:13:17.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:13:17.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:13:17.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:13:17.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:13:17.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:13:17.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:13:17.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:13:17.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:13:17.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:13:17.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:13:17.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:13:17.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:13:17.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:13:17.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:13:17.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:13:17.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:13:17.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:13:17.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:13:17.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:13:17.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:13:17.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:13:17.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:13:17.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:13:17.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:13:17.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:13:17.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:13:17.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:13:17.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:13:17.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:13:17.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:13:17.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:13:17.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:13:17.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:13:17.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:13:17.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:13:17.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:13:17.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:13:17.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:13:17.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:13:17.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:13:17.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:13:17.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:13:17.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:13:17.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:13:17.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:13:17.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:13:17.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:13:17.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:13:17.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:13:17.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:13:17.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:13:17.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:13:17.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:13:17.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:13:17.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:13:17.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:13:17.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:13:17.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:13:17.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:13:17.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:13:17.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:13:17.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:13:17.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:13:17.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:13:17.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:13:17.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:13:17.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:13:17.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:13:17.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:13:17.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:13:17.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:13:17.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:13:17.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:13:17.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:13:17.949 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:17.949 DEBUG:teuthology.orchestra.run.smithi005:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:13:17.975 INFO:teuthology.orchestra.run.smithi005.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:13:17.975 INFO:teuthology.orchestra.run.smithi005.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:13:17.975 INFO:teuthology.orchestra.run.smithi005.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:13:17.975 INFO:teuthology.orchestra.run.smithi005.stdout:fi 2024-08-17T02:13:17.975 INFO:teuthology.orchestra.run.smithi005.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:13:17.975 INFO:teuthology.orchestra.run.smithi005.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:13:17.975 INFO:teuthology.orchestra.run.smithi005.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:13:17.976 INFO:teuthology.orchestra.run.smithi005.stdout: fi 2024-08-17T02:13:17.976 INFO:teuthology.orchestra.run.smithi005.stdout:done 2024-08-17T02:13:17.976 INFO:teuthology.orchestra.run.smithi005.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:13:17.976 INFO:teuthology.orchestra.run.smithi005.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:13:17.976 INFO:teuthology.orchestra.run.smithi005.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:13:17.976 INFO:teuthology.orchestra.run.smithi005.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:13:17.976 INFO:teuthology.orchestra.run.smithi005.stdout:fi 2024-08-17T02:13:17.976 INFO:teuthology.orchestra.run.smithi005.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:13:17.976 INFO:teuthology.orchestra.run.smithi005.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:17.976 INFO:teuthology.orchestra.run.smithi005.stdout:fi 2024-08-17T02:13:17.976 INFO:teuthology.orchestra.run.smithi005.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:13:17.976 INFO:teuthology.orchestra.run.smithi005.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:13:17.977 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:17.977 INFO:teuthology.orchestra.run.smithi005.stdout:fi 2024-08-17T02:13:17.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo rpm -qi grub2-tools 2024-08-17T02:13:18.050 INFO:teuthology.orchestra.run.smithi005.stdout:Name : grub2-tools 2024-08-17T02:13:18.050 INFO:teuthology.orchestra.run.smithi005.stdout:Epoch : 1 2024-08-17T02:13:18.050 INFO:teuthology.orchestra.run.smithi005.stdout:Version : 2.06 2024-08-17T02:13:18.050 INFO:teuthology.orchestra.run.smithi005.stdout:Release : 68.el9 2024-08-17T02:13:18.050 INFO:teuthology.orchestra.run.smithi005.stdout:Architecture: x86_64 2024-08-17T02:13:18.050 INFO:teuthology.orchestra.run.smithi005.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:13:18.050 INFO:teuthology.orchestra.run.smithi005.stdout:Group : Unspecified 2024-08-17T02:13:18.050 INFO:teuthology.orchestra.run.smithi005.stdout:Size : 8264254 2024-08-17T02:13:18.051 INFO:teuthology.orchestra.run.smithi005.stdout:License : GPLv3+ 2024-08-17T02:13:18.051 INFO:teuthology.orchestra.run.smithi005.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:13:18.051 INFO:teuthology.orchestra.run.smithi005.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:13:18.051 INFO:teuthology.orchestra.run.smithi005.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:13:18.051 INFO:teuthology.orchestra.run.smithi005.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:13:18.051 INFO:teuthology.orchestra.run.smithi005.stdout:Packager : builder@centos.org 2024-08-17T02:13:18.051 INFO:teuthology.orchestra.run.smithi005.stdout:Vendor : CentOS 2024-08-17T02:13:18.051 INFO:teuthology.orchestra.run.smithi005.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:13:18.051 INFO:teuthology.orchestra.run.smithi005.stdout:Summary : Support tools for GRUB. 2024-08-17T02:13:18.051 INFO:teuthology.orchestra.run.smithi005.stdout:Description : 2024-08-17T02:13:18.051 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:13:18.051 INFO:teuthology.orchestra.run.smithi005.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:13:18.051 INFO:teuthology.orchestra.run.smithi005.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:13:18.051 INFO:teuthology.orchestra.run.smithi005.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:13:18.052 INFO:teuthology.orchestra.run.smithi005.stdout:hardware devices. 2024-08-17T02:13:18.052 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:13:18.052 INFO:teuthology.orchestra.run.smithi005.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:13:18.053 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:13:18.053 INFO:teuthology.task.kernel:Updating grub on smithi005 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:18.053 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:13:18.590 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi087.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:13:18.590 DEBUG:teuthology.orchestra.run.smithi087:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:13:18.667 INFO:teuthology.orchestra.run.smithi087.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:18.667 INFO:teuthology.orchestra.run.smithi087.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:18.668 INFO:teuthology.orchestra.run.smithi087.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:18.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:18.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:13:18.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:13:18.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:13:18.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:13:18.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:13:18.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:13:18.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:13:18.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:13:18.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:13:18.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:13:18.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:13:18.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:13:18.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:13:18.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:13:18.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:13:18.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:13:18.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:13:18.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:13:18.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:13:18.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:13:18.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:13:18.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:13:18.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:13:18.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:13:18.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:13:18.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:13:18.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:13:18.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:13:18.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:13:18.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:13:18.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:13:18.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:13:18.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:13:18.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:13:18.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:13:18.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:13:18.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:13:18.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:13:18.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:13:18.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:13:18.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:13:18.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:13:18.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:13:18.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:13:18.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:13:18.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:13:18.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:13:18.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:13:18.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:13:18.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:13:18.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:13:18.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:13:18.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:13:18.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:13:18.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:13:18.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:13:18.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:13:18.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:13:18.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:13:18.672 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:13:18.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:13:18.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:13:18.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:13:18.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:13:18.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:13:18.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:13:18.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:13:18.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:13:18.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:13:18.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:13:18.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:13:18.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:13:18.673 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:13:18.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:13:18.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:13:18.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:13:18.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:13:18.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:13:18.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:13:18.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:13:18.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:13:18.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:13:18.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:13:18.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:13:18.674 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:13:18.675 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:13:18.675 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:13:18.675 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:13:18.675 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:13:18.675 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:13:18.675 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:13:18.675 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:13:18.675 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:13:18.675 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:13:18.675 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:13:18.675 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:13:18.675 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:13:18.675 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:13:18.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:13:18.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:13:18.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:13:18.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:13:18.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:13:18.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:13:18.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:13:18.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:13:18.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:13:18.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:13:18.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:13:18.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:13:18.676 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:13:18.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:13:18.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:13:18.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:13:18.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:13:18.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:13:18.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:13:18.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:13:18.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:13:18.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:13:18.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:13:18.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:13:18.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:13:18.677 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:13:18.678 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:13:18.678 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:13:18.678 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:13:18.678 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:13:18.678 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:13:18.678 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:13:18.678 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:13:18.678 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:13:18.678 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:13:18.678 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:13:18.678 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:13:18.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:13:18.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:13:18.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:13:18.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:13:18.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:13:18.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:13:18.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:13:18.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:13:18.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:13:18.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:13:18.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:13:18.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:13:18.679 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:13:18.680 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:13:18.680 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:13:18.680 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:13:18.680 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:13:18.680 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:13:18.680 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:13:18.680 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:13:18.680 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:13:18.680 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:13:18.680 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:13:18.680 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:13:18.680 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:13:18.680 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:13:18.681 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:13:18.681 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:13:18.681 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:13:18.681 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:13:18.681 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:13:18.681 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:13:18.681 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:13:18.681 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:13:18.681 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:13:18.681 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:13:18.681 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:13:18.681 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:13:18.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:13:18.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:13:18.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:13:18.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:13:18.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:13:18.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:13:18.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:13:18.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:13:18.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:13:18.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:13:18.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:13:18.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:13:18.682 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:13:18.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:13:18.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:13:18.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:13:18.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:13:18.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:13:18.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:13:18.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:13:18.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:13:18.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:13:18.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:13:18.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:13:18.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:13:18.683 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:13:18.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:13:18.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:13:18.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:13:18.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:13:18.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:13:18.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:13:18.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:13:18.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:13:18.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:13:18.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:13:18.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:13:18.684 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:13:18.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:13:18.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:13:18.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:13:18.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:13:18.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:13:18.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:13:18.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:13:18.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:13:18.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:13:18.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:13:18.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:13:18.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:13:18.685 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:13:18.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:13:18.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:13:18.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:13:18.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:13:18.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:13:18.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:13:18.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:13:18.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:13:18.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:13:18.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:13:18.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:13:18.686 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:13:18.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:13:18.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:13:18.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:13:18.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:13:18.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:13:18.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:13:18.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:13:18.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:13:18.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:13:18.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:13:18.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:13:18.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:13:18.687 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:13:18.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:13:18.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:13:18.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:13:18.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:13:18.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:13:18.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:13:18.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:13:18.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:13:18.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:13:18.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:13:18.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:13:18.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:13:18.688 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:13:18.689 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:13:18.689 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:13:18.689 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:13:18.689 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:13:18.689 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:13:18.689 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:13:18.689 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:13:18.689 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:13:18.689 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:13:18.689 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:13:18.689 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:13:18.689 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:13:18.689 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:13:18.689 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:13:18.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:13:18.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:13:18.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:13:18.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:13:18.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:13:18.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:13:18.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:13:18.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:13:18.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:13:18.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:13:18.690 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:13:18.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:13:18.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:13:18.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:13:18.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:13:18.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:13:18.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:13:18.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:13:18.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:13:18.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:13:18.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:13:18.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:13:18.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:13:18.691 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:13:18.692 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:13:18.692 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:13:18.692 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:13:18.692 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:13:18.692 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:13:18.692 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:13:18.692 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:13:18.692 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:13:18.692 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:13:18.692 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:13:18.692 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:13:18.692 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:13:18.692 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:13:18.693 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:13:18.693 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:13:18.693 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:13:18.693 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:13:18.693 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:13:18.693 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:13:18.693 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:13:18.693 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:13:18.693 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:13:18.693 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:13:18.693 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:13:18.693 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:13:18.693 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:13:18.694 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:13:18.694 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:13:18.694 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:13:18.694 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:13:18.694 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:13:18.694 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:13:18.694 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:13:18.694 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:13:18.694 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:13:18.694 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:13:18.694 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:13:18.694 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:13:18.694 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:13:18.695 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:13:18.695 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:13:18.695 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:13:18.695 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:13:18.695 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:13:18.695 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:13:18.695 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:13:18.695 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:13:18.695 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:13:18.695 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:13:18.695 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:13:18.695 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:13:18.696 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:13:18.696 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:13:18.696 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:13:18.696 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:13:18.696 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:13:18.696 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:13:18.696 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:13:18.696 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:13:18.696 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:13:18.696 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:13:18.696 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:13:18.696 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:13:18.696 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:13:18.697 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:13:18.697 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:13:18.697 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:13:18.697 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:13:18.697 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:13:18.697 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:13:18.697 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:13:18.697 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:13:18.697 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:13:18.697 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:13:18.697 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:13:18.697 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:13:18.697 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:13:18.698 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:13:18.698 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:13:18.698 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:13:18.698 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:13:18.698 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:13:18.698 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:13:18.698 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:13:18.698 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:13:18.698 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:13:18.698 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:13:18.698 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:13:18.699 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:13:18.699 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:13:18.699 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:13:18.699 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:13:18.699 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:13:18.699 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:13:18.699 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:13:18.699 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:13:18.699 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:13:18.699 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:13:18.699 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:13:18.699 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:13:18.699 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:13:18.700 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:13:18.700 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:13:18.700 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:13:18.700 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:13:18.700 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:13:18.700 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:13:18.700 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:13:18.700 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:13:18.700 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:13:18.700 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:13:18.700 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:13:18.700 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:13:18.700 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:13:18.700 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:13:18.701 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:13:18.701 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:13:18.701 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:13:18.701 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:13:18.701 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:13:18.701 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:13:18.701 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:13:18.701 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:13:18.701 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:13:18.701 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:13:18.701 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:13:18.701 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:13:18.702 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:13:18.702 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:13:18.702 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:13:18.702 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:13:18.702 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:13:18.702 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:13:18.702 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:13:18.702 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:13:18.702 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:13:18.702 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:13:18.702 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:13:18.702 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:13:18.702 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:13:18.703 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:13:18.703 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:13:18.703 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:13:18.703 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:13:18.703 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:13:18.703 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:13:18.703 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:13:18.703 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:13:18.703 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:13:18.703 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:13:18.703 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:13:18.703 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:13:18.703 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:13:18.704 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:13:18.704 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:13:18.704 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:13:18.704 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:13:18.704 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:13:18.704 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:13:18.704 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:13:18.704 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:13:18.704 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:13:18.704 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:13:18.704 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:13:18.704 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:13:18.704 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:13:18.705 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:13:18.705 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:13:18.705 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:13:18.705 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:13:18.705 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:13:18.705 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:13:18.705 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:13:18.705 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:13:18.705 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:13:18.705 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:13:18.705 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:13:18.705 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:13:18.705 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:13:18.706 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:13:18.706 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:13:18.706 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:13:18.706 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:13:18.706 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:13:18.706 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:13:18.706 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:13:18.706 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:13:18.706 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:13:18.706 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:13:18.706 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:13:18.706 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:13:18.707 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:13:18.707 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:13:18.707 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:13:18.707 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:13:18.707 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:13:18.707 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:13:18.707 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:13:18.707 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:13:18.707 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:13:18.707 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:13:18.707 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:13:18.707 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:13:18.707 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:13:18.708 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:13:18.708 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:13:18.708 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:13:18.708 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:13:18.708 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:13:18.708 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:13:18.708 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:13:18.708 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:13:18.708 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:13:18.708 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:13:18.708 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:13:18.708 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:13:18.708 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:13:18.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:13:18.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:13:18.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:13:18.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:13:18.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:13:18.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:13:18.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:13:18.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:13:18.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:13:18.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:13:18.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:13:18.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:13:18.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:13:18.709 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:13:18.710 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:13:18.710 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:13:18.710 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:13:18.710 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:13:18.710 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:13:18.710 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:13:18.710 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:13:18.710 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:13:18.710 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:13:18.710 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:13:18.710 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:13:18.710 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:13:18.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:13:18.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:13:18.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:13:18.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:13:18.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:13:18.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:13:18.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:13:18.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:13:18.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:13:18.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:13:18.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:13:18.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:13:18.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:13:18.711 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:13:18.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:13:18.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:13:18.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:13:18.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:13:18.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:13:18.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:13:18.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:13:18.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:13:18.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:13:18.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:13:18.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:13:18.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:13:18.712 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:13:18.713 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:13:18.713 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:13:18.713 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:13:18.713 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:13:18.713 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:13:18.713 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:13:18.713 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:13:18.713 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:13:18.713 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:13:18.713 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:13:18.713 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:13:18.713 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:13:18.713 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:13:18.714 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:13:18.714 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:13:18.714 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:13:18.714 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:13:18.714 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:13:18.714 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:13:18.714 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:13:18.714 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:13:18.714 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:13:18.714 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:13:18.714 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:13:18.714 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:13:18.714 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:13:18.715 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:13:18.715 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:13:18.715 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:13:18.715 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:13:18.715 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:13:18.715 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:13:18.715 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:13:18.715 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:13:18.715 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:13:18.715 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:13:18.715 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:13:18.715 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:13:18.715 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:13:18.716 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:13:18.716 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:13:18.716 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:13:18.716 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:13:18.716 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:13:18.716 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:13:18.716 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:13:18.716 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:13:18.716 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:13:18.716 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:13:18.716 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:13:18.716 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:13:18.716 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:13:18.717 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:13:18.717 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:13:18.717 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:13:18.717 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:13:18.717 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:13:18.717 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:13:18.717 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:13:18.717 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:13:18.717 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:13:18.717 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:13:18.717 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:13:18.717 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:13:18.717 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:13:18.718 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:13:18.718 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:13:18.718 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:13:18.718 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:13:18.718 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:13:18.718 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:13:18.718 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:13:18.718 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:13:18.718 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:13:18.718 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:13:18.718 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:13:18.718 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:13:18.718 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:13:18.719 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:13:18.719 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:13:18.719 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:13:18.719 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:13:18.719 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:13:18.719 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:13:18.719 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:13:18.719 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:13:18.719 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:13:18.719 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:13:18.719 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:13:18.719 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:13:18.719 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:13:18.719 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:13:18.720 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:13:18.720 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:13:18.720 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:13:18.720 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:13:18.720 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:13:18.720 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:13:18.720 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:13:18.720 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:13:18.720 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:13:18.720 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:13:18.720 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:13:18.720 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:13:18.720 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:13:18.721 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:13:18.721 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:13:18.721 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:13:18.721 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:13:18.721 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:13:18.721 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:13:18.721 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:13:18.721 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:13:18.721 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:13:18.721 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:13:18.721 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:13:18.721 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:13:18.722 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:13:18.722 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:13:18.722 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:13:18.722 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:13:18.722 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:13:18.722 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:13:18.722 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:13:18.722 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:13:18.722 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:13:18.722 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:13:18.722 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:13:18.722 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:13:18.723 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:13:18.723 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:13:18.723 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:13:18.723 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:13:18.723 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:13:18.723 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:13:18.723 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:13:18.723 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:13:18.723 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:13:18.723 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:13:18.723 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:13:18.723 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:13:18.723 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:13:18.724 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:13:18.724 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:13:18.724 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:13:18.724 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:13:18.724 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:13:18.724 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:13:18.724 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:13:18.724 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:13:18.724 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:13:18.724 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:13:18.724 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:13:18.724 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:13:18.725 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:13:18.725 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:13:18.725 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:13:18.725 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:13:18.725 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:13:18.725 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:13:18.725 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:13:18.725 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:13:18.725 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:13:18.725 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:13:18.725 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:13:18.725 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:13:18.725 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:13:18.725 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:13:18.726 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:13:18.726 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:13:18.726 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:13:18.726 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:13:18.726 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:13:18.726 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:13:18.726 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:13:18.726 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:13:18.726 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:13:18.726 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:13:18.726 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:13:18.726 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:13:18.726 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:13:18.727 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:13:18.727 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:13:18.727 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:13:18.727 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:13:18.727 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:13:18.727 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:13:18.727 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:13:18.727 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:13:18.727 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:13:18.727 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:13:18.727 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:13:18.727 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:13:18.728 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:13:18.728 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:13:18.728 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:13:18.728 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:13:18.728 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:13:18.728 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:13:18.728 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:13:18.728 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:13:18.728 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:13:18.728 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:13:18.729 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:13:18.729 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:13:18.729 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:13:18.729 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:13:18.729 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:13:18.729 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:13:18.729 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:13:18.729 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:13:18.729 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:13:18.729 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:13:18.729 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:13:18.729 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:13:18.729 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:13:18.730 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:13:18.730 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:13:18.730 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:13:18.730 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:13:18.730 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:13:18.730 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:13:18.730 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:13:18.730 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:13:18.730 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:13:18.730 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:13:18.730 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:13:18.730 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:13:18.731 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:13:18.731 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:13:18.731 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:13:18.731 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:13:18.731 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:13:18.731 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:13:18.731 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:13:18.731 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:13:18.731 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:13:18.731 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:13:18.731 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:13:18.731 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:13:18.731 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:13:18.731 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:13:18.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:13:18.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:13:18.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:13:18.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:13:18.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:13:18.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:13:18.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:13:18.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:13:18.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:13:18.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:13:18.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:13:18.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:13:18.732 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:13:18.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:13:18.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:13:18.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:13:18.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:13:18.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:13:18.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:13:18.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:13:18.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:13:18.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:13:18.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:13:18.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:13:18.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:13:18.733 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:13:18.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:13:18.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:13:18.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:13:18.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:13:18.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:13:18.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:13:18.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:13:18.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:13:18.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:13:18.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:13:18.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:13:18.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:13:18.734 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:13:18.735 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:13:18.735 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:13:18.735 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:13:18.735 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:13:18.735 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:13:18.735 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:13:18.735 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:13:18.735 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:13:18.735 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:13:18.735 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:13:18.735 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:13:18.735 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:13:18.735 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:13:18.736 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:13:18.736 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:13:18.736 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:13:18.736 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:13:18.736 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:13:18.736 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:13:18.736 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:13:18.736 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:13:18.736 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:13:18.736 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:13:18.736 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:13:18.736 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:13:18.736 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:13:18.737 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:13:18.737 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:13:18.737 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:13:18.737 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:13:18.737 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:13:18.737 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:13:18.737 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:13:18.737 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:13:18.737 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:13:18.737 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:13:18.737 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:13:18.737 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:13:18.737 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:13:18.737 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:13:18.738 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:13:18.738 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:13:18.738 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:13:18.738 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:13:18.738 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:13:18.738 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:13:18.738 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:13:18.738 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:13:18.738 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:13:18.738 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:13:18.738 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:13:18.738 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:13:18.739 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:13:18.739 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:13:18.739 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:13:18.739 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:13:18.739 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:13:18.739 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:13:18.739 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:13:18.739 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:13:18.739 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:13:18.739 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:13:18.739 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:13:18.739 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:13:18.739 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:13:18.739 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:13:18.740 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:13:18.740 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:13:18.740 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:13:18.740 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:13:18.740 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:13:18.740 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:13:18.740 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:13:18.740 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:13:18.740 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:13:18.740 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:13:18.740 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:13:18.740 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:13:18.740 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:13:18.741 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:13:18.741 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:13:18.741 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:13:18.741 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:13:18.741 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:13:18.741 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:13:18.741 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:13:18.741 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:13:18.741 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:13:18.741 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:13:18.741 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:13:18.741 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:13:18.741 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:13:18.742 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:13:18.742 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:13:18.742 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:13:18.742 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:13:18.742 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:13:18.742 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:13:18.742 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:13:18.742 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:13:18.742 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:13:18.742 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:13:18.742 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:13:18.742 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:13:18.742 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:13:18.743 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:13:18.743 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:13:18.743 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:13:18.743 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:13:18.743 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:13:18.743 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:13:18.743 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:13:18.743 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:13:18.743 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:13:18.743 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:13:18.743 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:13:18.743 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:13:18.743 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:13:18.744 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:13:18.744 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:13:18.744 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:13:18.744 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:13:18.744 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:13:18.744 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:13:18.744 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:13:18.744 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:13:18.744 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:13:18.744 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:13:18.744 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:13:18.744 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:13:18.745 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:13:18.745 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:13:18.745 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:13:18.745 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:13:18.745 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:13:18.745 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:13:18.745 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:13:18.745 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:13:18.745 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:13:18.745 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:13:18.745 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:13:18.745 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:13:18.745 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:13:18.745 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:13:18.746 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:13:18.746 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:13:18.746 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:13:18.746 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:13:18.746 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:13:18.746 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:13:18.746 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:13:18.746 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:13:18.746 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:13:18.746 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:13:18.746 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:13:18.746 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:13:18.746 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:13:18.747 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:13:18.747 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:13:18.747 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:13:18.747 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:13:18.747 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:13:18.747 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:13:18.747 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:13:18.747 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:13:18.747 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:13:18.747 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:13:18.747 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:13:18.747 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:13:18.747 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:13:18.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:13:18.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:13:18.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:13:18.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:13:18.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:13:18.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:13:18.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:13:18.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:13:18.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:13:18.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:13:18.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:13:18.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:13:18.748 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:13:18.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:13:18.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:13:18.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:13:18.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:13:18.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:13:18.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:13:18.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:13:18.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:13:18.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:13:18.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:13:18.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:13:18.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:13:18.749 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:13:18.750 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:13:18.750 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:13:18.750 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:13:18.750 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:13:18.750 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:13:18.750 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:13:18.750 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:13:18.750 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:13:18.750 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:13:18.750 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:13:18.750 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:13:18.750 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:13:18.751 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:13:18.751 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:13:18.751 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:13:18.751 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:13:18.751 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:13:18.751 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:13:18.751 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:13:18.751 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:13:18.751 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:13:18.751 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:13:18.751 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:13:18.751 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:13:18.751 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:13:18.751 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:13:18.752 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:13:18.752 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:13:18.752 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:13:18.752 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:13:18.752 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:13:18.752 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:13:18.752 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:13:18.752 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:13:18.752 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:13:18.752 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:13:18.752 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:13:18.752 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:13:18.752 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:13:18.753 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:13:18.753 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:13:18.753 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:13:18.753 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:13:18.753 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:13:18.753 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:13:18.753 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:13:18.753 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:13:18.753 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:13:18.753 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:13:18.753 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:13:18.753 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:13:18.753 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:13:18.754 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:13:18.754 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:13:18.754 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:13:18.754 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:13:18.754 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:13:18.754 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:13:18.754 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:13:18.754 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:13:18.754 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:13:18.754 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:13:18.754 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:13:18.754 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:13:18.755 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:13:18.755 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:13:18.755 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:13:18.755 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:13:18.755 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:13:18.755 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:13:18.755 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:13:18.755 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:13:18.755 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:13:18.755 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:13:18.755 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:13:18.755 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:13:18.755 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:13:18.756 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:13:18.756 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:13:18.756 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:13:18.756 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:13:18.756 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:13:18.756 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:13:18.756 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:13:18.756 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:13:18.756 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:13:18.756 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:13:18.756 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:13:18.756 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:13:18.756 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:13:18.757 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:13:18.757 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:13:18.757 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:13:18.757 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:13:18.757 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:13:18.757 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:13:18.757 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:13:18.757 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:13:18.757 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:13:18.757 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:13:18.757 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:13:18.757 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:13:18.758 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:13:18.758 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:13:18.758 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:13:18.758 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:13:18.758 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:13:18.758 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:13:18.758 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:13:18.758 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:13:18.758 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:13:18.758 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:13:18.758 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:13:18.758 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:13:18.759 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:13:18.759 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:13:18.759 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:13:18.759 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:13:18.759 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:13:18.759 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:13:18.759 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:13:18.759 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:13:18.759 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:13:18.759 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:13:18.759 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:13:18.759 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:13:18.759 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:13:18.759 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:13:18.759 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:13:18.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:13:18.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:13:18.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:13:18.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:13:18.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:13:18.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:13:18.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:13:18.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:13:18.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:13:18.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:13:18.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:13:18.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:13:18.760 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:13:18.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:13:18.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:13:18.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:13:18.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:13:18.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:13:18.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:13:18.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:13:18.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:13:18.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:13:18.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:13:18.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:13:18.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:13:18.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:13:18.761 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:13:18.762 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:13:18.762 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:13:18.762 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:13:18.762 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:13:18.762 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:13:18.762 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:13:18.762 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:13:18.762 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:13:18.762 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:13:18.762 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:13:18.762 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:13:18.762 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:13:18.762 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:13:18.763 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:13:18.763 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:13:18.763 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:13:18.763 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:13:18.763 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:13:18.763 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:13:18.763 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:13:18.763 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:13:18.763 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:13:18.763 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:13:18.763 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:13:18.763 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:13:18.763 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:13:18.763 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:13:18.764 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:13:18.764 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:13:18.764 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:13:18.764 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:13:18.764 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:13:18.764 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:13:18.764 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:13:18.764 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:13:18.764 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:13:18.764 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:13:18.764 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:13:18.764 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:13:18.764 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:13:18.765 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:13:18.765 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:13:18.765 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:13:18.765 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:13:18.765 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:13:18.765 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:13:18.765 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:13:18.765 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:13:18.765 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:13:18.765 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:13:18.765 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:13:18.765 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:13:18.765 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:13:18.766 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:13:18.766 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:13:18.766 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:13:18.766 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:13:18.766 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:13:18.766 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:13:18.766 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:13:18.766 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:13:18.766 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:13:18.766 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:13:18.766 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:13:18.766 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:13:18.766 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:13:18.767 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:13:18.767 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:13:18.767 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:13:18.767 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:13:18.767 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:13:18.767 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:13:18.767 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:13:18.767 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:13:18.767 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:13:18.767 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:13:18.767 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:13:18.767 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:13:18.767 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:13:18.767 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:13:18.767 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:13:18.768 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:13:18.768 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:13:18.768 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:13:18.768 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:13:18.768 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:13:18.768 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:13:18.768 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:13:18.768 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:13:18.768 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:13:18.768 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:13:18.768 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:13:18.768 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:13:18.768 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:13:18.768 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:13:18.769 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:13:18.769 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:13:18.769 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:13:18.769 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:13:18.769 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:13:18.769 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:13:18.769 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:13:18.769 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:13:18.769 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:13:18.769 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:13:18.769 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:13:18.769 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:13:18.769 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:13:18.770 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:13:18.770 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:13:18.770 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:13:18.770 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:13:18.770 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:13:18.770 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:13:18.770 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:13:18.770 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:13:18.770 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:13:18.770 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:13:18.770 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:13:18.770 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:13:18.770 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:13:18.771 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:13:18.771 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:13:18.771 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:13:18.771 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:13:18.771 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:13:18.771 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:13:18.771 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:13:18.771 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:13:18.771 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:13:18.771 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:13:18.771 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:13:18.771 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:13:18.771 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:13:18.771 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:13:18.772 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:13:18.772 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:13:18.772 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:13:18.772 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:13:18.772 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:13:18.772 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:13:18.772 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:13:18.772 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:13:18.772 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:13:18.772 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:13:18.772 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:13:18.772 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:13:18.772 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:13:18.773 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:13:18.773 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:13:18.773 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:13:18.773 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:13:18.773 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:13:18.773 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:13:18.773 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:13:18.773 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:13:18.773 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:13:18.773 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:13:18.773 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:13:18.773 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:13:18.773 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:13:18.774 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:13:18.774 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:13:18.774 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:13:18.774 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:13:18.774 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:13:18.774 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:13:18.774 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:13:18.774 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:13:18.774 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:13:18.774 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:13:18.774 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:13:18.774 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:13:18.774 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:13:18.775 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:13:18.775 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:13:18.775 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:13:18.775 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:13:18.775 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:13:18.775 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:13:18.775 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:13:18.775 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:13:18.775 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:13:18.775 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:13:18.775 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:13:18.775 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:13:18.775 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:13:18.776 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:13:18.776 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:13:18.776 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:13:18.776 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:13:18.776 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:13:18.776 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:13:18.776 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:13:18.776 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:13:18.776 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:13:18.776 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:13:18.776 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:13:18.776 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:13:18.776 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:13:18.777 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:13:18.777 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:13:18.777 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:13:18.777 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:13:18.777 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:13:18.777 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:13:18.777 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:13:18.777 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:13:18.777 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:13:18.777 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:13:18.777 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:13:18.777 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:13:18.777 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:13:18.778 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:13:18.778 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:13:18.778 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:13:18.778 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:13:18.778 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:13:18.778 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:13:18.778 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:13:18.778 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:13:18.778 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:13:18.778 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:13:18.778 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:13:18.778 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:13:18.778 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:13:18.779 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:13:18.779 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:13:18.779 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:13:18.779 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:13:18.779 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:13:18.779 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:13:18.779 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:13:18.779 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:13:18.779 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:13:18.779 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:13:18.779 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:13:18.779 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:13:18.779 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:13:18.779 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:13:18.780 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:13:18.780 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:13:18.780 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:13:18.780 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:13:18.780 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:13:18.780 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:13:18.780 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:13:18.780 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:13:18.780 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:13:18.780 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:13:18.780 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:13:18.780 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:13:18.780 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:13:18.780 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:13:18.781 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:13:18.781 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:13:18.781 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:13:18.781 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:13:18.781 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:13:18.781 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:13:18.781 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:13:18.781 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:13:18.781 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:13:18.781 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:13:18.781 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:13:18.781 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:13:18.781 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:13:18.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:13:18.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:13:18.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:13:18.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:13:18.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:13:18.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:13:18.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:13:18.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:13:18.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:13:18.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:13:18.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:13:18.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:13:18.782 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:13:18.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:13:18.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:13:18.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:13:18.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:13:18.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:13:18.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:13:18.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:13:18.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:13:18.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:13:18.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:13:18.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:13:18.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:13:18.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:13:18.783 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:13:18.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:13:18.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:13:18.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:13:18.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:13:18.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:13:18.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:13:18.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:13:18.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:13:18.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:13:18.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:13:18.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:13:18.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:13:18.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:13:18.784 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:13:18.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:13:18.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:13:18.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:13:18.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:13:18.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:13:18.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:13:18.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:13:18.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:13:18.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:13:18.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:13:18.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:13:18.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:13:18.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:13:18.785 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:13:18.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:13:18.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:13:18.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:13:18.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:13:18.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:13:18.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:13:18.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:13:18.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:13:18.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:13:18.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:13:18.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:13:18.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:13:18.786 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:13:18.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:13:18.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:13:18.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:13:18.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:13:18.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:13:18.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:13:18.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:13:18.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:13:18.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:13:18.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:13:18.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:13:18.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:13:18.787 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:13:18.788 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:13:18.788 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:13:18.788 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:13:18.788 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:13:18.788 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:13:18.788 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:13:18.788 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:13:18.788 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:13:18.788 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:13:18.788 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:13:18.788 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:13:18.788 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:13:18.788 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:13:18.789 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:13:18.789 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:13:18.789 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:13:18.789 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:13:18.789 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:13:18.789 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:13:18.789 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:13:18.789 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:13:18.789 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:13:18.789 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:13:18.789 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:13:18.789 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:13:18.789 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:13:18.789 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:13:18.790 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:13:18.790 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:13:18.790 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:13:18.790 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:13:18.790 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:13:18.790 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:13:18.790 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:13:18.790 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:13:18.790 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:13:18.790 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:13:18.790 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:13:18.790 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:13:18.790 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:13:18.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:13:18.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:13:18.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:13:18.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:13:18.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:13:18.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:13:18.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:13:18.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:13:18.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:13:18.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:13:18.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:13:18.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:13:18.791 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:13:18.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:13:18.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:13:18.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:13:18.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:13:18.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:13:18.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:13:18.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:13:18.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:13:18.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:13:18.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:13:18.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:13:18.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:13:18.792 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:13:18.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:13:18.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:13:18.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:13:18.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:13:18.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:13:18.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:13:18.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:13:18.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:13:18.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:13:18.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:13:18.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:13:18.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:13:18.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:13:18.793 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:13:18.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:13:18.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:13:18.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:13:18.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:13:18.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:13:18.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:13:18.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:13:18.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:13:18.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:13:18.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:13:18.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:13:18.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:13:18.794 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:13:18.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:13:18.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:13:18.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:13:18.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:13:18.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:13:18.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:13:18.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:13:18.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:13:18.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:13:18.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:13:18.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:13:18.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:13:18.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:13:18.795 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:13:18.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:13:18.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:13:18.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:13:18.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:13:18.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:13:18.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:13:18.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:13:18.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:13:18.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:13:18.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:13:18.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:13:18.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:13:18.796 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:13:18.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:13:18.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:13:18.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:13:18.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:13:18.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:13:18.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:13:18.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:13:18.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:13:18.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:13:18.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:13:18.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:13:18.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:13:18.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:13:18.797 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:13:18.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:13:18.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:13:18.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:13:18.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:13:18.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:13:18.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:13:18.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:13:18.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:13:18.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:13:18.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:13:18.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:13:18.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:13:18.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:13:18.798 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:13:18.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:13:18.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:13:18.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:13:18.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:13:18.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:13:18.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:13:18.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:13:18.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:13:18.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:13:18.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:13:18.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:13:18.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:13:18.799 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:13:18.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:13:18.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:13:18.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:13:18.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:13:18.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:13:18.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:13:18.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:13:18.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:13:18.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:13:18.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:13:18.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:13:18.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:13:18.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:13:18.800 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:13:18.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:13:18.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:13:18.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:13:18.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:13:18.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:13:18.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:13:18.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:13:18.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:13:18.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:13:18.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:13:18.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:13:18.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:13:18.801 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:13:18.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:13:18.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:13:18.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:13:18.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:13:18.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:13:18.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:13:18.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:13:18.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:13:18.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:13:18.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:13:18.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:13:18.802 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:13:18.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:13:18.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:13:18.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:13:18.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:13:18.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:13:18.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:13:18.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:13:18.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:13:18.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:13:18.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:13:18.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:13:18.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:13:18.803 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:13:18.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:13:18.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:13:18.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:13:18.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:13:18.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:13:18.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:13:18.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:13:18.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:13:18.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:13:18.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:13:18.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:13:18.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:13:18.804 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:13:18.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:13:18.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:13:18.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:13:18.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:13:18.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:13:18.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:13:18.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:13:18.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:13:18.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:13:18.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:13:18.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:13:18.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:13:18.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:13:18.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:13:18.805 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:13:18.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:13:18.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:13:18.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:13:18.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:13:18.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:13:18.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:13:18.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:13:18.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:13:18.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:13:18.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:13:18.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:13:18.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:13:18.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:13:18.806 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:13:18.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:13:18.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:13:18.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:13:18.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:13:18.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:13:18.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:13:18.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:13:18.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:13:18.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:13:18.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:13:18.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:13:18.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:13:18.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:13:18.807 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:13:18.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:13:18.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:13:18.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:13:18.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:13:18.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:13:18.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:13:18.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:13:18.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:13:18.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:13:18.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:13:18.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:13:18.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:13:18.808 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:13:18.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:13:18.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:13:18.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:13:18.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:13:18.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:13:18.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:13:18.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:13:18.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:13:18.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:13:18.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:13:18.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:13:18.809 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:13:18.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:13:18.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:13:18.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:13:18.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:13:18.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:13:18.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:13:18.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:13:18.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:13:18.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:13:18.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:13:18.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:13:18.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:13:18.810 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:13:18.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:13:18.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:13:18.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:13:18.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:13:18.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:13:18.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:13:18.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:13:18.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:13:18.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:13:18.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:13:18.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:13:18.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:13:18.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:13:18.811 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:13:18.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:13:18.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:13:18.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:13:18.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:13:18.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:13:18.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:13:18.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:13:18.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:13:18.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:13:18.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:13:18.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:13:18.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:13:18.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:13:18.812 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:13:18.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:13:18.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:13:18.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:13:18.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:13:18.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:13:18.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:13:18.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:13:18.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:13:18.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:13:18.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:13:18.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:13:18.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:13:18.813 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:13:18.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:13:18.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:13:18.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:13:18.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:13:18.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:13:18.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:13:18.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:13:18.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:13:18.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:13:18.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:13:18.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:13:18.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:13:18.814 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:13:18.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:13:18.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:13:18.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:13:18.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:13:18.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:13:18.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:13:18.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:13:18.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:13:18.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:13:18.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:13:18.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:13:18.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:13:18.815 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:13:18.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:13:18.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:13:18.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:13:18.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:13:18.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:13:18.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:13:18.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:13:18.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:13:18.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:13:18.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:13:18.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:13:18.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:13:18.816 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:13:18.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:13:18.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:13:18.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:13:18.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:13:18.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:13:18.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:13:18.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:13:18.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:13:18.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:13:18.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:13:18.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:13:18.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:13:18.817 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:13:18.821 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:18.821 DEBUG:teuthology.orchestra.run.smithi087:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:13:18.822 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2024-08-17T02:13:18.844 INFO:teuthology.orchestra.run.smithi087.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:13:18.844 INFO:teuthology.orchestra.run.smithi087.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:13:18.844 INFO:teuthology.orchestra.run.smithi087.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:13:18.844 INFO:teuthology.orchestra.run.smithi087.stdout:fi 2024-08-17T02:13:18.844 INFO:teuthology.orchestra.run.smithi087.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:13:18.844 INFO:teuthology.orchestra.run.smithi087.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:13:18.844 INFO:teuthology.orchestra.run.smithi087.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:13:18.844 INFO:teuthology.orchestra.run.smithi087.stdout: fi 2024-08-17T02:13:18.844 INFO:teuthology.orchestra.run.smithi087.stdout:done 2024-08-17T02:13:18.844 INFO:teuthology.orchestra.run.smithi087.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:13:18.844 INFO:teuthology.orchestra.run.smithi087.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:13:18.845 INFO:teuthology.orchestra.run.smithi087.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:13:18.845 INFO:teuthology.orchestra.run.smithi087.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:13:18.845 INFO:teuthology.orchestra.run.smithi087.stdout:fi 2024-08-17T02:13:18.845 INFO:teuthology.orchestra.run.smithi087.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:13:18.845 INFO:teuthology.orchestra.run.smithi087.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:18.845 INFO:teuthology.orchestra.run.smithi087.stdout:fi 2024-08-17T02:13:18.845 INFO:teuthology.orchestra.run.smithi087.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:13:18.845 INFO:teuthology.orchestra.run.smithi087.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:13:18.845 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:18.845 INFO:teuthology.orchestra.run.smithi087.stdout:fi 2024-08-17T02:13:18.846 DEBUG:teuthology.orchestra.run.smithi087:> sudo rpm -qi grub2-tools 2024-08-17T02:13:18.928 INFO:teuthology.orchestra.run.smithi087.stdout:Name : grub2-tools 2024-08-17T02:13:18.928 INFO:teuthology.orchestra.run.smithi087.stdout:Epoch : 1 2024-08-17T02:13:18.928 INFO:teuthology.orchestra.run.smithi087.stdout:Version : 2.06 2024-08-17T02:13:18.929 INFO:teuthology.orchestra.run.smithi087.stdout:Release : 68.el9 2024-08-17T02:13:18.929 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: x86_64 2024-08-17T02:13:18.929 INFO:teuthology.orchestra.run.smithi087.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:13:18.929 INFO:teuthology.orchestra.run.smithi087.stdout:Group : Unspecified 2024-08-17T02:13:18.929 INFO:teuthology.orchestra.run.smithi087.stdout:Size : 8264254 2024-08-17T02:13:18.929 INFO:teuthology.orchestra.run.smithi087.stdout:License : GPLv3+ 2024-08-17T02:13:18.929 INFO:teuthology.orchestra.run.smithi087.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:13:18.929 INFO:teuthology.orchestra.run.smithi087.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:13:18.929 INFO:teuthology.orchestra.run.smithi087.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:13:18.929 INFO:teuthology.orchestra.run.smithi087.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:13:18.929 INFO:teuthology.orchestra.run.smithi087.stdout:Packager : builder@centos.org 2024-08-17T02:13:18.929 INFO:teuthology.orchestra.run.smithi087.stdout:Vendor : CentOS 2024-08-17T02:13:18.929 INFO:teuthology.orchestra.run.smithi087.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:13:18.930 INFO:teuthology.orchestra.run.smithi087.stdout:Summary : Support tools for GRUB. 2024-08-17T02:13:18.930 INFO:teuthology.orchestra.run.smithi087.stdout:Description : 2024-08-17T02:13:18.930 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:13:18.930 INFO:teuthology.orchestra.run.smithi087.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:13:18.930 INFO:teuthology.orchestra.run.smithi087.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:13:18.930 INFO:teuthology.orchestra.run.smithi087.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:13:18.930 INFO:teuthology.orchestra.run.smithi087.stdout:hardware devices. 2024-08-17T02:13:18.930 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:13:18.930 INFO:teuthology.orchestra.run.smithi087.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:13:18.931 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:13:18.931 INFO:teuthology.task.kernel:Updating grub on smithi087 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:18.931 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:13:19.472 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2024-08-17T02:13:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:13:20.133 INFO:teuthology.orchestra.run.smithi005.stderr:done 2024-08-17T02:13:20.135 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-08-17T02:13:20.156 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.U5zFKjRv5N 2024-08-17T02:13:20.156 DEBUG:teuthology.orchestra.run.smithi005:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.U5zFKjRv5N 2024-08-17T02:13:20.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.U5zFKjRv5N 2024-08-17T02:13:20.369 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.U5zFKjRv5N is 6KB 2024-08-17T02:13:20.418 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.U5zFKjRv5N 2024-08-17T02:13:20.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:13:20.495 INFO:teuthology.orchestra.run.smithi005.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:13:20.495 INFO:teuthology.orchestra.run.smithi005.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:13:20.495 INFO:teuthology.orchestra.run.smithi005.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:13:20.495 INFO:teuthology.orchestra.run.smithi005.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:13:20.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:20.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo shutdown -r now 2024-08-17T02:13:20.795 INFO:teuthology.orchestra.run.smithi087.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:13:20.825 INFO:teuthology.orchestra.run.smithi087.stderr:done 2024-08-17T02:13:20.828 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-08-17T02:13:20.843 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.ltuWNwbof7 2024-08-17T02:13:20.843 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ltuWNwbof7 2024-08-17T02:13:20.909 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.ltuWNwbof7 2024-08-17T02:13:21.045 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.ltuWNwbof7 is 6KB 2024-08-17T02:13:21.092 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.ltuWNwbof7 2024-08-17T02:13:21.106 DEBUG:teuthology.orchestra.run.smithi087:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:13:21.167 INFO:teuthology.orchestra.run.smithi087.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:13:21.168 INFO:teuthology.orchestra.run.smithi087.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:13:21.168 INFO:teuthology.orchestra.run.smithi087.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:13:21.168 INFO:teuthology.orchestra.run.smithi087.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:13:21.169 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:21.335 DEBUG:teuthology.orchestra.run.smithi087:> sudo shutdown -r now 2024-08-17T02:13:50.679 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-17T02:13:50.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-17T02:13:50.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:13:51.340 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-08-17T02:13:51.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-08-17T02:13:51.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:09.887 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-08-17T02:14:18.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-08-17T02:14:18.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:21.954 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-08-17T02:14:33.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-08-17T02:14:33.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:50.699 DEBUG:teuthology.orchestra.remote:timed out 2024-08-17T02:14:52.382 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-08-17T02:14:59.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-17T02:14:59.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:00.130 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-08-17T02:15:00.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-17T02:15:00.837 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:15:00.837 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-08-17T02:15:00.873 INFO:teuthology.orchestra.run.smithi005.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:00.873 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:00.873 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:15:00.873 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:15:01.877 DEBUG:teuthology.parallel:result is None 2024-08-17T02:15:07.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-08-17T02:15:07.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:07.795 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-08-17T02:15:08.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-08-17T02:15:08.324 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:15:08.324 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-08-17T02:15:08.358 INFO:teuthology.orchestra.run.smithi087.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:08.359 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:08.359 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:15:08.359 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:15:09.360 DEBUG:teuthology.parallel:result is None 2024-08-17T02:15:09.360 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:15:09.374 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:15:09.374 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:15:09.387 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:15:09.467 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:15:09.473 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:15:09.480 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:15:09.481 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:15:09.494 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:15:09.588 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:15:09.595 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:15:09.595 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:15:09.606 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:15:09.749 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:15:09.787 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:15:09.797 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:15:09.844 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:15:09.848 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:15:09.854 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:15:09.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:15:09.859 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:15:09.915 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:15:09.925 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:15:09.925 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:15:09.930 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:15:09.964 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:15:10.068 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:15:10.149 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:15:10.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:15:10.293 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:15:10.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:15:10.356 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:15:10.418 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:15:10.503 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:15:10.567 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:15:10.644 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:15:10.644 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:15:10.724 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2024-08-17T02:15:10.728 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2024-08-17T02:15:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:15:10.847 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:15:11.034 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:15:11.044 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:15:11.045 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:15:11.060 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:15:11.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2024-08-17T02:15:11.358 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2024-08-17T02:15:11.362 DEBUG:teuthology.orchestra.run.smithi087:> sudo service auditd rotate 2024-08-17T02:15:11.473 INFO:teuthology.orchestra.run.smithi087.stdout:Rotating logs: 2024-08-17T02:15:11.477 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:15:11.478 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2024-08-17T02:15:11.542 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2024-08-17T02:15:11.543 DEBUG:teuthology.orchestra.run.smithi087:> /usr/sbin/getenforce 2024-08-17T02:15:11.584 INFO:teuthology.orchestra.run.smithi087.stdout:Permissive 2024-08-17T02:15:11.584 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi087.front.sepia.ceph.com': 'permissive'} 2024-08-17T02:15:11.585 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:15:11.651 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:15:11.652 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:15:11.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:15:11.710 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:15:11.711 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:15:11.783 DEBUG:teuthology.orchestra.run.smithi087:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:15:11.855 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:15:11.868 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:15:11.879 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:15:11.880 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi087.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:20:56.662 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi087.front.sepia.ceph.com')] 2024-08-17T02:20:56.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-17T02:20:56.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:20:56.759 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-08-17T02:20:56.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-17T02:20:56.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-08-17T02:20:56.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:20:56.965 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-08-17T02:20:57.085 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-08-17T02:20:57.085 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:20:57.095 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:20:57.095 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:20:57.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:20:57.099 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:20:57.100 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:20:57.158 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:20:57.188 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:20:57.193 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:20:57.224 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:20:57.240 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2024-08-17T02:20:57.264 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2024-08-17T02:20:57.276 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: ntpd: command not found 2024-08-17T02:20:57.293 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:20:57.300 INFO:teuthology.orchestra.run.smithi087.stdout:506 Cannot talk to daemon 2024-08-17T02:20:57.323 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:20:57.329 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:20:57.359 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:20:57.427 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:20:57.433 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:20:57.433 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-08-17T02:20:57.433 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:20:57.433 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:20:57.434 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:20:57.434 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:20:57.454 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:20:57.461 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:20:57.461 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-08-17T02:20:57.461 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:20:57.461 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:20:57.461 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:20:57.461 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:20:57.462 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:20:57.471 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:20:57.471 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:20:57.472 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:20:57.472 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:20:57.478 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:20:57.478 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:20:57.479 DEBUG:teuthology.orchestra.run.smithi005:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:20:57.479 DEBUG:teuthology.orchestra.run.smithi087:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:20:58.203 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:20 ago on Sat 17 Aug 2024 02:19:37 AM UTC. 2024-08-17T02:20:58.211 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:25 ago on Sat 17 Aug 2024 02:19:32 AM UTC. 2024-08-17T02:20:58.294 INFO:teuthology.orchestra.run.smithi005.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:20:58.304 INFO:teuthology.orchestra.run.smithi087.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:20:58.338 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-08-17T02:20:58.339 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-08-17T02:20:58.340 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-08-17T02:20:58.345 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-08-17T02:20:58.346 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-08-17T02:20:58.346 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-08-17T02:20:58.422 DEBUG:teuthology.orchestra.run.smithi087:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:20:58.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:20:58.680 INFO:teuthology.orchestra.run.smithi005.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:20:58.680 INFO:teuthology.orchestra.run.smithi005.stderr:of the main distribution, and quality may vary. 2024-08-17T02:20:58.680 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-17T02:20:58.680 INFO:teuthology.orchestra.run.smithi005.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:20:58.680 INFO:teuthology.orchestra.run.smithi005.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:20:58.680 INFO:teuthology.orchestra.run.smithi005.stderr:, 2024-08-17T02:20:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:and packages are not held to any quality or security level. 2024-08-17T02:20:58.681 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-17T02:20:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:20:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:20:58.681 INFO:teuthology.orchestra.run.smithi087.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:20:58.681 INFO:teuthology.orchestra.run.smithi087.stderr:of the main distribution, and quality may vary. 2024-08-17T02:20:58.681 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-08-17T02:20:58.681 INFO:teuthology.orchestra.run.smithi087.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:20:58.682 INFO:teuthology.orchestra.run.smithi087.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:20:58.682 INFO:teuthology.orchestra.run.smithi087.stderr:, 2024-08-17T02:20:58.682 INFO:teuthology.orchestra.run.smithi087.stderr:and packages are not held to any quality or security level. 2024-08-17T02:20:58.682 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-08-17T02:20:58.682 INFO:teuthology.orchestra.run.smithi087.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:20:58.682 INFO:teuthology.orchestra.run.smithi087.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:20:58.761 INFO:teuthology.orchestra.run.smithi005.stdout:Repository successfully enabled. 2024-08-17T02:20:58.779 INFO:teuthology.orchestra.run.smithi087.stdout:Repository successfully enabled. 2024-08-17T02:20:58.809 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:20:58.810 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:20:58.824 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:20:58.825 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:20:58.959 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:20:58.960 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:20:58.970 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:20:58.970 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:20:59.073 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:20:59.073 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:20:59.073 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:20:59.087 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:20:59.092 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:20:59.093 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:20:59.130 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:20:59.130 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:20:59.148 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:20:59.148 DEBUG:teuthology.orchestra.run.smithi087:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:20:59.228 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:20:59.245 DEBUG:teuthology.orchestra.run.smithi087:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:20:59.309 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:20:59.324 DEBUG:teuthology.orchestra.run.smithi087:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:20:59.367 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2024-08-17T02:20:59.367 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2024-08-17T02:20:59.381 INFO:teuthology.orchestra.run.smithi087.stdout:check_obsoletes = 1 2024-08-17T02:20:59.382 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum clean all 2024-08-17T02:20:59.639 INFO:teuthology.orchestra.run.smithi005.stdout:45 files removed 2024-08-17T02:20:59.656 INFO:teuthology.orchestra.run.smithi087.stdout:45 files removed 2024-08-17T02:20:59.672 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:20:59.690 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:21:00.375 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 238 kB/s | 77 kB 00:00 2024-08-17T02:21:00.380 INFO:teuthology.orchestra.run.smithi087.stdout:ceph packages for x86_64 235 kB/s | 77 kB 00:00 2024-08-17T02:21:00.698 INFO:teuthology.orchestra.run.smithi087.stdout:ceph noarch packages 39 kB/s | 11 kB 00:00 2024-08-17T02:21:00.700 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 38 kB/s | 11 kB 00:00 2024-08-17T02:21:01.023 INFO:teuthology.orchestra.run.smithi087.stdout:ceph source packages 6.2 kB/s | 1.8 kB 00:00 2024-08-17T02:21:01.026 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 6.2 kB/s | 1.8 kB 00:00 2024-08-17T02:21:01.235 INFO:teuthology.orchestra.run.smithi005.stdout:Copr repo for el9 owned by ceph 44 kB/s | 7.6 kB 00:00 2024-08-17T02:21:01.249 INFO:teuthology.orchestra.run.smithi087.stdout:Copr repo for el9 owned by ceph 40 kB/s | 7.6 kB 00:00 2024-08-17T02:21:01.919 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-08-17T02:21:01.967 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-08-17T02:21:04.367 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 16 MB/s | 20 MB 00:01 2024-08-17T02:21:06.487 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 5.9 MB/s | 20 MB 00:03 2024-08-17T02:21:09.410 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 6.1 MB/s | 6.6 MB 00:01 2024-08-17T02:21:11.011 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 18 kB 00:00 2024-08-17T02:21:11.129 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.6 MB 00:00 2024-08-17T02:21:11.923 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 29 MB/s | 22 MB 00:00 2024-08-17T02:21:12.704 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 98 kB/s | 18 kB 00:00 2024-08-17T02:21:13.776 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-08-17T02:21:18.438 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-08-17T02:21:20.406 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-08-17T02:21:20.975 INFO:teuthology.orchestra.run.smithi087.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:21:20.976 INFO:teuthology.orchestra.run.smithi087.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:21:20.987 INFO:teuthology.orchestra.run.smithi087.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:21:20.988 INFO:teuthology.orchestra.run.smithi087.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:21:20.988 INFO:teuthology.orchestra.run.smithi087.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:21:20.989 INFO:teuthology.orchestra.run.smithi087.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:21:20.991 INFO:teuthology.orchestra.run.smithi087.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:21:20.993 INFO:teuthology.orchestra.run.smithi087.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:21:20.994 INFO:teuthology.orchestra.run.smithi087.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:21:21.054 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-08-17T02:21:21.075 INFO:teuthology.orchestra.run.smithi087.stdout:======================================================================================= 2024-08-17T02:21:21.076 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-08-17T02:21:21.076 INFO:teuthology.orchestra.run.smithi087.stdout:======================================================================================= 2024-08-17T02:21:21.076 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-08-17T02:21:21.077 INFO:teuthology.orchestra.run.smithi087.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:21:21.077 INFO:teuthology.orchestra.run.smithi087.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:21:21.077 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:21:21.077 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:21:21.077 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:21:21.077 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:21:21.077 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:21:21.077 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:21:21.077 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:21:21.077 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:21:21.077 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:21:21.077 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:21:21.078 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:21:21.078 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:21:21.078 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:21:21.078 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:21:21.078 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:21:21.078 INFO:teuthology.orchestra.run.smithi087.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:21:21.078 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:21:21.078 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:21:21.078 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:21:21.079 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:21:21.079 INFO:teuthology.orchestra.run.smithi087.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:21:21.079 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:21:21.079 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:21:21.079 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:21:21.079 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:21:21.079 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:21:21.079 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:21:21.079 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:21:21.079 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:21:21.079 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:21:21.080 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:21:21.080 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrading: 2024-08-17T02:21:21.080 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:21:21.080 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:21:21.080 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:21:21.080 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:21:21.080 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:21:21.080 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:21:21.080 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:21:21.080 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:21:21.080 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:21:21.080 INFO:teuthology.orchestra.run.smithi087.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:21:21.081 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:21:21.081 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:21:21.081 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-08-17T02:21:21.081 INFO:teuthology.orchestra.run.smithi087.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:21:21.081 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:21:21.081 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:21:21.081 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:21:21.081 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:21:21.081 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:21:21.081 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:21:21.081 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:21:21.081 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:21:21.081 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:21:21.082 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:21:21.082 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:21:21.082 INFO:teuthology.orchestra.run.smithi087.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:21:21.082 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:21:21.083 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:21:21.083 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:21:21.083 INFO:teuthology.orchestra.run.smithi087.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:21:21.083 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:21:21.083 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:21:21.083 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:21:21.083 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:21:21.083 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:21:21.083 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:21:21.083 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:21:21.083 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:21:21.083 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:21:21.084 INFO:teuthology.orchestra.run.smithi087.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:21:21.084 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:21:21.084 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:21:21.084 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:21:21.084 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:21:21.084 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:21:21.084 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:21:21.084 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:21:21.084 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:21:21.084 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:21:21.084 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:21:21.085 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:21:21.085 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:21:21.085 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:21:21.085 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:21:21.085 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:21:21.085 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:21:21.085 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:21:21.085 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:21:21.086 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:21:21.087 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:21:21.087 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:21:21.087 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:21:21.087 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:21:21.087 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:21:21.087 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:21:21.087 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:21:21.087 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:21:21.087 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:21:21.087 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:21:21.087 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:21:21.088 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:21:21.088 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:21:21.088 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:21:21.088 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:21:21.088 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:21:21.088 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:21:21.088 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:21:21.088 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:21:21.088 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:21:21.089 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:21:21.089 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:21:21.089 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:21:21.089 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:21:21.089 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:21:21.089 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:21:21.089 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:21:21.089 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:21:21.089 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:21:21.090 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:21:21.090 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:21:21.090 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:21:21.090 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:21:21.090 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:21:21.090 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:21:21.090 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:21:21.090 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:21:21.090 INFO:teuthology.orchestra.run.smithi087.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:21:21.090 INFO:teuthology.orchestra.run.smithi087.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:21:21.090 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:21:21.090 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:21:21.091 INFO:teuthology.orchestra.run.smithi087.stdout:Installing weak dependencies: 2024-08-17T02:21:21.091 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:21:21.091 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:21:21.091 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-08-17T02:21:21.091 INFO:teuthology.orchestra.run.smithi087.stdout:======================================================================================= 2024-08-17T02:21:21.091 INFO:teuthology.orchestra.run.smithi087.stdout:Install 121 Packages 2024-08-17T02:21:21.091 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrade 12 Packages 2024-08-17T02:21:21.091 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:21:21.093 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 206 M 2024-08-17T02:21:21.093 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-08-17T02:21:21.781 INFO:teuthology.orchestra.run.smithi087.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 27 kB/s | 6.5 kB 00:00 2024-08-17T02:21:22.074 INFO:teuthology.orchestra.run.smithi087.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 2.7 MB/s | 813 kB 00:00 2024-08-17T02:21:22.140 INFO:teuthology.orchestra.run.smithi087.stdout:(3/133): ceph-immutable-object-cache-17.2.7-137 2.0 MB/s | 137 kB 00:00 2024-08-17T02:21:22.473 INFO:teuthology.orchestra.run.smithi087.stdout:(4/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 6.2 MB/s | 2.1 MB 00:00 2024-08-17T02:21:22.590 INFO:teuthology.orchestra.run.smithi087.stdout:(5/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 4.7 MB/s | 5.0 MB 00:01 2024-08-17T02:21:22.715 INFO:teuthology.orchestra.run.smithi087.stdout:(6/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 5.8 MB/s | 1.4 MB 00:00 2024-08-17T02:21:23.070 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:21:23.070 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:21:23.075 INFO:teuthology.orchestra.run.smithi087.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 8.1 MB/s | 3.9 MB 00:00 2024-08-17T02:21:23.082 INFO:teuthology.orchestra.run.smithi005.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:21:23.082 INFO:teuthology.orchestra.run.smithi005.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:21:23.085 INFO:teuthology.orchestra.run.smithi005.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:21:23.085 INFO:teuthology.orchestra.run.smithi005.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:21:23.086 INFO:teuthology.orchestra.run.smithi005.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:21:23.089 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:21:23.090 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:21:23.156 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-08-17T02:21:23.187 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-08-17T02:21:23.188 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-08-17T02:21:23.188 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-08-17T02:21:23.188 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-08-17T02:21:23.188 INFO:teuthology.orchestra.run.smithi005.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:21:23.188 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:21:23.188 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:21:23.188 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:21:23.188 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:21:23.188 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:21:23.188 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:21:23.188 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:21:23.189 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:21:23.189 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:21:23.189 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:21:23.189 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:21:23.189 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:21:23.189 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:21:23.189 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:21:23.189 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:21:23.189 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:21:23.189 INFO:teuthology.orchestra.run.smithi005.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:21:23.189 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:21:23.190 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:21:23.190 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:21:23.190 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:21:23.190 INFO:teuthology.orchestra.run.smithi005.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:21:23.190 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:21:23.190 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:21:23.190 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:21:23.190 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:21:23.190 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:21:23.190 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:21:23.190 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:21:23.190 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:21:23.191 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:21:23.191 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:21:23.191 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2024-08-17T02:21:23.191 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:21:23.191 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:21:23.191 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:21:23.191 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:21:23.191 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:21:23.191 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:21:23.191 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:21:23.191 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:21:23.191 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:21:23.191 INFO:teuthology.orchestra.run.smithi005.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:21:23.192 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:21:23.192 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:21:23.192 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-08-17T02:21:23.192 INFO:teuthology.orchestra.run.smithi005.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:21:23.192 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:21:23.192 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:21:23.192 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:21:23.192 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:21:23.192 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:21:23.192 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:21:23.192 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:21:23.192 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:21:23.192 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:21:23.193 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:21:23.193 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:21:23.193 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:21:23.193 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:21:23.193 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:21:23.193 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:21:23.193 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:21:23.193 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:21:23.193 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:21:23.193 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:21:23.193 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:21:23.193 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:21:23.193 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:21:23.194 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:21:23.194 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:21:23.194 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:21:23.194 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:21:23.194 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:21:23.194 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:21:23.194 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:21:23.194 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:21:23.194 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:21:23.194 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:21:23.194 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:21:23.195 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:21:23.195 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:21:23.195 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:21:23.195 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:21:23.195 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:21:23.195 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:21:23.195 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:21:23.195 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:21:23.195 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:21:23.195 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:21:23.197 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:21:23.197 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:21:23.197 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:21:23.197 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:21:23.197 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:21:23.197 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:21:23.197 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:21:23.197 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:21:23.197 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:21:23.197 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:21:23.198 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:21:23.198 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:21:23.198 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:21:23.199 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:21:23.199 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:21:23.199 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:21:23.199 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:21:23.199 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:21:23.199 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:21:23.199 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:21:23.199 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:21:23.200 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:21:23.200 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:21:23.201 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:21:23.201 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:21:23.201 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:21:23.201 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:21:23.201 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:21:23.202 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:21:23.202 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:21:23.202 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:21:23.202 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:21:23.202 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:21:23.202 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:21:23.202 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:21:23.202 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:21:23.202 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:21:23.202 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:21:23.203 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:21:23.203 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:21:23.203 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:21:23.203 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:21:23.203 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:21:23.203 INFO:teuthology.orchestra.run.smithi005.stdout:Installing weak dependencies: 2024-08-17T02:21:23.203 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:21:23.203 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:21:23.203 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-08-17T02:21:23.203 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-08-17T02:21:23.203 INFO:teuthology.orchestra.run.smithi005.stdout:Install 121 Packages 2024-08-17T02:21:23.204 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 12 Packages 2024-08-17T02:21:23.204 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:21:23.204 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 206 M 2024-08-17T02:21:23.204 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-08-17T02:21:23.858 INFO:teuthology.orchestra.run.smithi087.stdout:(8/133): ceph-common-17.2.7-1375.g2577e813.el9. 9.7 MB/s | 22 MB 00:02 2024-08-17T02:21:23.922 INFO:teuthology.orchestra.run.smithi087.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 395 kB/s | 25 kB 00:00 2024-08-17T02:21:23.924 INFO:teuthology.orchestra.run.smithi005.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 33 kB/s | 6.5 kB 00:00 2024-08-17T02:21:24.108 INFO:teuthology.orchestra.run.smithi005.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 4.3 MB/s | 813 kB 00:00 2024-08-17T02:21:24.108 INFO:teuthology.orchestra.run.smithi087.stdout:(10/133): ceph-radosgw-17.2.7-1375.g2577e813.el 14 MB/s | 14 MB 00:01 2024-08-17T02:21:24.167 INFO:teuthology.orchestra.run.smithi005.stdout:(3/133): ceph-immutable-object-cache-17.2.7-137 2.3 MB/s | 137 kB 00:00 2024-08-17T02:21:24.309 INFO:teuthology.orchestra.run.smithi087.stdout:(11/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 9.6 MB/s | 15 MB 00:01 2024-08-17T02:21:24.333 INFO:teuthology.orchestra.run.smithi087.stdout:(12/133): cephfs-mirror-17.2.7-1375.g2577e813.e 955 kB/s | 215 kB 00:00 2024-08-17T02:21:24.384 INFO:teuthology.orchestra.run.smithi087.stdout:(13/133): libcephfs-devel-17.2.7-1375.g2577e813 334 kB/s | 25 kB 00:00 2024-08-17T02:21:24.400 INFO:teuthology.orchestra.run.smithi005.stdout:(4/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 8.9 MB/s | 2.1 MB 00:00 2024-08-17T02:21:24.426 INFO:teuthology.orchestra.run.smithi087.stdout:(14/133): libcephfs2-17.2.7-1375.g2577e813.el9. 6.8 MB/s | 636 kB 00:00 2024-08-17T02:21:24.476 INFO:teuthology.orchestra.run.smithi087.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 1.7 MB/s | 163 kB 00:00 2024-08-17T02:21:24.576 INFO:teuthology.orchestra.run.smithi005.stdout:(5/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 8.1 MB/s | 1.4 MB 00:00 2024-08-17T02:21:24.585 INFO:teuthology.orchestra.run.smithi087.stdout:(16/133): libradosstriper1-17.2.7-1375.g2577e81 4.1 MB/s | 458 kB 00:00 2024-08-17T02:21:24.909 INFO:teuthology.orchestra.run.smithi005.stdout:(6/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 12 MB/s | 3.9 MB 00:00 2024-08-17T02:21:25.136 INFO:teuthology.orchestra.run.smithi087.stdout:(17/133): librgw2-17.2.7-1375.g2577e813.el9.x86 8.9 MB/s | 4.9 MB 00:00 2024-08-17T02:21:25.185 INFO:teuthology.orchestra.run.smithi087.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 909 kB/s | 45 kB 00:00 2024-08-17T02:21:25.210 INFO:teuthology.orchestra.run.smithi005.stdout:(7/133): ceph-common-17.2.7-1375.g2577e813.el9. 15 MB/s | 22 MB 00:01 2024-08-17T02:21:25.210 INFO:teuthology.orchestra.run.smithi087.stdout:(19/133): librados-devel-17.2.7-1375.g2577e813. 161 kB/s | 126 kB 00:00 2024-08-17T02:21:25.236 INFO:teuthology.orchestra.run.smithi087.stdout:(20/133): python3-ceph-common-17.2.7-1375.g2577 2.3 MB/s | 120 kB 00:00 2024-08-17T02:21:25.286 INFO:teuthology.orchestra.run.smithi087.stdout:(21/133): python3-cephfs-17.2.7-1375.g2577e813. 2.4 MB/s | 182 kB 00:00 2024-08-17T02:21:25.320 INFO:teuthology.orchestra.run.smithi087.stdout:(22/133): python3-rados-17.2.7-1375.g2577e813.e 4.3 MB/s | 369 kB 00:00 2024-08-17T02:21:25.387 INFO:teuthology.orchestra.run.smithi087.stdout:(23/133): python3-rbd-17.2.7-1375.g2577e813.el9 3.3 MB/s | 344 kB 00:00 2024-08-17T02:21:25.404 INFO:teuthology.orchestra.run.smithi087.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.4 MB/s | 116 kB 00:00 2024-08-17T02:21:25.471 INFO:teuthology.orchestra.run.smithi087.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 984 kB/s | 82 kB 00:00 2024-08-17T02:21:25.571 INFO:teuthology.orchestra.run.smithi087.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 1.6 MB/s | 165 kB 00:00 2024-08-17T02:21:25.672 INFO:teuthology.orchestra.run.smithi087.stdout:(27/133): ceph-grafana-dashboards-17.2.7-1375.g 244 kB/s | 24 kB 00:00 2024-08-17T02:21:25.772 INFO:teuthology.orchestra.run.smithi087.stdout:(28/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 1.2 MB/s | 124 kB 00:00 2024-08-17T02:21:25.844 INFO:teuthology.orchestra.run.smithi087.stdout:(29/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 6.7 MB/s | 2.9 MB 00:00 2024-08-17T02:21:26.139 INFO:teuthology.orchestra.run.smithi087.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 9.1 MB/s | 3.4 MB 00:00 2024-08-17T02:21:26.143 INFO:teuthology.orchestra.run.smithi005.stdout:(8/133): ceph-radosgw-17.2.7-1375.g2577e813.el9 15 MB/s | 14 MB 00:00 2024-08-17T02:21:26.198 INFO:teuthology.orchestra.run.smithi087.stdout:(31/133): ceph-mgr-modules-core-17.2.7-1375.g25 4.0 MB/s | 240 kB 00:00 2024-08-17T02:21:26.226 INFO:teuthology.orchestra.run.smithi005.stdout:(9/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 2.0 MB/s | 5.0 MB 00:02 2024-08-17T02:21:26.264 INFO:teuthology.orchestra.run.smithi087.stdout:(32/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 716 kB/s | 47 kB 00:00 2024-08-17T02:21:26.275 INFO:teuthology.orchestra.run.smithi005.stdout:(10/133): ceph-selinux-17.2.7-1375.g2577e813.el 191 kB/s | 25 kB 00:00 2024-08-17T02:21:26.323 INFO:teuthology.orchestra.run.smithi087.stdout:(33/133): ceph-prometheus-alerts-17.2.7-1375.g2 251 kB/s | 15 kB 00:00 2024-08-17T02:21:26.390 INFO:teuthology.orchestra.run.smithi087.stdout:(34/133): ceph-volume-17.2.7-1375.g2577e813.el9 3.9 MB/s | 269 kB 00:00 2024-08-17T02:21:26.449 INFO:teuthology.orchestra.run.smithi087.stdout:(35/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.4 MB/s | 83 kB 00:00 2024-08-17T02:21:26.477 INFO:teuthology.orchestra.run.smithi005.stdout:(11/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 9.8 MB/s | 15 MB 00:01 2024-08-17T02:21:26.491 INFO:teuthology.orchestra.run.smithi087.stdout:(36/133): cephfs-top-17.2.7-1375.g2577e813.el9. 437 kB/s | 18 kB 00:00 2024-08-17T02:21:26.502 INFO:teuthology.orchestra.run.smithi005.stdout:(12/133): cephfs-mirror-17.2.7-1375.g2577e813.e 948 kB/s | 215 kB 00:00 2024-08-17T02:21:26.536 INFO:teuthology.orchestra.run.smithi005.stdout:(13/133): libcephfs-devel-17.2.7-1375.g2577e813 428 kB/s | 25 kB 00:00 2024-08-17T02:21:26.578 INFO:teuthology.orchestra.run.smithi005.stdout:(14/133): libcephfs2-17.2.7-1375.g2577e813.el9. 8.3 MB/s | 636 kB 00:00 2024-08-17T02:21:26.603 INFO:teuthology.orchestra.run.smithi005.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 2.4 MB/s | 163 kB 00:00 2024-08-17T02:21:26.628 INFO:teuthology.orchestra.run.smithi005.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 2.5 MB/s | 126 kB 00:00 2024-08-17T02:21:26.679 INFO:teuthology.orchestra.run.smithi005.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 6.0 MB/s | 458 kB 00:00 2024-08-17T02:21:26.746 INFO:teuthology.orchestra.run.smithi005.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 678 kB/s | 45 kB 00:00 2024-08-17T02:21:26.862 INFO:teuthology.orchestra.run.smithi005.stdout:(19/133): librgw2-17.2.7-1375.g2577e813.el9.x86 21 MB/s | 4.9 MB 00:00 2024-08-17T02:21:26.888 INFO:teuthology.orchestra.run.smithi005.stdout:(20/133): python3-ceph-common-17.2.7-1375.g2577 847 kB/s | 120 kB 00:00 2024-08-17T02:21:26.913 INFO:teuthology.orchestra.run.smithi005.stdout:(21/133): python3-cephfs-17.2.7-1375.g2577e813. 3.5 MB/s | 182 kB 00:00 2024-08-17T02:21:26.947 INFO:teuthology.orchestra.run.smithi005.stdout:(22/133): python3-rados-17.2.7-1375.g2577e813.e 6.2 MB/s | 369 kB 00:00 2024-08-17T02:21:26.980 INFO:teuthology.orchestra.run.smithi005.stdout:(23/133): python3-rbd-17.2.7-1375.g2577e813.el9 5.0 MB/s | 344 kB 00:00 2024-08-17T02:21:27.005 INFO:teuthology.orchestra.run.smithi005.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.9 MB/s | 116 kB 00:00 2024-08-17T02:21:27.031 INFO:teuthology.orchestra.run.smithi005.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.6 MB/s | 82 kB 00:00 2024-08-17T02:21:27.033 INFO:teuthology.orchestra.run.smithi087.stdout:(37/133): ceph-test-17.2.7-1375.g2577e813.el9.x 15 MB/s | 48 MB 00:03 2024-08-17T02:21:27.058 INFO:teuthology.orchestra.run.smithi087.stdout:(38/133): fuse-2.9.9-16.el9.x86_64.rpm 141 kB/s | 80 kB 00:00 2024-08-17T02:21:27.081 INFO:teuthology.orchestra.run.smithi005.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 3.2 MB/s | 165 kB 00:00 2024-08-17T02:21:27.132 INFO:teuthology.orchestra.run.smithi005.stdout:(27/133): ceph-grafana-dashboards-17.2.7-1375.g 491 kB/s | 24 kB 00:00 2024-08-17T02:21:27.150 INFO:teuthology.orchestra.run.smithi087.stdout:(39/133): ceph-mgr-diskprediction-local-17.2.7- 5.7 MB/s | 7.4 MB 00:01 2024-08-17T02:21:27.209 INFO:teuthology.orchestra.run.smithi087.stdout:(40/133): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-08-17T02:21:27.224 INFO:teuthology.orchestra.run.smithi005.stdout:(28/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 14 MB/s | 2.9 MB 00:00 2024-08-17T02:21:27.249 INFO:teuthology.orchestra.run.smithi005.stdout:(29/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 1.0 MB/s | 124 kB 00:00 2024-08-17T02:21:27.367 INFO:teuthology.orchestra.run.smithi087.stdout:(41/133): libgfortran-11.4.1-3.el9.x86_64.rpm 2.4 MB/s | 803 kB 00:00 2024-08-17T02:21:27.392 INFO:teuthology.orchestra.run.smithi087.stdout:(42/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-08-17T02:21:27.426 INFO:teuthology.orchestra.run.smithi087.stdout:(43/133): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-08-17T02:21:27.452 INFO:teuthology.orchestra.run.smithi087.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-08-17T02:21:27.486 INFO:teuthology.orchestra.run.smithi087.stdout:(45/133): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-08-17T02:21:27.511 INFO:teuthology.orchestra.run.smithi087.stdout:(46/133): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-08-17T02:21:27.541 INFO:teuthology.orchestra.run.smithi005.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 11 MB/s | 3.4 MB 00:00 2024-08-17T02:21:27.552 INFO:teuthology.orchestra.run.smithi087.stdout:(47/133): python3-cryptography-36.0.1-4.el9.x86 3.6 MB/s | 1.2 MB 00:00 2024-08-17T02:21:27.619 INFO:teuthology.orchestra.run.smithi087.stdout:(48/133): automake-1.16.2-8.el9.noarch.rpm 5.0 MB/s | 689 kB 00:00 2024-08-17T02:21:27.636 INFO:teuthology.orchestra.run.smithi087.stdout:(49/133): elfutils-libelf-devel-0.191-4.el9.x86 260 kB/s | 22 kB 00:00 2024-08-17T02:21:27.658 INFO:teuthology.orchestra.run.smithi005.stdout:(31/133): ceph-mgr-diskprediction-local-17.2.7- 18 MB/s | 7.4 MB 00:00 2024-08-17T02:21:27.678 INFO:teuthology.orchestra.run.smithi087.stdout:(50/133): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-08-17T02:21:27.683 INFO:teuthology.orchestra.run.smithi005.stdout:(32/133): ceph-mgr-modules-core-17.2.7-1375.g25 1.7 MB/s | 240 kB 00:00 2024-08-17T02:21:27.703 INFO:teuthology.orchestra.run.smithi087.stdout:(51/133): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-08-17T02:21:27.708 INFO:teuthology.orchestra.run.smithi005.stdout:(33/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 951 kB/s | 47 kB 00:00 2024-08-17T02:21:27.733 INFO:teuthology.orchestra.run.smithi005.stdout:(34/133): ceph-prometheus-alerts-17.2.7-1375.g2 291 kB/s | 15 kB 00:00 2024-08-17T02:21:27.759 INFO:teuthology.orchestra.run.smithi005.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 5.2 MB/s | 269 kB 00:00 2024-08-17T02:21:27.762 INFO:teuthology.orchestra.run.smithi087.stdout:(52/133): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-08-17T02:21:27.784 INFO:teuthology.orchestra.run.smithi005.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.6 MB/s | 83 kB 00:00 2024-08-17T02:21:27.787 INFO:teuthology.orchestra.run.smithi087.stdout:(53/133): flexiblas-openblas-openmp-3.0.4-8.el9 218 kB/s | 18 kB 00:00 2024-08-17T02:21:27.810 INFO:teuthology.orchestra.run.smithi005.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 363 kB/s | 18 kB 00:00 2024-08-17T02:21:27.821 INFO:teuthology.orchestra.run.smithi087.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-08-17T02:21:27.905 INFO:teuthology.orchestra.run.smithi087.stdout:(55/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-08-17T02:21:27.910 INFO:teuthology.orchestra.run.smithi005.stdout:(38/133): fuse-2.9.9-16.el9.x86_64.rpm 637 kB/s | 80 kB 00:00 2024-08-17T02:21:27.930 INFO:teuthology.orchestra.run.smithi087.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 418 kB/s | 45 kB 00:00 2024-08-17T02:21:27.955 INFO:teuthology.orchestra.run.smithi087.stdout:(57/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 956 kB/s | 160 kB 00:00 2024-08-17T02:21:27.977 INFO:teuthology.orchestra.run.smithi005.stdout:(39/133): libgfortran-11.4.1-3.el9.x86_64.rpm 4.7 MB/s | 803 kB 00:00 2024-08-17T02:21:27.989 INFO:teuthology.orchestra.run.smithi087.stdout:(58/133): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-08-17T02:21:28.002 INFO:teuthology.orchestra.run.smithi005.stdout:(40/133): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-08-17T02:21:28.014 INFO:teuthology.orchestra.run.smithi087.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 436 kB/s | 25 kB 00:00 2024-08-17T02:21:28.027 INFO:teuthology.orchestra.run.smithi005.stdout:(41/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-08-17T02:21:28.039 INFO:teuthology.orchestra.run.smithi087.stdout:(60/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-08-17T02:21:28.065 INFO:teuthology.orchestra.run.smithi087.stdout:(61/133): libtool-2.4.6-46.el9.x86_64.rpm 4.2 MB/s | 581 kB 00:00 2024-08-17T02:21:28.086 INFO:teuthology.orchestra.run.smithi005.stdout:(42/133): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-08-17T02:21:28.090 INFO:teuthology.orchestra.run.smithi087.stdout:(62/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-08-17T02:21:28.115 INFO:teuthology.orchestra.run.smithi087.stdout:(63/133): openblas-0.3.21-2.el9.x86_64.rpm 468 kB/s | 35 kB 00:00 2024-08-17T02:21:28.120 INFO:teuthology.orchestra.run.smithi005.stdout:(43/133): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-08-17T02:21:28.145 INFO:teuthology.orchestra.run.smithi005.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-08-17T02:21:28.170 INFO:teuthology.orchestra.run.smithi005.stdout:(45/133): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-08-17T02:21:28.195 INFO:teuthology.orchestra.run.smithi005.stdout:(46/133): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-08-17T02:21:28.249 INFO:teuthology.orchestra.run.smithi087.stdout:(64/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-08-17T02:21:28.296 INFO:teuthology.orchestra.run.smithi005.stdout:(47/133): automake-1.16.2-8.el9.noarch.rpm 5.4 MB/s | 689 kB 00:00 2024-08-17T02:21:28.329 INFO:teuthology.orchestra.run.smithi005.stdout:(48/133): bison-3.7.4-5.el9.x86_64.rpm 6.9 MB/s | 943 kB 00:00 2024-08-17T02:21:28.354 INFO:teuthology.orchestra.run.smithi005.stdout:(49/133): elfutils-libelf-devel-0.191-4.el9.x86 373 kB/s | 22 kB 00:00 2024-08-17T02:21:28.366 INFO:teuthology.orchestra.run.smithi087.stdout:(65/133): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 6.0 MB 00:00 2024-08-17T02:21:28.380 INFO:teuthology.orchestra.run.smithi005.stdout:(50/133): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-08-17T02:21:28.400 INFO:teuthology.orchestra.run.smithi087.stdout:(66/133): python3-devel-3.9.18-3.el9.x86_64.rpm 1.6 MB/s | 244 kB 00:00 2024-08-17T02:21:28.405 INFO:teuthology.orchestra.run.smithi005.stdout:(51/133): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-08-17T02:21:28.425 INFO:teuthology.orchestra.run.smithi087.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-08-17T02:21:28.508 INFO:teuthology.orchestra.run.smithi087.stdout:(68/133): openblas-openmp-0.3.21-2.el9.x86_64.r 11 MB/s | 4.7 MB 00:00 2024-08-17T02:21:28.534 INFO:teuthology.orchestra.run.smithi087.stdout:(69/133): python3-jsonpatch-1.21-16.el9.noarch. 192 kB/s | 26 kB 00:00 2024-08-17T02:21:28.559 INFO:teuthology.orchestra.run.smithi087.stdout:(70/133): python3-jsonpointer-2.0-4.el9.noarch. 143 kB/s | 19 kB 00:00 2024-08-17T02:21:28.592 INFO:teuthology.orchestra.run.smithi087.stdout:(71/133): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-08-17T02:21:28.618 INFO:teuthology.orchestra.run.smithi087.stdout:(72/133): python3-markupsafe-1.1.1-12.el9.x86_6 596 kB/s | 35 kB 00:00 2024-08-17T02:21:28.660 INFO:teuthology.orchestra.run.smithi087.stdout:(73/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-08-17T02:21:28.696 INFO:teuthology.orchestra.run.smithi087.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 2.8 MB/s | 222 kB 00:00 2024-08-17T02:21:28.721 INFO:teuthology.orchestra.run.smithi087.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 1.2 MB/s | 77 kB 00:00 2024-08-17T02:21:28.796 INFO:teuthology.orchestra.run.smithi087.stdout:(76/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 5.1 MB 00:00 2024-08-17T02:21:28.843 INFO:teuthology.orchestra.run.smithi087.stdout:(77/133): python3-prettytable-0.7.2-27.el9.noar 287 kB/s | 42 kB 00:00 2024-08-17T02:21:28.864 INFO:teuthology.orchestra.run.smithi005.stdout:(52/133): ceph-test-17.2.7-1375.g2577e813.el9.x 18 MB/s | 48 MB 00:02 2024-08-17T02:21:28.871 INFO:teuthology.orchestra.run.smithi087.stdout:(78/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-08-17T02:21:28.889 INFO:teuthology.orchestra.run.smithi005.stdout:(53/133): flexiblas-openblas-openmp-3.0.4-8.el9 38 kB/s | 18 kB 00:00 2024-08-17T02:21:28.897 INFO:teuthology.orchestra.run.smithi087.stdout:(79/133): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-08-17T02:21:28.922 INFO:teuthology.orchestra.run.smithi087.stdout:(80/133): python3-pytz-2021.1-5.el9.noarch.rpm 645 kB/s | 51 kB 00:00 2024-08-17T02:21:28.947 INFO:teuthology.orchestra.run.smithi087.stdout:(81/133): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-08-17T02:21:28.975 INFO:teuthology.orchestra.run.smithi005.stdout:(54/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.0 MB/s | 3.0 MB 00:00 2024-08-17T02:21:28.981 INFO:teuthology.orchestra.run.smithi087.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 709 kB/s | 42 kB 00:00 2024-08-17T02:21:28.998 INFO:teuthology.orchestra.run.smithi005.stdout:(55/133): libaio-devel-0.3.111-13.el9.x86_64.rp 83 kB/s | 11 kB 00:00 2024-08-17T02:21:29.015 INFO:teuthology.orchestra.run.smithi087.stdout:(83/133): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-08-17T02:21:29.023 INFO:teuthology.orchestra.run.smithi005.stdout:(56/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-08-17T02:21:29.041 INFO:teuthology.orchestra.run.smithi087.stdout:(84/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-08-17T02:21:29.041 INFO:teuthology.orchestra.run.smithi005.stdout:(57/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 698 kB/s | 45 kB 00:00 2024-08-17T02:21:29.066 INFO:teuthology.orchestra.run.smithi087.stdout:(85/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-17T02:21:29.082 INFO:teuthology.orchestra.run.smithi005.stdout:(58/133): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-08-17T02:21:29.091 INFO:teuthology.orchestra.run.smithi087.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-08-17T02:21:29.099 INFO:teuthology.orchestra.run.smithi005.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 435 kB/s | 25 kB 00:00 2024-08-17T02:21:29.133 INFO:teuthology.orchestra.run.smithi005.stdout:(60/133): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-08-17T02:21:29.150 INFO:teuthology.orchestra.run.smithi005.stdout:(61/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 705 kB/s | 47 kB 00:00 2024-08-17T02:21:29.175 INFO:teuthology.orchestra.run.smithi005.stdout:(62/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-08-17T02:21:29.182 INFO:teuthology.orchestra.run.smithi087.stdout:(87/133): liboath-2.6.7-2.el9.x86_64.rpm 772 kB/s | 49 kB 00:00 2024-08-17T02:21:29.192 INFO:teuthology.orchestra.run.smithi005.stdout:(63/133): openblas-0.3.21-2.el9.x86_64.rpm 601 kB/s | 35 kB 00:00 2024-08-17T02:21:29.208 INFO:teuthology.orchestra.run.smithi087.stdout:(88/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.1 MB/s | 309 kB 00:00 2024-08-17T02:21:29.233 INFO:teuthology.orchestra.run.smithi087.stdout:(89/133): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-08-17T02:21:29.259 INFO:teuthology.orchestra.run.smithi087.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:21:29.284 INFO:teuthology.orchestra.run.smithi087.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-17T02:21:29.310 INFO:teuthology.orchestra.run.smithi087.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 569 kB/s | 14 kB 00:00 2024-08-17T02:21:29.310 INFO:teuthology.orchestra.run.smithi005.stdout:(64/133): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-08-17T02:21:29.343 INFO:teuthology.orchestra.run.smithi087.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 5.1 MB/s | 172 kB 00:00 2024-08-17T02:21:29.368 INFO:teuthology.orchestra.run.smithi087.stdout:(94/133): python3-asyncssh-2.13.2-5.el9.noarch. 3.3 MB/s | 548 kB 00:00 2024-08-17T02:21:29.376 INFO:teuthology.orchestra.run.smithi005.stdout:(65/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-08-17T02:21:29.401 INFO:teuthology.orchestra.run.smithi005.stdout:(66/133): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-08-17T02:21:29.410 INFO:teuthology.orchestra.run.smithi087.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 5.2 MB/s | 220 kB 00:00 2024-08-17T02:21:29.427 INFO:teuthology.orchestra.run.smithi087.stdout:(96/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 645 kB/s | 11 kB 00:00 2024-08-17T02:21:29.435 INFO:teuthology.orchestra.run.smithi005.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-08-17T02:21:29.460 INFO:teuthology.orchestra.run.smithi005.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-08-17T02:21:29.460 INFO:teuthology.orchestra.run.smithi087.stdout:(97/133): python3-cherrypy-18.6.1-2.el9.noarch. 3.0 MB/s | 358 kB 00:00 2024-08-17T02:21:29.485 INFO:teuthology.orchestra.run.smithi005.stdout:(69/133): python3-jsonpointer-2.0-4.el9.noarch. 385 kB/s | 19 kB 00:00 2024-08-17T02:21:29.486 INFO:teuthology.orchestra.run.smithi087.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 301 kB/s | 18 kB 00:00 2024-08-17T02:21:29.510 INFO:teuthology.orchestra.run.smithi005.stdout:(70/133): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-08-17T02:21:29.511 INFO:teuthology.orchestra.run.smithi087.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 460 kB/s | 23 kB 00:00 2024-08-17T02:21:29.536 INFO:teuthology.orchestra.run.smithi005.stdout:(71/133): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-08-17T02:21:29.537 INFO:teuthology.orchestra.run.smithi087.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 385 kB/s | 19 kB 00:00 2024-08-17T02:21:29.562 INFO:teuthology.orchestra.run.smithi087.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-08-17T02:21:29.586 INFO:teuthology.orchestra.run.smithi005.stdout:(72/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-08-17T02:21:29.596 INFO:teuthology.orchestra.run.smithi087.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 154 kB/s | 9.0 kB 00:00 2024-08-17T02:21:29.621 INFO:teuthology.orchestra.run.smithi087.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 697 kB/s | 41 kB 00:00 2024-08-17T02:21:29.646 INFO:teuthology.orchestra.run.smithi087.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:21:29.661 INFO:teuthology.orchestra.run.smithi005.stdout:(73/133): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-08-17T02:21:29.672 INFO:teuthology.orchestra.run.smithi087.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:21:29.687 INFO:teuthology.orchestra.run.smithi005.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-08-17T02:21:29.697 INFO:teuthology.orchestra.run.smithi087.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-17T02:21:29.712 INFO:teuthology.orchestra.run.smithi005.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-17T02:21:29.737 INFO:teuthology.orchestra.run.smithi005.stdout:(76/133): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-08-17T02:21:29.739 INFO:teuthology.orchestra.run.smithi087.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 6.4 MB/s | 272 kB 00:00 2024-08-17T02:21:29.764 INFO:teuthology.orchestra.run.smithi087.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-08-17T02:21:29.771 INFO:teuthology.orchestra.run.smithi005.stdout:(77/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-08-17T02:21:29.796 INFO:teuthology.orchestra.run.smithi005.stdout:(78/133): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-08-17T02:21:29.812 INFO:teuthology.orchestra.run.smithi087.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.9 MB/s | 90 kB 00:00 2024-08-17T02:21:29.821 INFO:teuthology.orchestra.run.smithi005.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-17T02:21:29.857 INFO:teuthology.orchestra.run.smithi087.stdout:(110/133): python3-kubernetes-26.1.0-2.el9.noar 3.9 MB/s | 1.0 MB 00:00 2024-08-17T02:21:29.868 INFO:teuthology.orchestra.run.smithi005.stdout:(80/133): python3-requests-oauthlib-1.3.0-12.el 750 kB/s | 54 kB 00:00 2024-08-17T02:21:29.890 INFO:teuthology.orchestra.run.smithi087.stdout:(111/133): python3-repoze-lru-0.7-16.el9.noarch 395 kB/s | 31 kB 00:00 2024-08-17T02:21:29.915 INFO:teuthology.orchestra.run.smithi087.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 2.4 MB/s | 59 kB 00:00 2024-08-17T02:21:29.941 INFO:teuthology.orchestra.run.smithi087.stdout:(113/133): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-17T02:21:29.951 INFO:teuthology.orchestra.run.smithi005.stdout:(81/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-08-17T02:21:29.966 INFO:teuthology.orchestra.run.smithi087.stdout:(114/133): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-08-17T02:21:29.972 INFO:teuthology.orchestra.run.smithi005.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 402 kB/s | 42 kB 00:00 2024-08-17T02:21:29.992 INFO:teuthology.orchestra.run.smithi087.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-17T02:21:30.017 INFO:teuthology.orchestra.run.smithi087.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-17T02:21:30.022 INFO:teuthology.orchestra.run.smithi005.stdout:(83/133): socat-1.7.4.1-6.el9.x86_64.rpm 4.0 MB/s | 304 kB 00:00 2024-08-17T02:21:30.042 INFO:teuthology.orchestra.run.smithi087.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-17T02:21:30.048 INFO:teuthology.orchestra.run.smithi005.stdout:(84/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.2 MB/s | 96 kB 00:00 2024-08-17T02:21:30.067 INFO:teuthology.orchestra.run.smithi087.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 811 kB/s | 20 kB 00:00 2024-08-17T02:21:30.074 INFO:teuthology.orchestra.run.smithi005.stdout:(85/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-17T02:21:30.098 INFO:teuthology.orchestra.run.smithi005.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-08-17T02:21:30.109 INFO:teuthology.orchestra.run.smithi087.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-08-17T02:21:30.176 INFO:teuthology.orchestra.run.smithi087.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-17T02:21:30.199 INFO:teuthology.orchestra.run.smithi005.stdout:(87/133): liboath-2.6.7-2.el9.x86_64.rpm 487 kB/s | 49 kB 00:00 2024-08-17T02:21:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:(88/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.0 MB/s | 309 kB 00:00 2024-08-17T02:21:30.250 INFO:teuthology.orchestra.run.smithi005.stdout:(89/133): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-08-17T02:21:30.275 INFO:teuthology.orchestra.run.smithi005.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:21:30.300 INFO:teuthology.orchestra.run.smithi005.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-17T02:21:30.317 INFO:teuthology.orchestra.run.smithi005.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 852 kB/s | 14 kB 00:00 2024-08-17T02:21:30.359 INFO:teuthology.orchestra.run.smithi005.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 4.0 MB/s | 172 kB 00:00 2024-08-17T02:21:30.393 INFO:teuthology.orchestra.run.smithi005.stdout:(94/133): python3-asyncssh-2.13.2-5.el9.noarch. 3.2 MB/s | 548 kB 00:00 2024-08-17T02:21:30.402 INFO:teuthology.orchestra.run.smithi087.stdout:(121/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-17T02:21:30.426 INFO:teuthology.orchestra.run.smithi005.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 6.5 MB/s | 220 kB 00:00 2024-08-17T02:21:30.443 INFO:teuthology.orchestra.run.smithi005.stdout:(96/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 639 kB/s | 11 kB 00:00 2024-08-17T02:21:30.477 INFO:teuthology.orchestra.run.smithi005.stdout:(97/133): python3-cherrypy-18.6.1-2.el9.noarch. 3.0 MB/s | 358 kB 00:00 2024-08-17T02:21:30.494 INFO:teuthology.orchestra.run.smithi005.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 353 kB/s | 18 kB 00:00 2024-08-17T02:21:30.511 INFO:teuthology.orchestra.run.smithi005.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 688 kB/s | 23 kB 00:00 2024-08-17T02:21:30.518 INFO:teuthology.orchestra.run.smithi087.stdout:(122/133): librados2-17.2.7-1375.g2577e813.el9. 7.5 MB/s | 3.1 MB 00:00 2024-08-17T02:21:30.528 INFO:teuthology.orchestra.run.smithi005.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 578 kB/s | 19 kB 00:00 2024-08-17T02:21:30.545 INFO:teuthology.orchestra.run.smithi005.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 589 kB/s | 20 kB 00:00 2024-08-17T02:21:30.561 INFO:teuthology.orchestra.run.smithi005.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 272 kB/s | 9.0 kB 00:00 2024-08-17T02:21:30.577 INFO:teuthology.orchestra.run.smithi087.stdout:(123/133): librbd1-17.2.7-1375.g2577e813.el9.x8 7.3 MB/s | 2.9 MB 00:00 2024-08-17T02:21:30.579 INFO:teuthology.orchestra.run.smithi005.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 1.2 MB/s | 41 kB 00:00 2024-08-17T02:21:30.596 INFO:teuthology.orchestra.run.smithi005.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-08-17T02:21:30.612 INFO:teuthology.orchestra.run.smithi005.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 4.7 MB/s | 79 kB 00:00 2024-08-17T02:21:30.638 INFO:teuthology.orchestra.run.smithi005.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-17T02:21:30.672 INFO:teuthology.orchestra.run.smithi005.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-17T02:21:30.697 INFO:teuthology.orchestra.run.smithi005.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 666 kB/s | 16 kB 00:00 2024-08-17T02:21:30.702 INFO:teuthology.orchestra.run.smithi087.stdout:(124/133): NetworkManager-team-1.48.2-2.el9.x86 326 kB/s | 41 kB 00:00 2024-08-17T02:21:30.722 INFO:teuthology.orchestra.run.smithi005.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-17T02:21:30.773 INFO:teuthology.orchestra.run.smithi005.stdout:(110/133): python3-repoze-lru-0.7-16.el9.noarch 617 kB/s | 31 kB 00:00 2024-08-17T02:21:30.806 INFO:teuthology.orchestra.run.smithi005.stdout:(111/133): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-08-17T02:21:30.828 INFO:teuthology.orchestra.run.smithi087.stdout:(125/133): NetworkManager-tui-1.48.2-2.el9.x86_ 1.9 MB/s | 247 kB 00:00 2024-08-17T02:21:30.832 INFO:teuthology.orchestra.run.smithi005.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-17T02:21:30.856 INFO:teuthology.orchestra.run.smithi005.stdout:(113/133): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-08-17T02:21:30.870 INFO:teuthology.orchestra.run.smithi087.stdout:(126/133): NetworkManager-libnm-1.48.2-2.el9.x8 5.1 MB/s | 1.8 MB 00:00 2024-08-17T02:21:30.882 INFO:teuthology.orchestra.run.smithi005.stdout:(114/133): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-08-17T02:21:30.895 INFO:teuthology.orchestra.run.smithi087.stdout:(127/133): elfutils-debuginfod-client-0.191-4.e 551 kB/s | 37 kB 00:00 2024-08-17T02:21:30.907 INFO:teuthology.orchestra.run.smithi005.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-08-17T02:21:30.929 INFO:teuthology.orchestra.run.smithi087.stdout:(128/133): elfutils-libelf-0.191-4.el9.x86_64.r 3.4 MB/s | 207 kB 00:00 2024-08-17T02:21:30.932 INFO:teuthology.orchestra.run.smithi005.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-17T02:21:30.957 INFO:teuthology.orchestra.run.smithi005.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-17T02:21:30.983 INFO:teuthology.orchestra.run.smithi005.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 796 kB/s | 20 kB 00:00 2024-08-17T02:21:30.987 INFO:teuthology.orchestra.run.smithi087.stdout:(129/133): elfutils-libs-0.191-4.el9.x86_64.rpm 2.7 MB/s | 260 kB 00:00 2024-08-17T02:21:31.017 INFO:teuthology.orchestra.run.smithi005.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-08-17T02:21:31.038 INFO:teuthology.orchestra.run.smithi087.stdout:(130/133): openssl-3.2.2-2.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-08-17T02:21:31.075 INFO:teuthology.orchestra.run.smithi005.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-08-17T02:21:31.096 INFO:teuthology.orchestra.run.smithi087.stdout:(131/133): NetworkManager-1.48.2-2.el9.x86_64.r 3.3 MB/s | 2.3 MB 00:00 2024-08-17T02:21:31.138 INFO:teuthology.orchestra.run.smithi087.stdout:(132/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-08-17T02:21:31.326 INFO:teuthology.orchestra.run.smithi005.stdout:(121/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-17T02:21:31.418 INFO:teuthology.orchestra.run.smithi005.stdout:(122/133): librbd1-17.2.7-1375.g2577e813.el9.x8 8.6 MB/s | 2.9 MB 00:00 2024-08-17T02:21:31.455 INFO:teuthology.orchestra.run.smithi087.stdout:(133/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 5.1 MB/s | 2.4 MB 00:00 2024-08-17T02:21:31.461 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:21:31.461 INFO:teuthology.orchestra.run.smithi087.stdout:Total 20 MB/s | 206 MB 00:10 2024-08-17T02:21:31.476 INFO:teuthology.orchestra.run.smithi005.stdout:(123/133): librados2-17.2.7-1375.g2577e813.el9. 6.7 MB/s | 3.1 MB 00:00 2024-08-17T02:21:31.543 INFO:teuthology.orchestra.run.smithi005.stdout:(124/133): NetworkManager-1.48.2-2.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-08-17T02:21:31.568 INFO:teuthology.orchestra.run.smithi005.stdout:(125/133): NetworkManager-team-1.48.2-2.el9.x86 443 kB/s | 41 kB 00:00 2024-08-17T02:21:31.602 INFO:teuthology.orchestra.run.smithi005.stdout:(126/133): NetworkManager-tui-1.48.2-2.el9.x86_ 4.1 MB/s | 247 kB 00:00 2024-08-17T02:21:31.648 INFO:teuthology.orchestra.run.smithi005.stdout:(127/133): elfutils-debuginfod-client-0.191-4.e 462 kB/s | 37 kB 00:00 2024-08-17T02:21:31.678 INFO:teuthology.orchestra.run.smithi005.stdout:(128/133): elfutils-libelf-0.191-4.el9.x86_64.r 2.7 MB/s | 207 kB 00:00 2024-08-17T02:21:31.728 INFO:teuthology.orchestra.run.smithi005.stdout:(129/133): NetworkManager-libnm-1.48.2-2.el9.x8 5.8 MB/s | 1.8 MB 00:00 2024-08-17T02:21:31.753 INFO:teuthology.orchestra.run.smithi005.stdout:(130/133): elfutils-libs-0.191-4.el9.x86_64.rpm 2.4 MB/s | 260 kB 00:00 2024-08-17T02:21:31.803 INFO:teuthology.orchestra.run.smithi005.stdout:(131/133): openssl-3.2.2-2.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-08-17T02:21:31.862 INFO:teuthology.orchestra.run.smithi005.stdout:(132/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 18 MB/s | 2.4 MB 00:00 2024-08-17T02:21:31.903 INFO:teuthology.orchestra.run.smithi005.stdout:(133/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 7.2 MB/s | 1.1 MB 00:00 2024-08-17T02:21:31.908 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:21:31.908 INFO:teuthology.orchestra.run.smithi005.stdout:Total 24 MB/s | 206 MB 00:08 2024-08-17T02:21:33.178 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-08-17T02:21:33.386 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-08-17T02:21:33.386 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-08-17T02:21:33.646 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-08-17T02:21:33.873 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-08-17T02:21:33.873 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-08-17T02:21:35.492 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-08-17T02:21:35.493 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-08-17T02:21:36.083 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-08-17T02:21:36.084 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-08-17T02:21:41.259 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-08-17T02:21:41.394 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:21:41.450 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:21:41.517 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:21:41.562 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:21:41.595 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:21:41.651 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:21:41.986 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-08-17T02:21:41.989 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:21:42.076 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:21:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:21:42.128 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:21:42.193 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:21:42.232 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:21:42.237 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:21:42.268 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:21:42.281 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:21:42.328 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:21:42.399 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:21:42.691 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:21:42.785 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:21:42.877 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:21:42.907 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:21:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:21:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:21:42.999 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:21:43.079 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:21:43.099 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:21:43.125 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:21:43.244 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:21:43.276 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:21:43.421 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:21:43.578 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:21:43.604 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:21:43.692 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:21:43.694 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:21:43.772 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:21:43.806 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:21:43.874 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:21:43.930 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:21:43.952 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:21:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:21:44.056 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:21:44.132 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:21:44.152 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:21:44.619 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:21:44.636 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:21:44.733 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:21:44.778 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:21:44.829 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:21:44.858 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:21:44.891 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:21:44.901 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:21:44.936 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:21:45.011 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:21:45.022 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:21:45.087 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:21:45.109 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:21:45.127 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:21:45.199 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:21:45.291 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:21:45.331 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:21:45.374 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:21:45.457 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:21:45.466 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:21:45.500 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:21:45.537 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:21:45.622 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:21:45.626 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:21:45.669 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:21:45.686 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:21:45.702 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:21:45.795 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:21:45.856 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:21:45.889 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:21:45.947 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:21:46.043 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:21:46.077 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:21:46.123 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:21:46.220 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:21:46.334 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:21:46.404 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:21:46.428 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:21:46.471 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:21:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:21:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:21:46.582 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:21:46.630 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:21:46.683 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:21:46.731 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:21:46.790 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:21:46.874 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:21:46.924 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:21:47.152 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:21:47.172 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:21:47.285 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:21:47.337 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:21:47.387 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:21:47.499 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:21:47.557 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:21:47.558 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:21:47.599 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:21:47.603 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:21:47.647 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:21:47.648 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:21:47.689 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:21:47.735 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:21:47.761 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:21:47.773 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:21:47.813 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:21:47.836 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:21:47.865 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:21:47.895 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:21:47.921 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:21:47.932 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:21:47.957 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:21:47.969 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:21:47.993 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:21:48.007 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:21:48.041 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:21:48.074 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:21:48.083 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:21:48.138 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:21:48.142 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:21:48.176 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:21:48.189 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:21:48.212 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:21:48.261 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:21:48.370 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:21:48.382 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:21:48.412 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:21:48.450 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:21:48.456 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:21:48.588 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:21:48.638 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:21:48.681 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:21:48.720 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:21:48.756 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:21:48.795 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:21:48.831 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:21:48.866 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:21:48.899 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:21:48.969 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:21:49.000 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:21:49.036 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:21:49.088 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:21:49.215 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:21:49.276 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:21:49.322 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:21:49.376 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:21:49.410 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:21:49.523 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:21:49.569 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:21:49.798 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:21:49.842 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:21:49.934 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:21:50.240 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:21:50.293 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:21:50.327 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:21:50.459 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:21:50.632 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:21:50.724 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:21:50.760 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:21:50.815 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:21:50.870 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:21:50.924 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:21:51.791 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:21:51.934 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:21:52.465 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:21:52.554 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:21:52.590 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:21:52.624 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:21:52.938 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:21:52.985 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:21:53.101 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:21:53.137 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:21:53.632 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:21:53.720 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:21:53.748 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:21:53.772 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:21:54.109 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:21:54.150 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:21:54.267 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:21:54.313 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:21:55.674 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:21:55.709 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:21:56.322 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:21:56.370 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:21:56.497 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:21:56.497 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:21:56.497 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:21:56.497 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:21:56.540 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:21:57.064 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:21:57.115 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:21:57.741 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:21:57.794 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:21:58.068 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:21:58.068 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:21:58.068 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:21:58.069 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:21:58.111 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:22:08.716 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:22:08.716 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /sys 2024-08-17T02:22:08.716 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /proc 2024-08-17T02:22:08.717 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /mnt 2024-08-17T02:22:08.717 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /var/tmp 2024-08-17T02:22:08.717 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /home 2024-08-17T02:22:08.717 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /root 2024-08-17T02:22:08.717 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /tmp 2024-08-17T02:22:08.717 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:08.932 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:22:08.968 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:22:08.969 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:08.969 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:22:08.969 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:10.417 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:22:10.475 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:22:10.475 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:10.475 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:22:10.475 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:22:10.476 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:22:10.476 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:10.593 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:22:10.593 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2024-08-17T02:22:10.593 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2024-08-17T02:22:10.593 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2024-08-17T02:22:10.593 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2024-08-17T02:22:10.593 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2024-08-17T02:22:10.593 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /root 2024-08-17T02:22:10.593 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2024-08-17T02:22:10.594 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:10.692 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:22:10.744 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:22:10.744 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:10.744 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:22:10.744 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:22:10.744 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:22:10.744 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:10.794 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:22:10.832 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:22:10.833 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:10.833 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:22:10.833 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:11.143 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:22:11.194 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:22:11.195 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:11.318 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:22:11.378 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:22:11.467 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:22:11.692 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:22:11.755 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:22:11.842 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:22:11.950 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:22:12.112 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:22:12.162 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:22:12.186 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:22:12.221 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:22:12.261 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:22:12.288 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:22:12.366 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:22:12.423 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:22:12.423 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:12.423 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:22:12.423 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:22:12.423 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:22:12.423 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:12.664 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:22:12.716 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:22:12.716 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:12.716 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:22:12.716 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:22:12.716 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:22:12.716 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:12.740 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:22:12.770 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:22:12.808 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:22:12.869 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:22:12.900 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:22:13.140 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:22:13.193 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:22:13.194 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:13.194 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:22:13.194 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:22:13.194 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:22:13.194 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:13.324 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:22:13.386 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:22:13.476 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:22:13.712 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:22:13.770 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:22:13.859 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:22:14.011 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:22:14.046 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:22:14.094 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:22:14.182 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:22:14.233 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:22:14.258 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:22:14.294 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:22:14.343 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:22:14.368 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:22:14.939 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:22:14.976 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:22:15.006 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:22:15.069 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:22:15.098 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:22:15.173 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:22:15.202 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:22:15.339 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:22:15.498 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:22:15.530 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:22:15.582 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:15.630 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:22:15.657 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:22:15.758 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:22:15.827 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:22:16.321 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:22:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:22:17.156 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:22:17.191 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:22:17.305 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:22:17.305 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:17.305 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:22:17.305 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:22:17.305 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:22:17.305 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:17.351 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:22:17.401 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:22:17.401 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:17.401 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:22:17.401 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:17.460 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:22:17.511 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:22:17.511 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:17.511 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:22:17.512 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:22:17.512 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:22:17.512 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:17.519 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:22:17.559 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:22:17.703 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:22:17.878 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:22:17.918 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:22:17.919 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:22:17.970 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:22:17.970 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:17.970 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:22:17.971 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:22:17.971 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:22:17.971 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:17.972 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:22:17.972 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:17.972 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:22:17.972 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:22:17.972 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:22:17.972 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:18.020 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:22:18.047 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:22:18.151 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:22:18.220 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:22:19.625 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:22:19.656 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:22:19.770 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:22:19.770 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:19.770 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:22:19.770 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:22:19.770 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:22:19.771 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:19.816 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:22:19.867 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:22:19.867 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:19.867 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:22:19.867 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:19.942 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:22:19.994 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:22:19.994 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:19.994 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:22:19.994 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:22:19.994 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:22:19.994 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:20.334 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:22:20.386 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:22:20.387 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:20.387 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:22:20.387 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:22:20.387 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:22:20.387 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:22.639 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:22:22.681 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:22:22.724 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:22:22.753 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:22:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:22:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:22:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:22:22.884 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:22:22.965 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:22:24.257 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:22:24.509 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:22:24.586 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:22:24.632 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:22:24.737 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:22:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:22:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:22:24.848 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:22:24.884 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:22:24.884 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:22:24.984 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:22:25.016 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:22:25.016 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:22:25.126 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:22:25.150 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:22:25.167 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:22:25.167 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:22:25.406 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:22:25.419 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:22:25.420 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:22:25.448 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:22:25.492 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:22:25.538 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:22:25.545 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:22:25.570 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:22:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:22:25.606 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:22:25.614 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:22:25.653 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:22:25.677 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:22:25.685 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:22:25.733 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:22:25.890 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:22:25.890 INFO:teuthology.orchestra.run.smithi087.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:22:25.890 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:27.110 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:22:27.372 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:22:27.462 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:22:27.512 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:22:27.626 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:22:27.657 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:22:27.682 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:22:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:22:27.739 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:22:27.739 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:22:27.836 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:22:27.868 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:22:27.869 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:22:27.979 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:22:28.003 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:22:28.029 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:22:28.029 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:22:28.281 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:22:28.281 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:22:28.391 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:22:28.431 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:22:28.466 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:22:28.550 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:22:28.766 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:22:28.767 INFO:teuthology.orchestra.run.smithi005.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:22:28.767 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:30.976 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:22:30.977 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:22:30.977 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:22:30.977 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:22:30.977 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:22:30.977 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:22:30.977 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:22:30.977 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:22:30.977 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:22:30.977 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:22:30.977 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:22:30.977 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:22:30.977 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:22:30.978 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:22:30.978 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:22:30.978 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:22:30.978 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:22:30.978 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:22:30.978 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:22:30.978 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:22:30.978 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:22:30.978 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:22:30.978 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:22:30.979 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:22:30.979 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:22:30.979 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:22:30.979 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:22:30.979 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:22:30.979 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:22:30.979 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:22:30.979 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:22:30.990 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:22:30.990 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:22:30.990 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:22:30.990 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:22:30.990 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:22:30.990 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:22:30.990 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:22:30.990 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:22:30.990 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:22:30.991 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:22:30.991 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:22:30.991 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:22:30.991 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:22:30.991 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:22:30.991 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:22:30.991 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:22:30.991 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:22:30.991 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:22:30.991 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:22:30.991 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:22:30.991 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:22:30.992 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:22:30.992 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:22:30.992 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:22:30.992 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:22:30.992 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:22:30.992 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:22:30.992 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:22:30.992 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:22:30.992 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:22:30.992 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:22:30.992 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:22:30.993 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:22:30.993 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:22:30.993 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:22:30.993 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:22:30.993 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:22:30.993 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:22:30.993 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:22:30.993 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:22:30.993 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:22:30.993 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:22:30.993 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:22:30.993 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:22:30.994 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:22:30.994 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:22:30.994 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:22:30.994 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:22:30.994 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:22:30.994 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:22:30.994 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:22:30.994 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:22:30.994 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:22:30.994 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:22:30.994 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:22:30.994 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:22:30.995 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:22:30.995 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:22:30.995 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:22:30.995 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:22:30.995 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:22:30.995 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:22:30.995 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:22:30.995 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:22:30.995 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:22:30.995 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:22:30.995 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:22:30.996 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:22:30.996 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:22:30.996 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:22:30.996 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:22:30.996 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:22:30.996 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:22:30.996 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:22:30.996 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:22:30.996 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:22:30.996 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:22:30.996 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:22:30.996 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:22:30.996 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:22:30.997 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:22:30.997 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:22:30.997 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:22:30.997 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:22:30.997 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:22:30.997 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:22:30.997 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:22:30.997 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:22:30.997 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:22:30.997 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:22:30.997 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:22:30.997 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:22:30.997 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:22:30.997 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:22:30.998 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:22:30.998 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:22:30.998 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:22:30.998 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:22:30.998 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:22:30.998 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:22:30.998 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:22:30.998 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:22:30.998 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:22:30.998 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:22:30.998 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:22:30.998 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:22:30.999 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:22:30.999 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:22:30.999 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:22:30.999 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:22:30.999 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:22:30.999 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:22:30.999 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:22:32.926 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:22:32.927 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:32.927 INFO:teuthology.orchestra.run.smithi087.stdout:Upgraded: 2024-08-17T02:22:32.927 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:22:32.927 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:22:32.927 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:22:32.927 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:22:32.927 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:22:32.927 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:22:32.927 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:22:32.927 INFO:teuthology.orchestra.run.smithi087.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.927 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.928 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:22:32.928 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:22:32.928 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:22:32.928 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-08-17T02:22:32.928 INFO:teuthology.orchestra.run.smithi087.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:22:32.928 INFO:teuthology.orchestra.run.smithi087.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:22:32.928 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.928 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.928 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.928 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.928 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:32.928 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.929 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.929 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.929 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:32.929 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:32.929 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:32.929 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:32.929 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:32.929 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.929 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.929 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:32.929 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.929 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.930 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.930 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:32.930 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:32.930 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.930 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:32.930 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:22:32.930 INFO:teuthology.orchestra.run.smithi087.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:22:32.930 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:22:32.930 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:22:32.930 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:22:32.930 INFO:teuthology.orchestra.run.smithi087.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:22:32.930 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:22:32.931 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:22:32.931 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.931 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.931 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.931 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:22:32.931 INFO:teuthology.orchestra.run.smithi087.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:22:32.931 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:22:32.931 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:22:32.931 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:22:32.931 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.931 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.931 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:22:32.931 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.932 INFO:teuthology.orchestra.run.smithi087.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:22:32.932 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:22:32.932 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:22:32.932 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:22:32.932 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:22:32.932 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:22:32.932 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:22:32.932 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:22:32.932 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:22:32.932 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:22:32.932 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:22:32.932 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:22:32.933 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.933 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.933 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.933 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:22:32.933 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:22:32.933 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:22:32.933 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:22:32.933 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:22:32.933 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:22:32.933 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:22:32.933 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:22:32.933 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:22:32.934 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:22:32.934 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:22:32.934 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:22:32.934 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:22:32.934 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:22:32.934 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:22:32.934 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:22:32.934 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:22:32.934 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:22:32.934 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:22:32.934 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:22:32.934 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:22:32.935 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:22:32.935 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:22:32.935 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:22:32.935 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:22:32.935 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:22:32.935 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:22:32.935 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:22:32.935 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:22:32.935 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:22:32.936 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:22:32.936 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:22:32.936 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:22:32.936 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:22:32.936 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:22:32.936 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:22:32.936 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.936 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.936 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:22:32.936 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:22:32.936 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:22:32.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:22:32.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:22:32.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:22:32.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:22:32.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:22:32.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:22:32.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:22:32.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:22:32.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:22:32.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:22:32.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:22:32.937 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.938 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.938 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:32.938 INFO:teuthology.orchestra.run.smithi087.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:22:32.938 INFO:teuthology.orchestra.run.smithi087.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:22:32.938 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:22:32.938 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:22:32.938 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:22:32.938 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:32.939 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-08-17T02:22:33.556 DEBUG:teuthology.parallel:result is None 2024-08-17T02:22:33.975 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:22:33.975 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:22:33.975 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:22:33.975 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:22:33.975 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:22:33.975 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:22:33.976 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:22:33.976 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:22:33.976 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:22:33.976 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:22:33.976 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:22:33.976 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:22:33.976 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:22:33.976 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:22:33.976 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:22:33.976 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:22:33.976 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:22:33.976 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:22:33.977 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:22:33.977 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:22:33.977 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:22:33.977 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:22:33.977 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:22:33.977 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:22:33.977 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:22:33.977 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:22:33.977 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:22:33.977 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:22:33.977 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:22:33.977 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:22:33.987 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:22:33.988 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:22:33.988 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:22:33.988 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:22:33.988 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:22:33.988 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:22:33.988 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:22:33.988 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:22:33.988 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:22:33.988 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:22:33.988 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:22:33.988 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:22:33.988 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:22:33.989 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:22:33.989 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:22:33.989 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:22:33.989 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:22:33.989 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:22:33.989 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:22:33.989 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:22:33.989 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:22:33.989 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:22:33.989 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:22:33.989 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:22:33.989 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:22:33.989 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:22:33.990 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:22:33.990 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:22:33.990 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:22:33.990 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:22:33.990 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:22:33.990 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:22:33.990 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:22:33.990 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:22:33.990 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:22:33.990 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:22:33.990 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:22:33.990 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:22:33.990 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:22:33.991 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:22:33.991 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:22:33.991 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:22:33.991 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:22:33.991 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:22:33.991 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:22:33.991 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:22:33.991 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:22:33.991 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:22:33.991 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:22:33.991 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:22:33.991 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:22:33.991 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:22:33.992 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:22:33.992 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:22:33.992 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:22:33.992 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:22:33.992 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:22:33.992 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:22:33.992 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:22:33.992 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:22:33.992 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:22:33.992 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:22:33.992 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:22:33.992 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:22:33.992 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:22:33.993 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:22:33.993 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:22:33.993 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:22:33.993 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:22:33.993 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:22:33.993 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:22:33.993 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:22:33.993 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:22:33.993 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:22:33.993 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:22:33.993 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:22:33.993 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:22:33.993 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:22:33.993 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:22:33.994 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:22:33.994 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:22:33.994 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:22:33.994 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:22:33.994 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:22:33.994 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:22:33.994 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:22:33.994 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:22:33.994 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:22:33.994 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:22:33.994 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:22:33.994 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:22:33.994 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:22:33.995 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:22:33.995 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:22:33.995 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:22:33.995 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:22:33.995 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:22:33.995 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:22:33.995 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:22:33.995 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:22:33.995 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:22:33.995 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:22:33.995 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:22:33.995 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:22:33.995 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:22:33.996 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:22:33.996 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:22:33.996 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:22:33.996 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:22:33.996 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:22:33.996 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:22:33.996 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:22:33.996 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:22:33.996 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:22:36.081 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:22:36.081 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:36.081 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2024-08-17T02:22:36.081 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:22:36.082 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:22:36.082 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:22:36.082 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:22:36.082 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:22:36.082 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:22:36.082 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:22:36.082 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.082 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.082 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:22:36.082 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:22:36.082 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:22:36.082 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-08-17T02:22:36.083 INFO:teuthology.orchestra.run.smithi005.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:22:36.083 INFO:teuthology.orchestra.run.smithi005.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:22:36.083 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.083 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.083 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.083 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.083 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:36.083 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.083 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.083 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.083 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:36.083 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:36.083 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:36.084 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:36.084 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:36.084 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.084 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.084 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:36.084 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.084 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.084 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.084 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:36.084 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:36.084 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.084 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:22:36.084 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:22:36.085 INFO:teuthology.orchestra.run.smithi005.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:22:36.085 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:22:36.085 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:22:36.085 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:22:36.085 INFO:teuthology.orchestra.run.smithi005.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:22:36.085 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:22:36.085 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:22:36.085 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.085 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.085 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.085 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:22:36.085 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:22:36.085 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:22:36.086 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:22:36.086 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:22:36.086 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.086 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.086 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:22:36.086 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.086 INFO:teuthology.orchestra.run.smithi005.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:22:36.086 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:22:36.086 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:22:36.086 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:22:36.086 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:22:36.086 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:22:36.087 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:22:36.087 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:22:36.087 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:22:36.087 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:22:36.087 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:22:36.087 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:22:36.087 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.087 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.087 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.087 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:22:36.087 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:22:36.087 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:22:36.087 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:22:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:22:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:22:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:22:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:22:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:22:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:22:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:22:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:22:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:22:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:22:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:22:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:22:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:22:36.089 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:22:36.089 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:22:36.089 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:22:36.089 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:22:36.089 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:22:36.089 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:22:36.089 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:22:36.089 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:22:36.089 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:22:36.089 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:22:36.089 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:22:36.089 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:22:36.089 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:22:36.090 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:22:36.090 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:22:36.090 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:22:36.090 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:22:36.090 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:22:36.090 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:22:36.090 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.090 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.090 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:22:36.090 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:22:36.090 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:22:36.090 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.090 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:22:36.091 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:22:36.091 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:22:36.091 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:22:36.091 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:22:36.091 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:22:36.091 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:22:36.091 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:22:36.091 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:22:36.091 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:22:36.091 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:22:36.091 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.091 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.091 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:22:36.092 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:22:36.092 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:22:36.092 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:22:36.092 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:22:36.092 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:22:36.093 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:36.093 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-08-17T02:22:36.741 DEBUG:teuthology.parallel:result is None 2024-08-17T02:22:36.741 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:22:36.887 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:22:36.935 INFO:teuthology.orchestra.run.smithi005.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:22:36.936 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:22:36.936 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:22:36.938 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:22:37.079 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:22:37.130 INFO:teuthology.orchestra.run.smithi087.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:22:37.130 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:22:37.130 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:22:37.132 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:22:37.133 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:22:37.133 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:22:37.193 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:22:37.194 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:22:37.256 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:22:37.256 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:22:37.256 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:22:37.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:22:37.408 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:22:37.408 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:22:37.466 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:22:37.561 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:22:37.561 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:22:37.562 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:22:37.620 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:22:37.717 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:22:37.717 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:22:37.772 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:22:37.867 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:22:37.867 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:22:37.867 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:22:37.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:22:38.022 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:22:38.022 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:22:38.078 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:22:38.173 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:22:38.254 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:22:38.254 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /var/log/ceph 2024-08-17T02:22:38.258 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /var/log/ceph 2024-08-17T02:22:38.313 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:22:38.313 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:22:38.317 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:22:38.371 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:22:38.372 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:22:38.375 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:22:38.436 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:22:38.436 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:22:38.436 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:22:38.437 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:22:38.437 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:22:38.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:22:38.644 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:22:38.701 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:22:38.701 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:22:38.736 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:22:38.906 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:22:38.966 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:22:38.966 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:22:38.967 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858279', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858279', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi005.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEoN7S83P3smBUhqCGzLTLqKVMb06h1Y3Cp4LqisX27w7CDKhhhhPxE1kBYqc0nnxYfkNW5J2Wtj7aboqxGWZvI=', 'smithi087.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFZzJue/8sAA7PuLC0WJVsuYqo/0zi5yUKdC+Da3FbWIOI/qqqwYnfYepYzwM01MG5wJGak6xNyoF3k5ug76JtI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:02:08', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:22:38.967 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:22:38.971 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:22:39.006 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:22:39.047 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:22:39.103 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:22:39.103 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:22:39.138 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:22:39.138 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2024-08-17T02:22:39.214 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:22:39.214 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:22:39.215 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-08-17T02:22:39.215 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:22:39.215 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:22:39.215 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-17 02:22:29.103080381 +0000 2024-08-17T02:22:39.215 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-17 02:20:05.547047726 +0000 2024-08-17T02:22:39.215 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-17 02:20:05.547047726 +0000 2024-08-17T02:22:39.215 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-08-17 02:20:05.547047726 +0000 2024-08-17T02:22:39.215 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:22:39.306 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-17T02:22:39.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-17T02:22:39.307 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.00020596 s, 2.5 MB/s 2024-08-17T02:22:39.309 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:22:39.347 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2024-08-17T02:22:39.423 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:22:39.424 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:22:39.424 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-08-17T02:22:39.424 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:22:39.424 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:22:39.424 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-17 02:22:29.104080361 +0000 2024-08-17T02:22:39.424 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-17 02:20:06.014038476 +0000 2024-08-17T02:22:39.424 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-17 02:20:06.014038476 +0000 2024-08-17T02:22:39.424 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-08-17 02:20:06.014038476 +0000 2024-08-17T02:22:39.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:22:39.518 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-17T02:22:39.518 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-17T02:22:39.518 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000161424 s, 3.2 MB/s 2024-08-17T02:22:39.521 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:22:39.558 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2024-08-17T02:22:39.633 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:22:39.634 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:22:39.634 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-08-17T02:22:39.634 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:22:39.634 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:22:39.634 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-17 02:22:29.105080341 +0000 2024-08-17T02:22:39.634 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-17 02:20:06.499028870 +0000 2024-08-17T02:22:39.634 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-17 02:20:06.499028870 +0000 2024-08-17T02:22:39.634 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-08-17 02:20:06.499028870 +0000 2024-08-17T02:22:39.634 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:22:39.729 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-17T02:22:39.729 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-17T02:22:39.729 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000176612 s, 2.9 MB/s 2024-08-17T02:22:39.731 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:22:39.768 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2024-08-17T02:22:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:22:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:22:39.843 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-08-17T02:22:39.843 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:22:39.844 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:22:39.844 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-17 02:22:29.106080321 +0000 2024-08-17T02:22:39.844 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-17 02:20:07.012018708 +0000 2024-08-17T02:22:39.844 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-17 02:20:07.012018708 +0000 2024-08-17T02:22:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-08-17 02:20:07.012018708 +0000 2024-08-17T02:22:39.844 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:22:39.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-17T02:22:39.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-17T02:22:39.936 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000174583 s, 2.9 MB/s 2024-08-17T02:22:39.938 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:22:39.975 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:39.975 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:22:39.975 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:22:40.013 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:22:40.013 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2024-08-17T02:22:40.089 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:22:40.090 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:22:40.090 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-08-17T02:22:40.090 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:22:40.090 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:22:40.090 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-08-17 02:22:26.226380324 +0000 2024-08-17T02:22:40.090 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-08-17 02:20:00.859344788 +0000 2024-08-17T02:22:40.090 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-08-17 02:20:00.859344788 +0000 2024-08-17T02:22:40.090 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-08-17 02:20:00.859344788 +0000 2024-08-17T02:22:40.090 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:22:40.185 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-08-17T02:22:40.185 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-08-17T02:22:40.185 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000472317 s, 1.1 MB/s 2024-08-17T02:22:40.188 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:22:40.224 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2024-08-17T02:22:40.300 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:22:40.300 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:22:40.300 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-08-17T02:22:40.300 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:22:40.300 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:22:40.300 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-08-17 02:22:26.227380302 +0000 2024-08-17T02:22:40.300 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-08-17 02:20:01.332334214 +0000 2024-08-17T02:22:40.300 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-08-17 02:20:01.332334214 +0000 2024-08-17T02:22:40.300 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-08-17 02:20:01.332334214 +0000 2024-08-17T02:22:40.301 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:22:40.392 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-08-17T02:22:40.392 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-08-17T02:22:40.393 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000266438 s, 1.9 MB/s 2024-08-17T02:22:40.395 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:22:40.431 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2024-08-17T02:22:40.506 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:22:40.506 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:22:40.506 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-08-17T02:22:40.506 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:22:40.506 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:22:40.506 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-08-17 02:22:26.228380279 +0000 2024-08-17T02:22:40.506 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-08-17 02:20:01.817323372 +0000 2024-08-17T02:22:40.507 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-08-17 02:20:01.817323372 +0000 2024-08-17T02:22:40.507 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-08-17 02:20:01.817323372 +0000 2024-08-17T02:22:40.507 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:22:40.598 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-08-17T02:22:40.598 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-08-17T02:22:40.598 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000260049 s, 2.0 MB/s 2024-08-17T02:22:40.601 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:22:40.637 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2024-08-17T02:22:40.714 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:22:40.714 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:22:40.714 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-08-17T02:22:40.714 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:22:40.714 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:22:40.714 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-08-17 02:22:26.229380256 +0000 2024-08-17T02:22:40.714 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-08-17 02:20:02.306312440 +0000 2024-08-17T02:22:40.714 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-08-17 02:20:02.306312440 +0000 2024-08-17T02:22:40.714 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-08-17 02:20:02.306312440 +0000 2024-08-17T02:22:40.715 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:22:40.806 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-08-17T02:22:40.806 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-08-17T02:22:40.806 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000325713 s, 1.6 MB/s 2024-08-17T02:22:40.808 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:22:40.845 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:40.845 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:22:40.845 INFO:tasks.ceph:Generating config... 2024-08-17T02:22:40.846 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:22:40.846 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:22:40.846 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:22:40.846 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:22:40.846 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:22:40.847 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:22:40.847 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-17T02:22:40.847 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:22:40.847 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:22:40.847 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:22:40.847 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:22:40.847 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:22:40.847 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:22:40.847 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:22:40.847 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:22:40.847 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:22:40.847 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:22:40.848 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:22:40.848 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:22:40.848 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:22:40.848 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:22:40.848 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:22:40.848 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:22:40.848 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:22:40.848 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:22:40.848 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:22:40.848 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:22:40.848 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:22:40.848 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:22:40.848 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:22:40.848 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:22:40.849 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:22:40.849 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:22:40.849 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:22:40.849 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:22:40.849 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:22:40.849 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:22:40.849 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:22:40.849 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:22:40.849 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:22:40.849 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:22:40.849 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:22:40.850 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:22:40.944 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:22:40.949 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:22:41.031 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:22:41.085 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.5'), ('mon.b', '172.21.15.87'), ('mon.c', '[v2:172.21.15.87:3301,v1:172.21.15.87:6790]')] 2024-08-17T02:22:41.086 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.5,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:22:41.087 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:22:41.087 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:22:41.123 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.5 --add b 172.21.15.87 --addv c '[v2:172.21.15.87:3301,v1:172.21.15.87:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:22:41.234 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:22:41.234 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: generated fsid 9411fcb4-b308-4a27-a404-b7a846d24e75 2024-08-17T02:22:41.234 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = octopus 2024-08-17T02:22:41.234 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 0 2024-08-17T02:22:41.235 INFO:teuthology.orchestra.run.smithi005.stdout:fsid 9411fcb4-b308-4a27-a404-b7a846d24e75 2024-08-17T02:22:41.235 INFO:teuthology.orchestra.run.smithi005.stdout:last_changed 2024-08-17T02:22:41.234236+0000 2024-08-17T02:22:41.235 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-08-17T02:22:41.234236+0000 2024-08-17T02:22:41.235 INFO:teuthology.orchestra.run.smithi005.stdout:min_mon_release 15 (octopus) 2024-08-17T02:22:41.235 INFO:teuthology.orchestra.run.smithi005.stdout:election_strategy: 1 2024-08-17T02:22:41.236 INFO:teuthology.orchestra.run.smithi005.stdout:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-17T02:22:41.236 INFO:teuthology.orchestra.run.smithi005.stdout:1: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.b 2024-08-17T02:22:41.236 INFO:teuthology.orchestra.run.smithi005.stdout:2: [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] mon.c 2024-08-17T02:22:41.236 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:22:41.238 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:22:41.273 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9411fcb4-b308-4a27-a404-b7a846d24e75... 2024-08-17T02:22:41.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:22:41.318 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:22:41.411 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-08-17T02:22:41.411 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-08-17T02:22:41.411 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:22:41.411 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-08-17T02:22:41.411 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-08-17T02:22:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-08-17T02:22:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-08-17T02:22:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-08-17T02:22:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-08-17T02:22:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-08-17T02:22:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:22:41.412 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-08-17T02:22:41.413 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.413 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:22:41.413 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:22:41.413 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.413 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-08-17T02:22:41.413 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.413 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-08-17T02:22:41.413 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-08-17T02:22:41.413 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:22:41.413 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:22:41.413 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-08-17T02:22:41.413 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:22:41.413 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-08-17T02:22:41.413 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:22:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:22:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-08-17T02:22:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:22:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-08-17T02:22:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-08-17T02:22:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-08-17T02:22:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-08-17T02:22:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-08-17T02:22:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]" 2024-08-17T02:22:41.415 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on skipped message = False 2024-08-17T02:22:41.415 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 9411fcb4-b308-4a27-a404-b7a846d24e75 2024-08-17T02:22:41.415 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.415 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-08-17T02:22:41.415 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-08-17T02:22:41.415 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.415 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-08-17T02:22:41.415 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-08-17T02:22:41.415 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:22:41.415 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.415 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-08-17T02:22:41.415 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-08-17T02:22:41.416 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.416 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-08-17T02:22:41.416 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-08-17T02:22:41.416 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-08-17T02:22:41.416 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.416 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-08-17T02:22:41.416 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-08-17T02:22:41.416 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.416 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:22:41.416 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.416 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-08-17T02:22:41.416 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.416 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-08-17T02:22:41.417 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.417 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:22:41.417 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-08-17T02:22:41.417 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.417 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-08-17T02:22:41.417 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-08-17T02:22:41.417 INFO:teuthology.orchestra.run.smithi005.stdout: bdev async discard = True 2024-08-17T02:22:41.417 INFO:teuthology.orchestra.run.smithi005.stdout: bdev enable discard = True 2024-08-17T02:22:41.417 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore allocator = bitmap 2024-08-17T02:22:41.417 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-08-17T02:22:41.417 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-08-17T02:22:41.418 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 1/20 2024-08-17T02:22:41.418 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 1/20 2024-08-17T02:22:41.418 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-17T02:22:41.418 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-08-17T02:22:41.418 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 4/10 2024-08-17T02:22:41.418 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:22:41.418 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-08-17T02:22:41.418 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:22:41.418 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:22:41.418 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-08-17T02:22:41.419 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-08-17T02:22:41.419 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.419 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-08-17T02:22:41.419 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-17T02:22:41.419 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-08-17T02:22:41.419 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-08-17T02:22:41.419 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-08-17T02:22:41.419 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:22:41.419 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:22:41.419 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-08-17T02:22:41.419 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-08-17T02:22:41.419 INFO:teuthology.orchestra.run.smithi005.stdout: debug finisher = 20 2024-08-17T02:22:41.420 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.420 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-08-17T02:22:41.420 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-17T02:22:41.420 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-08-17T02:22:41.420 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-08-17T02:22:41.420 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-08-17T02:22:41.420 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-08-17T02:22:41.420 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-08-17T02:22:41.420 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:22:41.420 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-08-17T02:22:41.420 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-08-17T02:22:41.420 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:22:41.421 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.421 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:22:41.421 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:22:41.421 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:22:41.421 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.421 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:22:41.421 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:22:41.421 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:22:41.421 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.421 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-08-17T02:22:41.421 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:22:41.421 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.421 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:22:41.422 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2024-08-17T02:22:41.422 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:22:41.422 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-08-17T02:22:41.422 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-08-17T02:22:41.422 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-08-17T02:22:41.422 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-08-17T02:22:41.422 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:22:41.422 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:22:41.422 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2024-08-17T02:22:41.422 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-08-17T02:22:41.422 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-17T02:22:41.422 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = "" 2024-08-17T02:22:41.422 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-08-17T02:22:41.423 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-08-17T02:22:41.423 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-08-17T02:22:41.423 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2024-08-17T02:22:41.423 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2024-08-17T02:22:41.423 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-08-17T02:22:41.423 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-08-17T02:22:41.423 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-08-17T02:22:41.423 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2024-08-17T02:22:41.423 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2024-08-17T02:22:41.423 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2024-08-17T02:22:41.423 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2024-08-17T02:22:41.423 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-17T02:22:41.423 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2024-08-17T02:22:41.423 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2024-08-17T02:22:41.424 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2024-08-17T02:22:41.424 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = True 2024-08-17T02:22:41.424 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-08-17T02:22:41.424 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-08-17T02:22:41.424 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-08-17T02:22:41.424 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2024-08-17T02:22:41.424 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2024-08-17T02:22:41.424 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:22:41.425 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2024-08-17T02:22:41.425 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.425 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2024-08-17T02:22:41.425 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.425 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2024-08-17T02:22:41.425 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.425 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2024-08-17T02:22:41.425 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2024-08-17T02:22:41.425 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.425 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2024-08-17T02:22:41.425 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2024-08-17T02:22:41.425 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.425 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:22:41.425 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2024-08-17T02:22:41.426 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.426 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:22:41.426 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:22:41.426 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.426 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2024-08-17T02:22:41.426 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.426 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2024-08-17T02:22:41.426 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2024-08-17T02:22:41.426 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:22:41.426 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:22:41.426 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2024-08-17T02:22:41.426 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:22:41.427 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2024-08-17T02:22:41.427 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:22:41.427 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:22:41.427 INFO:teuthology.orchestra.run.smithi087.stdout: mon_allow_pool_size_one = true 2024-08-17T02:22:41.427 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.427 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:22:41.427 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.427 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2024-08-17T02:22:41.427 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.427 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2024-08-17T02:22:41.427 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.427 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2024-08-17T02:22:41.427 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2024-08-17T02:22:41.428 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2024-08-17T02:22:41.428 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = "172.21.15.5,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]" 2024-08-17T02:22:41.428 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on skipped message = False 2024-08-17T02:22:41.428 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = 9411fcb4-b308-4a27-a404-b7a846d24e75 2024-08-17T02:22:41.428 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.428 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2024-08-17T02:22:41.428 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2024-08-17T02:22:41.428 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.428 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2024-08-17T02:22:41.428 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2024-08-17T02:22:41.428 INFO:teuthology.orchestra.run.smithi087.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:22:41.428 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.429 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2024-08-17T02:22:41.429 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2024-08-17T02:22:41.429 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.429 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2024-08-17T02:22:41.429 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2024-08-17T02:22:41.429 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2024-08-17T02:22:41.429 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.429 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2024-08-17T02:22:41.429 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2024-08-17T02:22:41.429 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.429 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:22:41.429 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.429 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2024-08-17T02:22:41.429 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.430 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2024-08-17T02:22:41.430 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.430 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:22:41.430 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2024-08-17T02:22:41.430 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.430 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2024-08-17T02:22:41.430 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2024-08-17T02:22:41.430 INFO:teuthology.orchestra.run.smithi087.stdout: bdev async discard = True 2024-08-17T02:22:41.430 INFO:teuthology.orchestra.run.smithi087.stdout: bdev enable discard = True 2024-08-17T02:22:41.430 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore allocator = bitmap 2024-08-17T02:22:41.430 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2024-08-17T02:22:41.430 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2024-08-17T02:22:41.431 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 1/20 2024-08-17T02:22:41.431 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 1/20 2024-08-17T02:22:41.431 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-08-17T02:22:41.431 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2024-08-17T02:22:41.431 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 4/10 2024-08-17T02:22:41.431 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:22:41.431 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2024-08-17T02:22:41.431 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:22:41.431 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:22:41.431 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2024-08-17T02:22:41.431 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2024-08-17T02:22:41.431 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.431 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2024-08-17T02:22:41.432 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-08-17T02:22:41.432 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2024-08-17T02:22:41.432 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-08-17T02:22:41.432 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-08-17T02:22:41.432 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:22:41.432 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:22:41.432 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2024-08-17T02:22:41.432 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2024-08-17T02:22:41.432 INFO:teuthology.orchestra.run.smithi087.stdout: debug finisher = 20 2024-08-17T02:22:41.432 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.432 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2024-08-17T02:22:41.432 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-08-17T02:22:41.432 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-08-17T02:22:41.432 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2024-08-17T02:22:41.433 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-08-17T02:22:41.433 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2024-08-17T02:22:41.433 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2024-08-17T02:22:41.433 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:22:41.433 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2024-08-17T02:22:41.433 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2024-08-17T02:22:41.433 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:22:41.433 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.433 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:22:41.433 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:22:41.433 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:22:41.433 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.433 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:22:41.434 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:22:41.434 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:22:41.434 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.434 INFO:teuthology.orchestra.run.smithi087.stdout: # 1m isn't quite enough 2024-08-17T02:22:41.434 INFO:teuthology.orchestra.run.smithi087.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:22:41.434 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.434 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:22:41.434 INFO:teuthology.orchestra.run.smithi087.stdout: mon op complaint time = 120 2024-08-17T02:22:41.434 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-08-17T02:22:41.434 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2024-08-17T02:22:41.434 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2024-08-17T02:22:41.434 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2024-08-17T02:22:41.434 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2024-08-17T02:22:41.434 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:22:41.435 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:22:41.435 INFO:teuthology.orchestra.run.smithi087.stdout: client mount timeout = 600 2024-08-17T02:22:41.435 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2024-08-17T02:22:41.435 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-08-17T02:22:41.435 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = "" 2024-08-17T02:22:41.435 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 900 2024-08-17T02:22:41.435 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 900 2024-08-17T02:22:41.435 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2024-08-17T02:22:41.435 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.b] 2024-08-17T02:22:41.435 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.c] 2024-08-17T02:22:41.435 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2024-08-17T02:22:41.435 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2024-08-17T02:22:41.435 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2024-08-17T02:22:41.435 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.d] 2024-08-17T02:22:41.435 INFO:teuthology.orchestra.run.smithi087.stdout:[mds] 2024-08-17T02:22:41.436 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds = 20 2024-08-17T02:22:41.436 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds balancer = 20 2024-08-17T02:22:41.436 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-08-17T02:22:41.436 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug frag = True 2024-08-17T02:22:41.436 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug scatterstat = True 2024-08-17T02:22:41.436 INFO:teuthology.orchestra.run.smithi087.stdout: mds op complaint time = 180 2024-08-17T02:22:41.436 INFO:teuthology.orchestra.run.smithi087.stdout: mds verify scatter = True 2024-08-17T02:22:41.436 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2024-08-17T02:22:41.436 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 900 2024-08-17T02:22:41.436 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 900 2024-08-17T02:22:41.442 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:22:41.442 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:22:41.533 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:22:41.533 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:22:41.533 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:22:41.568 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:22:41.568 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:22:41.643 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:22:41.676 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:22:41.676 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:22:41.676 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:22:41.762 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:22:41.762 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:22:41.837 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2024-08-17T02:22:41.837 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:22:41.837 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:22:41.837 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:22:41.915 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:22:41.915 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:22:41.990 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:22:41.991 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:22:41.991 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:22:42.089 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:22:42.094 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:22:42.198 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:22:42.204 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:22:42.204 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:22:42.303 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:22:42.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:22:42.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:22:42.463 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:22:42.467 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:22:42.523 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:22:42.621 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:22:42.626 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:22:42.682 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:22:42.779 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:22:42.783 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:22:42.838 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:22:42.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:22:42.918 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:22:42.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:22:43.019 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:22:43.046 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:22:43.122 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:22:43.148 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:22:43.223 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:22:43.249 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:22:43.249 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:22:43.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:22:43.306 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:43.306 INFO:tasks.ceph:role: osd.0 2024-08-17T02:22:43.306 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:22:43.306 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:22:43.361 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:22:43.361 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:22:43.361 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:22:43.361 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:22:43.361 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:22:43.362 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:22:43.362 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:22:43.362 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:22:43.362 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:22:43.362 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:22:43.397 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-08-17T02:22:43.401 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-08-17T02:22:43.402 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:22:43.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:22:43.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:22:43.601 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:43.601 INFO:tasks.ceph:role: osd.1 2024-08-17T02:22:43.602 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:22:43.602 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:22:43.658 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:22:43.658 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:22:43.658 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:22:43.658 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:22:43.658 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:22:43.658 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:22:43.659 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:22:43.659 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:22:43.659 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:22:43.659 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:22:43.694 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-08-17T02:22:43.700 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-08-17T02:22:43.700 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:22:43.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:22:43.844 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:22:43.901 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:43.901 INFO:tasks.ceph:role: osd.2 2024-08-17T02:22:43.901 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:22:43.901 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:22:43.957 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:22:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:22:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:22:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:22:43.957 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:22:43.957 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:22:43.957 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:22:43.958 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:22:43.958 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:22:43.958 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:22:43.992 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-08-17T02:22:43.997 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-08-17T02:22:43.997 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:22:44.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:22:44.143 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:22:44.200 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:44.200 INFO:tasks.ceph:role: osd.3 2024-08-17T02:22:44.200 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:22:44.201 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:22:44.256 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:22:44.257 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:22:44.257 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:22:44.257 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:22:44.257 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:22:44.257 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:22:44.257 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:22:44.257 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:22:44.257 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:22:44.257 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:22:44.293 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-08-17T02:22:44.297 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-08-17T02:22:44.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:22:44.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:22:44.440 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:22:44.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:44.539+0000 7fd350f312c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:22:44.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:44.539+0000 7fd350f312c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:22:44.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:44.539+0000 7fd350f312c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:22:44.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:44.539+0000 7fd350f312c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:22:44.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:44.539+0000 7fd350f312c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:22:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:44.542+0000 7fd350f312c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:22:45.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:45.084+0000 7fd350f312c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:45.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:45.847+0000 7fd350f312c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:46.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:46.618+0000 7fd350f312c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:47.455 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:22:47.517 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:22:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:47.604+0000 7f724c8092c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:22:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:47.604+0000 7f724c8092c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:22:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:47.604+0000 7f724c8092c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:22:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:47.604+0000 7f724c8092c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:22:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:47.604+0000 7f724c8092c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:22:47.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:47.606+0000 7f724c8092c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:22:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:48.148+0000 7f724c8092c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:48.920+0000 7f724c8092c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:49.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:49.691+0000 7f724c8092c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:50.523 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:22:50.584 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:22:50.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:50.672+0000 7ff62606f2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:22:50.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:50.672+0000 7ff62606f2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:22:50.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:50.672+0000 7ff62606f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:22:50.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:50.672+0000 7ff62606f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:22:50.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:50.672+0000 7ff62606f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:22:50.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:50.674+0000 7ff62606f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:22:51.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:51.225+0000 7ff62606f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:52.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:52.003+0000 7ff62606f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:52.774+0000 7ff62606f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:53.604 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:22:53.665 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:22:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:53.751+0000 7f81a58892c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:22:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:53.751+0000 7f81a58892c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:22:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:53.751+0000 7f81a58892c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:22:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:53.751+0000 7f81a58892c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:22:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:53.751+0000 7f81a58892c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:22:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:53.753+0000 7f81a58892c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:22:54.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:54.291+0000 7f81a58892c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:55.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:55.061+0000 7f81a58892c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:55.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:22:55.826+0000 7f81a58892c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:22:56.655 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:22:56.716 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:22:56.778 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:56.778 INFO:tasks.ceph:role: osd.4 2024-08-17T02:22:56.778 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com 2024-08-17T02:22:56.778 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:22:56.843 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:22:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:22:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:22:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:22:56.843 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:22:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:22:56.843 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:22:56.843 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:22:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:22:56.844 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:22:57.254 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-08-17T02:22:57.258 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-08-17T02:22:57.258 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:22:57.375 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:22:57.440 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:22:57.505 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:57.505 INFO:tasks.ceph:role: osd.5 2024-08-17T02:22:57.505 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com 2024-08-17T02:22:57.505 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:22:57.569 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:22:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:22:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:22:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:22:57.569 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:22:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:22:57.569 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:22:57.570 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:22:57.570 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:22:57.570 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:22:57.927 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-08-17T02:22:57.931 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-08-17T02:22:57.931 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:22:58.016 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:22:58.077 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:22:58.132 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:58.133 INFO:tasks.ceph:role: osd.6 2024-08-17T02:22:58.133 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com 2024-08-17T02:22:58.133 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:22:58.195 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:22:58.195 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:22:58.195 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:22:58.195 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:22:58.195 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:22:58.195 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:22:58.195 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:22:58.195 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:22:58.195 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:22:58.195 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:22:58.583 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-08-17T02:22:58.587 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-08-17T02:22:58.587 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:22:58.686 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:22:58.749 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:22:58.804 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:22:58.805 INFO:tasks.ceph:role: osd.7 2024-08-17T02:22:58.805 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com 2024-08-17T02:22:58.805 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:22:58.868 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:22:58.868 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:22:58.869 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:22:58.869 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:22:58.869 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:22:58.869 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:22:58.869 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:22:58.869 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:22:58.869 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:22:58.869 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:22:59.250 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-08-17T02:22:59.254 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-08-17T02:22:59.254 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:22:59.392 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:22:59.457 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:22:59.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:22:59.559+0000 7f6c0ba302c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:22:59.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:22:59.562+0000 7f6c0ba302c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:22:59.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:22:59.562+0000 7f6c0ba302c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:22:59.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:22:59.562+0000 7f6c0ba302c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:22:59.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:22:59.562+0000 7f6c0ba302c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:22:59.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:22:59.572+0000 7f6c0ba302c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:23:00.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:00.116+0000 7f6c0ba302c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:00.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:00.898+0000 7f6c0ba302c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:01.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:01.671+0000 7f6c0ba302c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:02.502 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:23:02.561 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:02.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:02.643+0000 7ff0ce00b2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:23:02.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:02.645+0000 7ff0ce00b2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:23:02.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:02.645+0000 7ff0ce00b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:23:02.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:02.645+0000 7ff0ce00b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:23:02.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:02.645+0000 7ff0ce00b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:23:02.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:02.646+0000 7ff0ce00b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:23:03.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:03.188+0000 7ff0ce00b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:03.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:03.960+0000 7ff0ce00b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:04.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:04.733+0000 7ff0ce00b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:05.566 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:23:05.623 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:05.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:05.706+0000 7fa8e031f2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:23:05.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:05.707+0000 7fa8e031f2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:23:05.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:05.707+0000 7fa8e031f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:23:05.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:05.707+0000 7fa8e031f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:23:05.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:05.707+0000 7fa8e031f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:23:05.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:05.709+0000 7fa8e031f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:23:06.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:06.253+0000 7fa8e031f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:07.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:07.028+0000 7fa8e031f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:07.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:07.799+0000 7fa8e031f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:08.630 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:23:08.685 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:08.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:08.769+0000 7f222117b2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:23:08.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:08.769+0000 7f222117b2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:23:08.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:08.769+0000 7f222117b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:23:08.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:08.769+0000 7f222117b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:23:08.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:08.769+0000 7f222117b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:23:08.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:08.771+0000 7f222117b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:23:08.969 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:23:08.974 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:23:09.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:09.313+0000 7f222117b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:10.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:10.090+0000 7f222117b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:10.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:10.860+0000 7f222117b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:11.701 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:23:11.760 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:23:11.760 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:23:11.760 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:23:11.823 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:23:11.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:23:11.922 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:23:11.922 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:23:12.019 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:23:12.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:23:12.115 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:23:12.115 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:23:12.211 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:23:12.211 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:23:12.306 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:23:12.307 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:23:12.403 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:23:12.403 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:23:12.465 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:23:12.465 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:23:12.562 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:23:12.562 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:23:12.659 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:23:12.659 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:23:12.754 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:23:12.754 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:23:12.850 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:23:12.850 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:23:12.945 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:23:12.945 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:23:13.040 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:23:13.040 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:23:13.076 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:23:13.077 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:23:13.152 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:23:13.152 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:23:13.187 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:23:13.187 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:23:13.261 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:23:13.261 DEBUG:teuthology.orchestra.run.smithi005:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:23:13.265 DEBUG:teuthology.orchestra.run.smithi087:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:23:13.315 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.y] 2024-08-17T02:23:13.315 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQByCcBmCWxfBRAA6UCwyELcZC+o2GoJSU4hag== 2024-08-17T02:23:13.315 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-08-17T02:23:13.315 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQByCcBmZAUYEhAASlbkqRzbSYtrkDuGHRqgeg== 2024-08-17T02:23:13.315 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-08-17T02:23:13.315 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQByCcBmRG6lGxAAR9h6PoSAXnG1wzn56/04Sg== 2024-08-17T02:23:13.315 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2024-08-17T02:23:13.315 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB0CcBmf84uIBAAnwp8fxdBMZwGt6uiuEY02w== 2024-08-17T02:23:13.316 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2024-08-17T02:23:13.316 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB3CcBmYl4VJBAAAPI7lWsxEkOJqXmwIV3Y+A== 2024-08-17T02:23:13.316 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2024-08-17T02:23:13.316 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB6CcBmeOcbKBAAdxPpSnn+NPTVjhyGXwUotw== 2024-08-17T02:23:13.316 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.3] 2024-08-17T02:23:13.316 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB9CcBm7w7XLBAAX3OJYNcHdQ4nGAXOBUkj5A== 2024-08-17T02:23:13.316 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.x] 2024-08-17T02:23:13.316 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQByCcBm3P/ZCxAANVQk7OeahF/XMp2y9UNDOQ== 2024-08-17T02:23:13.316 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-08-17T02:23:13.316 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQByCcBm+uQZJRAAndCEBtQMjLEJy2B1AnKBwQ== 2024-08-17T02:23:13.316 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2024-08-17T02:23:13.316 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQByCcBmWPN3LhAAxeirTm0g2oFwOttYg6jByg== 2024-08-17T02:23:13.317 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.4] 2024-08-17T02:23:13.317 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCDCcBmGXVtIRAAszEPIslbzNwCapzIZFcotQ== 2024-08-17T02:23:13.317 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.5] 2024-08-17T02:23:13.317 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCGCcBma29zJhAAEmTKBe6FhVhhcfAGikyH1Q== 2024-08-17T02:23:13.317 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.6] 2024-08-17T02:23:13.317 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCJCcBmkFspKhAAwhhaQrNy4rCe80G81mYXWQ== 2024-08-17T02:23:13.317 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.7] 2024-08-17T02:23:13.317 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCMCcBmuzbiLRAAqFCXWg2aLsT/1woIqErqLw== 2024-08-17T02:23:13.317 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-08-17T02:23:13.317 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQByCcBmP0e4NhAAB1StObxxuyD898gkWnolQA== 2024-08-17T02:23:13.317 INFO:teuthology.orchestra.run.smithi005.stdout:[client.2] 2024-08-17T02:23:13.317 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBzCcBmM5I2ARAAOdOcTvcE22/i8hP2vklq0A== 2024-08-17T02:23:13.317 INFO:teuthology.orchestra.run.smithi005.stdout:[client.1] 2024-08-17T02:23:13.317 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBzCcBm9PVMBxAAqXVhHFkT7SoNj3mFRETi3Q== 2024-08-17T02:23:13.318 INFO:teuthology.orchestra.run.smithi005.stdout:[client.3] 2024-08-17T02:23:13.318 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBzCcBmvE9TDRAAuwbdDPlO3lEYHt0fbYrCvw== 2024-08-17T02:23:13.354 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.y] 2024-08-17T02:23:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQByCcBmCWxfBRAA6UCwyELcZC+o2GoJSU4hag== 2024-08-17T02:23:13.354 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2024-08-17T02:23:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQByCcBmZAUYEhAASlbkqRzbSYtrkDuGHRqgeg== 2024-08-17T02:23:13.354 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2024-08-17T02:23:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQByCcBmRG6lGxAAR9h6PoSAXnG1wzn56/04Sg== 2024-08-17T02:23:13.354 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.0] 2024-08-17T02:23:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQB0CcBmf84uIBAAnwp8fxdBMZwGt6uiuEY02w== 2024-08-17T02:23:13.354 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.1] 2024-08-17T02:23:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQB3CcBmYl4VJBAAAPI7lWsxEkOJqXmwIV3Y+A== 2024-08-17T02:23:13.354 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.2] 2024-08-17T02:23:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQB6CcBmeOcbKBAAdxPpSnn+NPTVjhyGXwUotw== 2024-08-17T02:23:13.355 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.3] 2024-08-17T02:23:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQB9CcBm7w7XLBAAX3OJYNcHdQ4nGAXOBUkj5A== 2024-08-17T02:23:13.355 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.x] 2024-08-17T02:23:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQByCcBm3P/ZCxAANVQk7OeahF/XMp2y9UNDOQ== 2024-08-17T02:23:13.355 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2024-08-17T02:23:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQByCcBm+uQZJRAAndCEBtQMjLEJy2B1AnKBwQ== 2024-08-17T02:23:13.355 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.d] 2024-08-17T02:23:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQByCcBmWPN3LhAAxeirTm0g2oFwOttYg6jByg== 2024-08-17T02:23:13.355 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.4] 2024-08-17T02:23:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCDCcBmGXVtIRAAszEPIslbzNwCapzIZFcotQ== 2024-08-17T02:23:13.355 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.5] 2024-08-17T02:23:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCGCcBma29zJhAAEmTKBe6FhVhhcfAGikyH1Q== 2024-08-17T02:23:13.356 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.6] 2024-08-17T02:23:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCJCcBmkFspKhAAwhhaQrNy4rCe80G81mYXWQ== 2024-08-17T02:23:13.356 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.7] 2024-08-17T02:23:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCMCcBmuzbiLRAAqFCXWg2aLsT/1woIqErqLw== 2024-08-17T02:23:13.356 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-08-17T02:23:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQByCcBmP0e4NhAAB1StObxxuyD898gkWnolQA== 2024-08-17T02:23:13.356 INFO:teuthology.orchestra.run.smithi087.stdout:[client.2] 2024-08-17T02:23:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBzCcBmM5I2ARAAOdOcTvcE22/i8hP2vklq0A== 2024-08-17T02:23:13.356 INFO:teuthology.orchestra.run.smithi087.stdout:[client.1] 2024-08-17T02:23:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBzCcBm9PVMBxAAqXVhHFkT7SoNj3mFRETi3Q== 2024-08-17T02:23:13.356 INFO:teuthology.orchestra.run.smithi087.stdout:[client.3] 2024-08-17T02:23:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBzCcBmvE9TDRAAuwbdDPlO3lEYHt0fbYrCvw== 2024-08-17T02:23:13.357 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:23:13.363 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:23:13.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:23:13.488 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:23:13.577 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:23:13.580 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:23:13.671 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:13.675 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:13.761 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:13.765 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:13.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:13.858 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:13.946 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:13.950 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:14.036 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:23:14.040 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:23:14.126 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:23:14.130 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:23:14.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:23:14.224 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:23:14.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:14.316 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:14.402 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:14.407 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:14.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:14.498 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:14.584 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:14.588 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:23:14.675 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:23:14.678 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:23:14.768 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:23:14.772 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:23:14.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:23:14.864 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:23:14.953 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:23:14.957 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:23:15.046 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:23:15.047 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:23:15.102 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:23:15.203 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:23:15.259 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:23:15.314 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:23:15.414 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:23:15.469 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:23:15.524 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:23:15.622 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:23:15.677 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:15.682 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:15.716 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:23:15.716 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:23:15.716 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:23:15.758 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:23:15.759 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:23:15.759 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:23:15.762 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:23:15.762 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:23:15.763 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:23:15.766 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:23:15.766 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:23:15.767 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:23:15.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:23:15.771 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:23:15.771 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:23:15.771 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:23:15.775 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:23:15.776 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:23:15.776 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:23:15.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.926+0000 7f3220a00640 1 Processor -- start 2024-08-17T02:23:15.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.926+0000 7f3220a00640 1 -- start start 2024-08-17T02:23:15.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f3220a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c158a00 0x7f321c158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f3220a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f321c0cb190 0x7f321c0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f3220a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f321c06e590 0x7f321c06e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f3220a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321c06ef10 con 0x7f321c06e590 2024-08-17T02:23:15.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f3220a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321c0cbc50 con 0x7f321c0cb190 2024-08-17T02:23:15.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f3220a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321c0cbf30 con 0x7f321c158a00 2024-08-17T02:23:15.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f3213e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f321c0cb190 0x7f321c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f3213e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f321c0cb190 0x7f321c0cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:44722/0 (socket says 172.21.15.5:44722) 2024-08-17T02:23:15.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f3213e00640 1 -- 172.21.15.5:0/3995018871 learned_addr learned my addr 172.21.15.5:0/3995018871 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:15.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f321b400640 1 --2- 172.21.15.5:0/3995018871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c158a00 0x7f321c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f3213e00640 1 -- 172.21.15.5:0/3995018871 >> v2:172.21.15.87:3300/0 conn(0x7f321c0cb190 msgr2=0x7f321c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:23:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f3213e00640 1 -- 172.21.15.5:0/3995018871 >> v2:172.21.15.87:3300/0 conn(0x7f321c0cb190 msgr2=0x7f321c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:23:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f3213e00640 1 --2- 172.21.15.5:0/3995018871 >> v2:172.21.15.87:3300/0 conn(0x7f321c0cb190 0x7f321c0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:23:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f3213e00640 1 --2- 172.21.15.5:0/3995018871 >> v2:172.21.15.87:3300/0 conn(0x7f321c0cb190 0x7f321c0cb5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:23:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f321b400640 1 -- 172.21.15.5:0/3995018871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c158a00 msgr2=0x7f321c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:23:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f321b400640 1 -- 172.21.15.5:0/3995018871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c158a00 msgr2=0x7f321c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:23:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f321b400640 1 --2- 172.21.15.5:0/3995018871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c158a00 0x7f321c158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:23:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f321b400640 1 --2- 172.21.15.5:0/3995018871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c158a00 0x7f321c158dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:23:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.927+0000 7f321be00640 1 --2- 172.21.15.5:0/3995018871 >> v2:172.21.15.5:3300/0 conn(0x7f321c06e590 0x7f321c06e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.928+0000 7f321be00640 1 -- 172.21.15.5:0/3995018871 >> v2:172.21.15.5:3300/0 conn(0x7f321c06e590 msgr2=0x7f321c06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:23:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.928+0000 7f321be00640 1 -- 172.21.15.5:0/3995018871 >> v2:172.21.15.5:3300/0 conn(0x7f321c06e590 msgr2=0x7f321c06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:23:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.928+0000 7f321be00640 1 --2- 172.21.15.5:0/3995018871 >> v2:172.21.15.5:3300/0 conn(0x7f321c06e590 0x7f321c06e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:23:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:15.928+0000 7f321be00640 1 --2- 172.21.15.5:0/3995018871 >> v2:172.21.15.5:3300/0 conn(0x7f321c06e590 0x7f321c06e9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:23:16.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.128+0000 7f3213e00640 1 --2- 172.21.15.5:0/3995018871 >> v2:172.21.15.87:3300/0 conn(0x7f321c0cb190 0x7f321c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.128+0000 7f321b400640 1 --2- 172.21.15.5:0/3995018871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c158a00 0x7f321c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.128+0000 7f321b400640 1 -- 172.21.15.5:0/3995018871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c158a00 msgr2=0x7f321c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:23:16.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.128+0000 7f321b400640 1 -- 172.21.15.5:0/3995018871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c158a00 msgr2=0x7f321c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:23:16.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.128+0000 7f3213e00640 1 -- 172.21.15.5:0/3995018871 >> v2:172.21.15.87:3300/0 conn(0x7f321c0cb190 msgr2=0x7f321c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:23:16.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.128+0000 7f3213e00640 1 -- 172.21.15.5:0/3995018871 >> v2:172.21.15.87:3300/0 conn(0x7f321c0cb190 msgr2=0x7f321c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:23:16.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.128+0000 7f321b400640 1 --2- 172.21.15.5:0/3995018871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c158a00 0x7f321c158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:23:16.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.128+0000 7f3213e00640 1 --2- 172.21.15.5:0/3995018871 >> v2:172.21.15.87:3300/0 conn(0x7f321c0cb190 0x7f321c0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:23:16.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.128+0000 7f321b400640 1 --2- 172.21.15.5:0/3995018871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c158a00 0x7f321c158dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:23:16.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.128+0000 7f3213e00640 1 --2- 172.21.15.5:0/3995018871 >> v2:172.21.15.87:3300/0 conn(0x7f321c0cb190 0x7f321c0cb5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:23:16.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.129+0000 7f321be00640 1 --2- 172.21.15.5:0/3995018871 >> v2:172.21.15.5:3300/0 conn(0x7f321c06e590 0x7f321c06e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.129+0000 7f321be00640 1 -- 172.21.15.5:0/3995018871 >> v2:172.21.15.5:3300/0 conn(0x7f321c06e590 msgr2=0x7f321c06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:23:16.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.129+0000 7f321be00640 1 -- 172.21.15.5:0/3995018871 >> v2:172.21.15.5:3300/0 conn(0x7f321c06e590 msgr2=0x7f321c06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:23:16.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.129+0000 7f321be00640 1 --2- 172.21.15.5:0/3995018871 >> v2:172.21.15.5:3300/0 conn(0x7f321c06e590 0x7f321c06e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:23:16.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.129+0000 7f321be00640 1 --2- 172.21.15.5:0/3995018871 >> v2:172.21.15.5:3300/0 conn(0x7f321c06e590 0x7f321c06e9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:23:16.269 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:16.268+0000 7f902ea0fec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:23:16.425 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:16.425+0000 7f902ea0fec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:23:16.487 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:16.486+0000 7f902ea0fec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:23:16.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.529+0000 7f321b400640 1 --2- 172.21.15.5:0/3995018871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c158a00 0x7f321c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.529+0000 7f3213e00640 1 --2- 172.21.15.5:0/3995018871 >> v2:172.21.15.87:3300/0 conn(0x7f321c0cb190 0x7f321c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.530+0000 7f3213e00640 1 -- 172.21.15.5:0/3995018871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c158a00 msgr2=0x7f321c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:16.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.530+0000 7f3213e00640 1 --2- 172.21.15.5:0/3995018871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c158a00 0x7f321c158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.530+0000 7f3213e00640 1 -- 172.21.15.5:0/3995018871 >> v2:172.21.15.5:3300/0 conn(0x7f321c06e590 msgr2=0x7f321c06e9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:23:16.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.530+0000 7f3213e00640 1 --2- 172.21.15.5:0/3995018871 >> v2:172.21.15.5:3300/0 conn(0x7f321c06e590 0x7f321c06e9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.530+0000 7f3213e00640 1 -- 172.21.15.5:0/3995018871 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321c0cc210 con 0x7f321c0cb190 2024-08-17T02:23:16.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.531+0000 7f3213e00640 1 --2- 172.21.15.5:0/3995018871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f321c0cb190 0x7f321c0cb5c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f321c069450 tx=0x7f3204008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=538eb0bc2bb0a6a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.531+0000 7f321aa00640 1 -- 172.21.15.5:0/3995018871 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3204030480 con 0x7f321c0cb190 2024-08-17T02:23:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.531+0000 7f321aa00640 1 -- 172.21.15.5:0/3995018871 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320402d030 con 0x7f321c0cb190 2024-08-17T02:23:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.531+0000 7f321aa00640 1 -- 172.21.15.5:0/3995018871 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32040307f0 con 0x7f321c0cb190 2024-08-17T02:23:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.532+0000 7f3220a00640 1 -- 172.21.15.5:0/3995018871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f321c0cb190 msgr2=0x7f321c0cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.532+0000 7f3220a00640 1 --2- 172.21.15.5:0/3995018871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f321c0cb190 0x7f321c0cb5c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f321c069450 tx=0x7f3204008040 comp rx=0 tx=0).stop 2024-08-17T02:23:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.532+0000 7f3220a00640 1 -- 172.21.15.5:0/3995018871 shutdown_connections 2024-08-17T02:23:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.532+0000 7f3220a00640 1 --2- 172.21.15.5:0/3995018871 >> v2:172.21.15.5:3300/0 conn(0x7f321c06e590 0x7f321c06e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.532+0000 7f3220a00640 1 --2- 172.21.15.5:0/3995018871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f321c0cb190 0x7f321c0cb5c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.532+0000 7f3220a00640 1 --2- 172.21.15.5:0/3995018871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c158a00 0x7f321c158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.532+0000 7f3220a00640 1 -- 172.21.15.5:0/3995018871 >> 172.21.15.5:0/3995018871 conn(0x7f321c0cfb80 msgr2=0x7f321c0cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:16.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.532+0000 7f3220a00640 1 -- 172.21.15.5:0/3995018871 shutdown_connections 2024-08-17T02:23:16.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.532+0000 7f3220a00640 1 -- 172.21.15.5:0/3995018871 wait complete. 2024-08-17T02:23:16.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.533+0000 7f3220a00640 1 Processor -- start 2024-08-17T02:23:16.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.533+0000 7f3220a00640 1 -- start start 2024-08-17T02:23:16.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.534+0000 7f3220a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f321c06e590 0x7f321c157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:16.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.534+0000 7f3220a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c0cb190 0x7f321c0cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:16.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.534+0000 7f3220a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f321c158a00 0x7f321c0cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:16.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.534+0000 7f3220a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c15e3e0 con 0x7f321c06e590 2024-08-17T02:23:16.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.534+0000 7f3220a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c15e680 con 0x7f321c158a00 2024-08-17T02:23:16.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.534+0000 7f3220a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321c15e960 con 0x7f321c0cb190 2024-08-17T02:23:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.535+0000 7f321b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f321c06e590 0x7f321c157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.535+0000 7f3213e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c0cb190 0x7f321c0cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.535+0000 7f321b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f321c06e590 0x7f321c157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33472/0 (socket says 172.21.15.5:33472) 2024-08-17T02:23:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.535+0000 7f321b400640 1 -- 172.21.15.5:0/327169797 learned_addr learned my addr 172.21.15.5:0/327169797 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.535+0000 7f321be00640 1 --2- 172.21.15.5:0/327169797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f321c158a00 0x7f321c0cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.535+0000 7f321be00640 1 -- 172.21.15.5:0/327169797 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c0cb190 msgr2=0x7f321c0cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.535+0000 7f321be00640 1 --2- 172.21.15.5:0/327169797 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c0cb190 0x7f321c0cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.535+0000 7f321be00640 1 -- 172.21.15.5:0/327169797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f321c06e590 msgr2=0x7f321c157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.535+0000 7f321be00640 1 --2- 172.21.15.5:0/327169797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f321c06e590 0x7f321c157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.535+0000 7f321be00640 1 -- 172.21.15.5:0/327169797 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320400e570 con 0x7f321c158a00 2024-08-17T02:23:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.535+0000 7f321b400640 1 --2- 172.21.15.5:0/327169797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f321c06e590 0x7f321c157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.535+0000 7f321be00640 1 --2- 172.21.15.5:0/327169797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f321c158a00 0x7f321c0cc990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3214009fc0 tx=0x7f3214009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.536+0000 7f3212a00640 1 -- 172.21.15.5:0/327169797 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3214002e20 con 0x7f321c158a00 2024-08-17T02:23:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.536+0000 7f3212a00640 1 -- 172.21.15.5:0/327169797 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321400f050 con 0x7f321c158a00 2024-08-17T02:23:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.536+0000 7f3212a00640 1 -- 172.21.15.5:0/327169797 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32140137b0 con 0x7f321c158a00 2024-08-17T02:23:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.536+0000 7f3220a00640 1 -- 172.21.15.5:0/327169797 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321c15ec40 con 0x7f321c158a00 2024-08-17T02:23:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.536+0000 7f3220a00640 1 -- 172.21.15.5:0/327169797 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321c158490 con 0x7f321c158a00 2024-08-17T02:23:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.536+0000 7f3212a00640 1 -- 172.21.15.5:0/327169797 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f3214003040 con 0x7f321c158a00 2024-08-17T02:23:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.536+0000 7f3212a00640 1 -- 172.21.15.5:0/327169797 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f321401eca0 con 0x7f321c158a00 2024-08-17T02:23:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.537+0000 7f3220a00640 1 -- 172.21.15.5:0/327169797 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f321c15f440 con 0x7f321c158a00 2024-08-17T02:23:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.540+0000 7f3212a00640 1 -- 172.21.15.5:0/327169797 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f321c15f440 con 0x7f321c158a00 2024-08-17T02:23:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.609+0000 7f3220a00640 1 -- 172.21.15.5:0/327169797 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f321c070720 con 0x7f321c158a00 2024-08-17T02:23:16.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.615+0000 7f3212a00640 1 -- 172.21.15.5:0/327169797 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f321401ee60 con 0x7f321c158a00 2024-08-17T02:23:16.615 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2024-08-17T02:23:16.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.616+0000 7f3220a00640 1 -- 172.21.15.5:0/327169797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f321c158a00 msgr2=0x7f321c0cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:16.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.616+0000 7f3220a00640 1 --2- 172.21.15.5:0/327169797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f321c158a00 0x7f321c0cc990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3214009fc0 tx=0x7f3214009920 comp rx=0 tx=0).stop 2024-08-17T02:23:16.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.616+0000 7f3220a00640 1 -- 172.21.15.5:0/327169797 shutdown_connections 2024-08-17T02:23:16.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.616+0000 7f3220a00640 1 --2- 172.21.15.5:0/327169797 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f321c0cb190 0x7f321c0cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.616+0000 7f3220a00640 1 --2- 172.21.15.5:0/327169797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f321c158a00 0x7f321c0cc990 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.616+0000 7f3220a00640 1 --2- 172.21.15.5:0/327169797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f321c06e590 0x7f321c157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:16.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.616+0000 7f3220a00640 1 -- 172.21.15.5:0/327169797 >> 172.21.15.5:0/327169797 conn(0x7f321c0cfb80 msgr2=0x7f321c15b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:16.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.616+0000 7f3220a00640 1 -- 172.21.15.5:0/327169797 shutdown_connections 2024-08-17T02:23:16.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:16.616+0000 7f3220a00640 1 -- 172.21.15.5:0/327169797 wait complete. 2024-08-17T02:23:16.624 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:16.624+0000 7fef1ee11ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:23:16.631 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:23:16.632 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:23:16.632 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:23:16.690 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:23:16.690 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:23:16.771 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:16.771+0000 7fef1ee11ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:23:16.786 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:23:16.786 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:23:16.799 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:16.799+0000 7f902ea0fec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:23:16.829 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:16.829+0000 7fef1ee11ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:23:16.854 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:16.854+0000 7f902ea0fec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:23:16.856 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:23:16.856 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:23:16.952 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:23:16.953 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:23:17.008 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:23:17.009 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:23:17.105 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:23:17.106 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:23:17.118 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:17.118+0000 7fef1ee11ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:23:17.175 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:17.176+0000 7fef1ee11ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:23:17.177 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-08-17T02:23:17.177 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:23:17.275 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 681b5b50-2b3d-4686-b47b-27e725c8dc26 0 2024-08-17T02:23:17.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.459+0000 7f569f200640 1 Processor -- start 2024-08-17T02:23:17.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.459+0000 7f569f200640 1 -- start start 2024-08-17T02:23:17.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.460+0000 7f569f200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56a01588d0 0x7f56a00ca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.461+0000 7f569f200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a00af600 con 0x7f56a00cf900 2024-08-17T02:23:17.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.461+0000 7f569f200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a00afb60 con 0x7f56a0158ca0 2024-08-17T02:23:17.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.461+0000 7f569f200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00d04e0 con 0x7f56a01588d0 2024-08-17T02:23:17.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.461+0000 7f569de00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56a01588d0 0x7f56a00ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.461+0000 7f569d400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f56a0158ca0 0x7f56a00cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47942/0 (socket says 172.21.15.87:47942) 2024-08-17T02:23:17.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.461+0000 7f569d400640 1 -- 172.21.15.87:0/3152131016 learned_addr learned my addr 172.21.15.87:0/3152131016 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-08-17T02:23:17.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.461+0000 7f569ca00640 1 -- 172.21.15.87:0/3152131016 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968623732 0 0) 0x7f56a00afb60 con 0x7f56a0158ca0 2024-08-17T02:23:17.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.461+0000 7f569de00640 1 -- 172.21.15.87:0/3152131016 >> v1:172.21.15.87:6789/0 conn(0x7f56a0158ca0 legacy=0x7f56a00cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.461+0000 7f569de00640 1 -- 172.21.15.87:0/3152131016 >> v1:172.21.15.5:6789/0 conn(0x7f56a00cf900 legacy=0x7f56a00afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:17.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.461+0000 7f569de00640 1 -- 172.21.15.87:0/3152131016 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a00af830 con 0x7f56a01588d0 2024-08-17T02:23:17.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.462+0000 7f569de00640 1 --2- 172.21.15.87:0/3152131016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56a01588d0 0x7f56a00ca800 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5690009880 tx=0x7f56900090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e392e0eff1934f4c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:17.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.463+0000 7f569ca00640 1 -- 172.21.15.87:0/3152131016 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569002ace0 con 0x7f56a01588d0 2024-08-17T02:23:17.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.463+0000 7f569ca00640 1 -- 172.21.15.87:0/3152131016 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569002ae40 con 0x7f56a01588d0 2024-08-17T02:23:17.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.463+0000 7f569ca00640 1 -- 172.21.15.87:0/3152131016 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690032670 con 0x7f56a01588d0 2024-08-17T02:23:17.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.463+0000 7f569f200640 1 -- 172.21.15.87:0/3152131016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56a01588d0 msgr2=0x7f56a00ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.463+0000 7f569f200640 1 --2- 172.21.15.87:0/3152131016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56a01588d0 0x7f56a00ca800 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5690009880 tx=0x7f56900090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.463+0000 7f569f200640 1 -- 172.21.15.87:0/3152131016 shutdown_connections 2024-08-17T02:23:17.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.463+0000 7f569f200640 1 --2- 172.21.15.87:0/3152131016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56a01588d0 0x7f56a00ca800 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.463+0000 7f569f200640 1 -- 172.21.15.87:0/3152131016 >> 172.21.15.87:0/3152131016 conn(0x7f56a0087a80 msgr2=0x7f56a006e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:17.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.463+0000 7f569f200640 1 -- 172.21.15.87:0/3152131016 shutdown_connections 2024-08-17T02:23:17.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.463+0000 7f569f200640 1 -- 172.21.15.87:0/3152131016 wait complete. 2024-08-17T02:23:17.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.465+0000 7f569f200640 1 Processor -- start 2024-08-17T02:23:17.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.465+0000 7f569f200640 1 -- start start 2024-08-17T02:23:17.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.466+0000 7f569f200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56a00cf900 0x7f56a0146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.466+0000 7f569f200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56a01588d0 0x7f56a00b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.466+0000 7f569f200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56a0158ca0 0x7f56a00c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.466+0000 7f569f200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a016d300 con 0x7f56a00cf900 2024-08-17T02:23:17.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.466+0000 7f569f200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a0169e40 con 0x7f56a01588d0 2024-08-17T02:23:17.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.466+0000 7f569f200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a016c6f0 con 0x7f56a0158ca0 2024-08-17T02:23:17.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.466+0000 7f569d400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56a01588d0 0x7f56a00b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.466+0000 7f569d400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56a01588d0 0x7f56a00b50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35344/0 (socket says 172.21.15.87:35344) 2024-08-17T02:23:17.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.466+0000 7f569de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56a00cf900 0x7f56a0146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.466+0000 7f569e800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56a0158ca0 0x7f56a00c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.466+0000 7f569d400640 1 -- 172.21.15.87:0/1886292893 learned_addr learned my addr 172.21.15.87:0/1886292893 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-08-17T02:23:17.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.466+0000 7f569d400640 1 -- 172.21.15.87:0/1886292893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56a0158ca0 msgr2=0x7f56a00c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.466+0000 7f569d400640 1 --2- 172.21.15.87:0/1886292893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56a0158ca0 0x7f56a00c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.466+0000 7f569d400640 1 -- 172.21.15.87:0/1886292893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56a00cf900 msgr2=0x7f56a0146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.466+0000 7f569d400640 1 --2- 172.21.15.87:0/1886292893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56a00cf900 0x7f56a0146670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.466+0000 7f569d400640 1 -- 172.21.15.87:0/1886292893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5690009390 con 0x7f56a01588d0 2024-08-17T02:23:17.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.467+0000 7f569d400640 1 --2- 172.21.15.87:0/1886292893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56a01588d0 0x7f56a00b50c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f568c00c510 tx=0x7f568c00c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:17.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.467+0000 7f5695600640 1 -- 172.21.15.87:0/1886292893 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c005aa0 con 0x7f56a01588d0 2024-08-17T02:23:17.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.467+0000 7f5695600640 1 -- 172.21.15.87:0/1886292893 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c005c00 con 0x7f56a01588d0 2024-08-17T02:23:17.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.467+0000 7f569f200640 1 -- 172.21.15.87:0/1886292893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a016c9d0 con 0x7f56a01588d0 2024-08-17T02:23:17.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.467+0000 7f5695600640 1 -- 172.21.15.87:0/1886292893 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c0070d0 con 0x7f56a01588d0 2024-08-17T02:23:17.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.467+0000 7f569f200640 1 -- 172.21.15.87:0/1886292893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a016cf90 con 0x7f56a01588d0 2024-08-17T02:23:17.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.467+0000 7f5695600640 1 -- 172.21.15.87:0/1886292893 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f568c007500 con 0x7f56a01588d0 2024-08-17T02:23:17.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.467+0000 7f5695600640 1 -- 172.21.15.87:0/1886292893 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f568c01ce00 con 0x7f56a01588d0 2024-08-17T02:23:17.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.468+0000 7f569f200640 1 -- 172.21.15.87:0/1886292893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a0070720 con 0x7f56a01588d0 2024-08-17T02:23:17.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.470+0000 7f5695600640 1 -- 172.21.15.87:0/1886292893 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f568c017070 con 0x7f56a01588d0 2024-08-17T02:23:17.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.543+0000 7f569f200640 1 -- 172.21.15.87:0/1886292893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "681b5b50-2b3d-4686-b47b-27e725c8dc26", "id": 0} v 0) v1 -- 0x7f56a006e840 con 0x7f56a01588d0 2024-08-17T02:23:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.547+0000 7f5695600640 1 -- 172.21.15.87:0/1886292893 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "681b5b50-2b3d-4686-b47b-27e725c8dc26", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f568c01c500 con 0x7f56a01588d0 2024-08-17T02:23:17.547 INFO:teuthology.orchestra.run.smithi087.stdout:0 2024-08-17T02:23:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.548+0000 7f569f200640 1 -- 172.21.15.87:0/1886292893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56a01588d0 msgr2=0x7f56a00b50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.548+0000 7f569f200640 1 --2- 172.21.15.87:0/1886292893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56a01588d0 0x7f56a00b50c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f568c00c510 tx=0x7f568c00c910 comp rx=0 tx=0).stop 2024-08-17T02:23:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.548+0000 7f569f200640 1 -- 172.21.15.87:0/1886292893 shutdown_connections 2024-08-17T02:23:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.548+0000 7f569f200640 1 --2- 172.21.15.87:0/1886292893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56a0158ca0 0x7f56a00c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.548+0000 7f569f200640 1 --2- 172.21.15.87:0/1886292893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56a01588d0 0x7f56a00b50c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.548+0000 7f569f200640 1 --2- 172.21.15.87:0/1886292893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56a00cf900 0x7f56a0146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.548+0000 7f569f200640 1 -- 172.21.15.87:0/1886292893 >> 172.21.15.87:0/1886292893 conn(0x7f56a0087a80 msgr2=0x7f56a01576d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.548+0000 7f569f200640 1 -- 172.21.15.87:0/1886292893 shutdown_connections 2024-08-17T02:23:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.548+0000 7f569f200640 1 -- 172.21.15.87:0/1886292893 wait complete. 2024-08-17T02:23:17.563 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 284594a3-765f-4546-ac0e-06e2eb2b66c1 1 2024-08-17T02:23:17.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.709+0000 7f9951800640 1 Processor -- start 2024-08-17T02:23:17.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.709+0000 7f9951800640 1 -- start start 2024-08-17T02:23:17.710 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:17.709+0000 7f902ea0fec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:23:17.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.710+0000 7f9951800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f994c0cb0d0 0x7f994c158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.710+0000 7f9951800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f994c0cda30 0x7f994c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.710+0000 7f9951800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f994c0af9a0 con 0x7f994c1589e0 2024-08-17T02:23:17.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.710+0000 7f9951800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f994c0af810 con 0x7f994c0cda30 2024-08-17T02:23:17.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.710+0000 7f9951800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994c0ce740 con 0x7f994c0cb0d0 2024-08-17T02:23:17.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.710+0000 7f994aa00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f994c1589e0 0x7f994c0ca9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47948/0 (socket says 172.21.15.87:47948) 2024-08-17T02:23:17.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.711+0000 7f994aa00640 1 -- 172.21.15.87:0/3777889318 learned_addr learned my addr 172.21.15.87:0/3777889318 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-08-17T02:23:17.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.711+0000 7f994a000640 1 --2- 172.21.15.87:0/3777889318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f994c0cb0d0 0x7f994c158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.711+0000 7f994b400640 1 --2- 172.21.15.87:0/3777889318 >> v2:172.21.15.5:3300/0 conn(0x7f994c0cda30 0x7f994c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.711+0000 7f9949600640 1 -- 172.21.15.87:0/3777889318 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781535168 0 0) 0x7f994c0af9a0 con 0x7f994c1589e0 2024-08-17T02:23:17.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.711+0000 7f9949600640 1 -- 172.21.15.87:0/3777889318 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99300034e0 con 0x7f994c1589e0 2024-08-17T02:23:17.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.711+0000 7f994a000640 1 -- 172.21.15.87:0/3777889318 >> v2:172.21.15.5:3300/0 conn(0x7f994c0cda30 msgr2=0x7f994c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:17.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.711+0000 7f994a000640 1 --2- 172.21.15.87:0/3777889318 >> v2:172.21.15.5:3300/0 conn(0x7f994c0cda30 0x7f994c0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.711+0000 7f994a000640 1 -- 172.21.15.87:0/3777889318 >> v1:172.21.15.87:6789/0 conn(0x7f994c1589e0 legacy=0x7f994c0ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.711+0000 7f994a000640 1 -- 172.21.15.87:0/3777889318 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c0cea00 con 0x7f994c0cb0d0 2024-08-17T02:23:17.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.712+0000 7f994a000640 1 --2- 172.21.15.87:0/3777889318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f994c0cb0d0 0x7f994c158db0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9938009850 tx=0x7f99380090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66d6c853229a12b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:17.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.712+0000 7f9949600640 1 -- 172.21.15.87:0/3777889318 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993802ad90 con 0x7f994c0cb0d0 2024-08-17T02:23:17.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.712+0000 7f9949600640 1 -- 172.21.15.87:0/3777889318 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9938032440 con 0x7f994c0cb0d0 2024-08-17T02:23:17.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.712+0000 7f9949600640 1 -- 172.21.15.87:0/3777889318 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9938032820 con 0x7f994c0cb0d0 2024-08-17T02:23:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.713+0000 7f9951800640 1 -- 172.21.15.87:0/3777889318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f994c0cb0d0 msgr2=0x7f994c158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.713+0000 7f9951800640 1 --2- 172.21.15.87:0/3777889318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f994c0cb0d0 0x7f994c158db0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9938009850 tx=0x7f99380090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.713+0000 7f9951800640 1 -- 172.21.15.87:0/3777889318 shutdown_connections 2024-08-17T02:23:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.713+0000 7f9951800640 1 --2- 172.21.15.87:0/3777889318 >> v2:172.21.15.5:3300/0 conn(0x7f994c0cda30 0x7f994c0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.713+0000 7f9951800640 1 --2- 172.21.15.87:0/3777889318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f994c0cb0d0 0x7f994c158db0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.713+0000 7f9951800640 1 -- 172.21.15.87:0/3777889318 >> 172.21.15.87:0/3777889318 conn(0x7f994c06e590 msgr2=0x7f994c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.713+0000 7f9951800640 1 -- 172.21.15.87:0/3777889318 shutdown_connections 2024-08-17T02:23:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.713+0000 7f9951800640 1 -- 172.21.15.87:0/3777889318 wait complete. 2024-08-17T02:23:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.714+0000 7f9951800640 1 Processor -- start 2024-08-17T02:23:17.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.715+0000 7f9951800640 1 -- start start 2024-08-17T02:23:17.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.715+0000 7f9951800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f994c0cb0d0 0x7f994c0b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.715+0000 7f9951800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f994c0cda30 0x7f994c151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.715+0000 7f9951800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f994c1589e0 0x7f994c0c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.715+0000 7f9951800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c169790 con 0x7f994c0cb0d0 2024-08-17T02:23:17.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.715+0000 7f9951800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c169a70 con 0x7f994c1589e0 2024-08-17T02:23:17.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.715+0000 7f9951800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994c169d50 con 0x7f994c0cda30 2024-08-17T02:23:17.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.716+0000 7f994a000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f994c0cda30 0x7f994c151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.716+0000 7f994b400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f994c1589e0 0x7f994c0c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.716+0000 7f994a000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f994c0cda30 0x7f994c151d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:52104/0 (socket says 172.21.15.87:52104) 2024-08-17T02:23:17.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.716+0000 7f994aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f994c0cb0d0 0x7f994c0b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.716+0000 7f994a000640 1 -- 172.21.15.87:0/691796944 learned_addr learned my addr 172.21.15.87:0/691796944 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-08-17T02:23:17.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.716+0000 7f994a000640 1 -- 172.21.15.87:0/691796944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f994c1589e0 msgr2=0x7f994c0c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.716+0000 7f994a000640 1 --2- 172.21.15.87:0/691796944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f994c1589e0 0x7f994c0c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.716+0000 7f994a000640 1 -- 172.21.15.87:0/691796944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f994c0cb0d0 msgr2=0x7f994c0b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.716+0000 7f994a000640 1 --2- 172.21.15.87:0/691796944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f994c0cb0d0 0x7f994c0b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.716+0000 7f994a000640 1 -- 172.21.15.87:0/691796944 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9938009390 con 0x7f994c0cda30 2024-08-17T02:23:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.716+0000 7f994a000640 1 --2- 172.21.15.87:0/691796944 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f994c0cda30 0x7f994c151d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9938009360 tx=0x7f9938032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.717+0000 7f9942000640 1 -- 172.21.15.87:0/691796944 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9938031c20 con 0x7f994c0cda30 2024-08-17T02:23:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.717+0000 7f9942000640 1 -- 172.21.15.87:0/691796944 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9938031d80 con 0x7f994c0cda30 2024-08-17T02:23:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.717+0000 7f9951800640 1 -- 172.21.15.87:0/691796944 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994c16a030 con 0x7f994c0cda30 2024-08-17T02:23:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.717+0000 7f9942000640 1 -- 172.21.15.87:0/691796944 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993803d670 con 0x7f994c0cda30 2024-08-17T02:23:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.717+0000 7f9951800640 1 -- 172.21.15.87:0/691796944 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f994c0c73b0 con 0x7f994c0cda30 2024-08-17T02:23:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.717+0000 7f9942000640 1 -- 172.21.15.87:0/691796944 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9938039040 con 0x7f994c0cda30 2024-08-17T02:23:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.717+0000 7f9942000640 1 -- 172.21.15.87:0/691796944 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f9938047440 con 0x7f994c0cda30 2024-08-17T02:23:17.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.718+0000 7f9951800640 1 -- 172.21.15.87:0/691796944 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994c0c75a0 con 0x7f994c0cda30 2024-08-17T02:23:17.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.720+0000 7f9942000640 1 -- 172.21.15.87:0/691796944 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f9938042070 con 0x7f994c0cda30 2024-08-17T02:23:17.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.813+0000 7f9951800640 1 -- 172.21.15.87:0/691796944 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd new", "uuid": "284594a3-765f-4546-ac0e-06e2eb2b66c1", "id": 1} v 0) v1 -- 0x7f994c063fb0 con 0x7f994c0cda30 2024-08-17T02:23:17.814 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:17.814+0000 7f902ea0fec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:23:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.817+0000 7f9942000640 1 -- 172.21.15.87:0/691796944 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "284594a3-765f-4546-ac0e-06e2eb2b66c1", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9938037070 con 0x7f994c0cda30 2024-08-17T02:23:17.817 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-08-17T02:23:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.818+0000 7f9951800640 1 -- 172.21.15.87:0/691796944 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f994c0cda30 msgr2=0x7f994c151d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.818+0000 7f9951800640 1 --2- 172.21.15.87:0/691796944 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f994c0cda30 0x7f994c151d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9938009360 tx=0x7f9938032000 comp rx=0 tx=0).stop 2024-08-17T02:23:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.818+0000 7f9951800640 1 -- 172.21.15.87:0/691796944 shutdown_connections 2024-08-17T02:23:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.818+0000 7f9951800640 1 --2- 172.21.15.87:0/691796944 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f994c0cda30 0x7f994c151d00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.818+0000 7f9951800640 1 --2- 172.21.15.87:0/691796944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f994c1589e0 0x7f994c0c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.818+0000 7f9951800640 1 --2- 172.21.15.87:0/691796944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f994c0cb0d0 0x7f994c0b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.818+0000 7f9951800640 1 -- 172.21.15.87:0/691796944 >> 172.21.15.87:0/691796944 conn(0x7f994c06e590 msgr2=0x7f994c155f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.818+0000 7f9951800640 1 -- 172.21.15.87:0/691796944 shutdown_connections 2024-08-17T02:23:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.818+0000 7f9951800640 1 -- 172.21.15.87:0/691796944 wait complete. 2024-08-17T02:23:17.835 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326 2 2024-08-17T02:23:17.866 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:17.865+0000 7f902ea0fec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:23:17.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.978+0000 7f22d6600640 1 Processor -- start 2024-08-17T02:23:17.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.978+0000 7f22d6600640 1 -- start start 2024-08-17T02:23:17.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.979+0000 7f22d6600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f22d0158a00 0x7f22d0158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.980+0000 7f22d6600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22d006eca0 0x7f22d00cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.980+0000 7f22d6600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d00cbc50 con 0x7f22d00cb190 2024-08-17T02:23:17.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.980+0000 7f22d6600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22d00cbf30 con 0x7f22d0158a00 2024-08-17T02:23:17.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.980+0000 7f22d6600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d00cc210 con 0x7f22d006eca0 2024-08-17T02:23:17.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.980+0000 7f22d5200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f22d0158a00 0x7f22d0158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.980+0000 7f22d5c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22d006eca0 0x7f22d00cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.980+0000 7f22d5200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f22d0158a00 0x7f22d0158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36436/0 (socket says 172.21.15.87:36436) 2024-08-17T02:23:17.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.980+0000 7f22d5200640 1 -- 172.21.15.87:0/3983696915 learned_addr learned my addr 172.21.15.87:0/3983696915 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-08-17T02:23:17.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.980+0000 7f22d5200640 1 -- 172.21.15.87:0/3983696915 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22d006eca0 msgr2=0x7f22d00cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:17.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.980+0000 7f22d5200640 1 --2- 172.21.15.87:0/3983696915 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22d006eca0 0x7f22d00cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.980+0000 7f22d5200640 1 -- 172.21.15.87:0/3983696915 >> v1:172.21.15.5:6789/0 conn(0x7f22d00cb190 legacy=0x7f22d006e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.980+0000 7f22d5200640 1 -- 172.21.15.87:0/3983696915 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d00b2930 con 0x7f22d0158a00 2024-08-17T02:23:17.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.980+0000 7f22d5c00640 1 --2- 172.21.15.87:0/3983696915 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22d006eca0 0x7f22d00cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:17.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.981+0000 7f22d5200640 1 --2- 172.21.15.87:0/3983696915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22d0158a00 0x7f22d0158dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009910 tx=0x7f22c40091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3428a427dfc43b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.982+0000 7f22cf400640 1 -- 172.21.15.87:0/3983696915 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c402ae40 con 0x7f22d0158a00 2024-08-17T02:23:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.982+0000 7f22cf400640 1 -- 172.21.15.87:0/3983696915 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c4032440 con 0x7f22d0158a00 2024-08-17T02:23:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.982+0000 7f22cf400640 1 -- 172.21.15.87:0/3983696915 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c4032820 con 0x7f22d0158a00 2024-08-17T02:23:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.982+0000 7f22d6600640 1 -- 172.21.15.87:0/3983696915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22d0158a00 msgr2=0x7f22d0158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.982+0000 7f22d6600640 1 --2- 172.21.15.87:0/3983696915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22d0158a00 0x7f22d0158dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009910 tx=0x7f22c40091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.982+0000 7f22d6600640 1 -- 172.21.15.87:0/3983696915 shutdown_connections 2024-08-17T02:23:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.982+0000 7f22d6600640 1 --2- 172.21.15.87:0/3983696915 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22d006eca0 0x7f22d00cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.982+0000 7f22d6600640 1 --2- 172.21.15.87:0/3983696915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22d0158a00 0x7f22d0158dd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.982+0000 7f22d6600640 1 -- 172.21.15.87:0/3983696915 >> 172.21.15.87:0/3983696915 conn(0x7f22d00cfb80 msgr2=0x7f22d00cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.982+0000 7f22d6600640 1 -- 172.21.15.87:0/3983696915 shutdown_connections 2024-08-17T02:23:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.982+0000 7f22d6600640 1 -- 172.21.15.87:0/3983696915 wait complete. 2024-08-17T02:23:17.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.984+0000 7f22d6600640 1 Processor -- start 2024-08-17T02:23:17.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.984+0000 7f22d6600640 1 -- start start 2024-08-17T02:23:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.985+0000 7f22d6600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22d006eca0 0x7f22d00c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.985+0000 7f22d6600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22d00cb190 0x7f22d00cf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.985+0000 7f22d6600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22d0158a00 0x7f22d016c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.985+0000 7f22d6600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d00a7c40 con 0x7f22d0158a00 2024-08-17T02:23:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.985+0000 7f22d6600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d00c9a60 con 0x7f22d006eca0 2024-08-17T02:23:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.985+0000 7f22d6600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d00c9780 con 0x7f22d00cb190 2024-08-17T02:23:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.985+0000 7f22d5200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22d006eca0 0x7f22d00c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.985+0000 7f22d5200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22d006eca0 0x7f22d00c8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36442/0 (socket says 172.21.15.87:36442) 2024-08-17T02:23:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.985+0000 7f22d5200640 1 -- 172.21.15.87:0/2020980374 learned_addr learned my addr 172.21.15.87:0/2020980374 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-08-17T02:23:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.985+0000 7f22cfe00640 1 --2- 172.21.15.87:0/2020980374 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22d00cb190 0x7f22d00cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.985+0000 7f22d5c00640 1 --2- 172.21.15.87:0/2020980374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22d0158a00 0x7f22d016c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.985+0000 7f22d5200640 1 -- 172.21.15.87:0/2020980374 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22d00cb190 msgr2=0x7f22d00cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.985+0000 7f22d5200640 1 --2- 172.21.15.87:0/2020980374 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22d00cb190 0x7f22d00cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.985+0000 7f22d5200640 1 -- 172.21.15.87:0/2020980374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22d0158a00 msgr2=0x7f22d016c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.985+0000 7f22d5200640 1 --2- 172.21.15.87:0/2020980374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22d0158a00 0x7f22d016c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.986+0000 7f22d5200640 1 -- 172.21.15.87:0/2020980374 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c8009a20 con 0x7f22d006eca0 2024-08-17T02:23:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.986+0000 7f22cfe00640 1 --2- 172.21.15.87:0/2020980374 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22d00cb190 0x7f22d00cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.986+0000 7f22d5200640 1 --2- 172.21.15.87:0/2020980374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22d006eca0 0x7f22d00c8ef0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f22c4035040 tx=0x7f22c4032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.986+0000 7f22c3e00640 1 -- 172.21.15.87:0/2020980374 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c4000d10 con 0x7f22d006eca0 2024-08-17T02:23:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.986+0000 7f22c3e00640 1 -- 172.21.15.87:0/2020980374 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c4031de0 con 0x7f22d006eca0 2024-08-17T02:23:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.986+0000 7f22d6600640 1 -- 172.21.15.87:0/2020980374 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c4009450 con 0x7f22d006eca0 2024-08-17T02:23:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.986+0000 7f22c3e00640 1 -- 172.21.15.87:0/2020980374 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c403d690 con 0x7f22d006eca0 2024-08-17T02:23:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.986+0000 7f22d6600640 1 -- 172.21.15.87:0/2020980374 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d00c9430 con 0x7f22d006eca0 2024-08-17T02:23:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.986+0000 7f22c3e00640 1 -- 172.21.15.87:0/2020980374 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f22c4039040 con 0x7f22d006eca0 2024-08-17T02:23:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.987+0000 7f22c3e00640 1 -- 172.21.15.87:0/2020980374 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f22c402ae40 con 0x7f22d006eca0 2024-08-17T02:23:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.987+0000 7f22d6600640 1 -- 172.21.15.87:0/2020980374 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d00a7700 con 0x7f22d006eca0 2024-08-17T02:23:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:17.989+0000 7f22c3e00640 1 -- 172.21.15.87:0/2020980374 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f22c4042070 con 0x7f22d006eca0 2024-08-17T02:23:18.043 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:18.042+0000 7f902ea0fec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:23:18.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.063+0000 7f22d6600640 1 -- 172.21.15.87:0/2020980374 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326", "id": 2} v 0) v1 -- 0x7f22d0070720 con 0x7f22d006eca0 2024-08-17T02:23:18.066 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:18.066+0000 7fef1ee11ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:23:18.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.067+0000 7f22c3e00640 1 -- 172.21.15.87:0/2020980374 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f22c4037070 con 0x7f22d006eca0 2024-08-17T02:23:18.067 INFO:teuthology.orchestra.run.smithi087.stdout:2 2024-08-17T02:23:18.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.068+0000 7f22d6600640 1 -- 172.21.15.87:0/2020980374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22d006eca0 msgr2=0x7f22d00c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.068+0000 7f22d6600640 1 --2- 172.21.15.87:0/2020980374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22d006eca0 0x7f22d00c8ef0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f22c4035040 tx=0x7f22c4032000 comp rx=0 tx=0).stop 2024-08-17T02:23:18.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.068+0000 7f22d6600640 1 -- 172.21.15.87:0/2020980374 shutdown_connections 2024-08-17T02:23:18.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.068+0000 7f22d6600640 1 --2- 172.21.15.87:0/2020980374 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22d00cb190 0x7f22d00cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.068+0000 7f22d6600640 1 --2- 172.21.15.87:0/2020980374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22d0158a00 0x7f22d016c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.068+0000 7f22d6600640 1 --2- 172.21.15.87:0/2020980374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22d006eca0 0x7f22d00c8ef0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.068+0000 7f22d6600640 1 -- 172.21.15.87:0/2020980374 >> 172.21.15.87:0/2020980374 conn(0x7f22d00cfb80 msgr2=0x7f22d00cc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:18.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.068+0000 7f22d6600640 1 -- 172.21.15.87:0/2020980374 shutdown_connections 2024-08-17T02:23:18.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.068+0000 7f22d6600640 1 -- 172.21.15.87:0/2020980374 wait complete. 2024-08-17T02:23:18.083 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new f85e35d3-ad8e-47fc-be7e-91ff326e2c65 3 2024-08-17T02:23:18.100 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:18.100+0000 7f902ea0fec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:23:18.163 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:18.163+0000 7f902ea0fec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:23:18.171 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:18.171+0000 7fef1ee11ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:23:18.222 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:18.221+0000 7fef1ee11ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:23:18.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.228+0000 7feabe800640 1 Processor -- start 2024-08-17T02:23:18.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.228+0000 7feabe800640 1 -- start start 2024-08-17T02:23:18.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.229+0000 7feabe800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feab81589e0 0x7feab8158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.229+0000 7feabe800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feab80ca9c0 0x7feab80cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.229+0000 7feabe800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab80af9a0 con 0x7feab80cda30 2024-08-17T02:23:18.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.229+0000 7feabe800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab80af810 con 0x7feab81589e0 2024-08-17T02:23:18.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.229+0000 7feabe800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab80cb340 con 0x7feab80ca9c0 2024-08-17T02:23:18.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.229+0000 7feab6a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feab80ca9c0 0x7feab80cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.229+0000 7feab6a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feab80ca9c0 0x7feab80cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36452/0 (socket says 172.21.15.87:36452) 2024-08-17T02:23:18.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.229+0000 7feab6a00640 1 -- 172.21.15.87:0/1925987325 learned_addr learned my addr 172.21.15.87:0/1925987325 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-08-17T02:23:18.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.229+0000 7feab7400640 1 --2- 172.21.15.87:0/1925987325 >> v2:172.21.15.5:3300/0 conn(0x7feab81589e0 0x7feab8158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.230+0000 7feab6a00640 1 -- 172.21.15.87:0/1925987325 >> v2:172.21.15.5:3300/0 conn(0x7feab81589e0 msgr2=0x7feab8158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:18.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.230+0000 7feab6a00640 1 --2- 172.21.15.87:0/1925987325 >> v2:172.21.15.5:3300/0 conn(0x7feab81589e0 0x7feab8158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.230+0000 7feab6a00640 1 -- 172.21.15.87:0/1925987325 >> v1:172.21.15.87:6789/0 conn(0x7feab80cda30 legacy=0x7feab80cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.230+0000 7feab6a00640 1 -- 172.21.15.87:0/1925987325 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab80ce740 con 0x7feab80ca9c0 2024-08-17T02:23:18.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.231+0000 7feab6a00640 1 --2- 172.21.15.87:0/1925987325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab80ca9c0 0x7feab80cae00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feab81592f0 tx=0x7feaa40091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=831690fb70b8ab8f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:18.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.231+0000 7feab6000640 1 -- 172.21.15.87:0/1925987325 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa402ae80 con 0x7feab80ca9c0 2024-08-17T02:23:18.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.231+0000 7feab6000640 1 -- 172.21.15.87:0/1925987325 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa4032440 con 0x7feab80ca9c0 2024-08-17T02:23:18.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.231+0000 7feab6000640 1 -- 172.21.15.87:0/1925987325 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4032800 con 0x7feab80ca9c0 2024-08-17T02:23:18.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.231+0000 7feabe800640 1 -- 172.21.15.87:0/1925987325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab80ca9c0 msgr2=0x7feab80cae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.231+0000 7feabe800640 1 --2- 172.21.15.87:0/1925987325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab80ca9c0 0x7feab80cae00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feab81592f0 tx=0x7feaa40091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.232+0000 7feabe800640 1 -- 172.21.15.87:0/1925987325 shutdown_connections 2024-08-17T02:23:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.232+0000 7feabe800640 1 --2- 172.21.15.87:0/1925987325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab80ca9c0 0x7feab80cae00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.232+0000 7feabe800640 1 --2- 172.21.15.87:0/1925987325 >> v2:172.21.15.5:3300/0 conn(0x7feab81589e0 0x7feab8158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.232+0000 7feabe800640 1 -- 172.21.15.87:0/1925987325 >> 172.21.15.87:0/1925987325 conn(0x7feab806e590 msgr2=0x7feab806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.232+0000 7feabe800640 1 -- 172.21.15.87:0/1925987325 shutdown_connections 2024-08-17T02:23:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.232+0000 7feabe800640 1 -- 172.21.15.87:0/1925987325 wait complete. 2024-08-17T02:23:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.233+0000 7feabe800640 1 Processor -- start 2024-08-17T02:23:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.233+0000 7feabe800640 1 -- start start 2024-08-17T02:23:18.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.234+0000 7feabe800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab80ca9c0 0x7feab8149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.234+0000 7feabe800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab80cda30 0x7feab80b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.234+0000 7feabe800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feab81589e0 0x7feab80b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.234+0000 7feabe800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab814ae30 con 0x7feab80cda30 2024-08-17T02:23:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.234+0000 7feabe800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab80b5b30 con 0x7feab80ca9c0 2024-08-17T02:23:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.234+0000 7feabe800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab80b3560 con 0x7feab81589e0 2024-08-17T02:23:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.234+0000 7feab7400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab80ca9c0 0x7feab8149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.234+0000 7feab7400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab80ca9c0 0x7feab8149ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36468/0 (socket says 172.21.15.87:36468) 2024-08-17T02:23:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.234+0000 7feab7400640 1 -- 172.21.15.87:0/3734397905 learned_addr learned my addr 172.21.15.87:0/3734397905 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-08-17T02:23:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.234+0000 7feab7e00640 1 --2- 172.21.15.87:0/3734397905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feab81589e0 0x7feab80b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.234+0000 7feab6a00640 1 --2- 172.21.15.87:0/3734397905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab80cda30 0x7feab80b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.235+0000 7feab7400640 1 -- 172.21.15.87:0/3734397905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feab81589e0 msgr2=0x7feab80b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.235+0000 7feab7400640 1 --2- 172.21.15.87:0/3734397905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feab81589e0 0x7feab80b0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.235+0000 7feab7400640 1 -- 172.21.15.87:0/3734397905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab80cda30 msgr2=0x7feab80b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.235+0000 7feab7400640 1 --2- 172.21.15.87:0/3734397905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab80cda30 0x7feab80b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.235+0000 7feab7400640 1 -- 172.21.15.87:0/3734397905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa4009450 con 0x7feab80ca9c0 2024-08-17T02:23:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.235+0000 7feab7400640 1 --2- 172.21.15.87:0/3734397905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab80ca9c0 0x7feab8149ec0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7feaa800ea20 tx=0x7feaa80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.235+0000 7feaaea00640 1 -- 172.21.15.87:0/3734397905 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa800ca10 con 0x7feab80ca9c0 2024-08-17T02:23:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.235+0000 7feaaea00640 1 -- 172.21.15.87:0/3734397905 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa800cb70 con 0x7feab80ca9c0 2024-08-17T02:23:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.235+0000 7feaaea00640 1 -- 172.21.15.87:0/3734397905 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8013470 con 0x7feab80ca9c0 2024-08-17T02:23:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.235+0000 7feabe800640 1 -- 172.21.15.87:0/3734397905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab80b3840 con 0x7feab80ca9c0 2024-08-17T02:23:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.235+0000 7feabe800640 1 -- 172.21.15.87:0/3734397905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab80b5800 con 0x7feab80ca9c0 2024-08-17T02:23:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.236+0000 7feaaea00640 1 -- 172.21.15.87:0/3734397905 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7feaa8005970 con 0x7feab80ca9c0 2024-08-17T02:23:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.236+0000 7feaaea00640 1 -- 172.21.15.87:0/3734397905 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7feaa8005c20 con 0x7feab80ca9c0 2024-08-17T02:23:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.237+0000 7feabe800640 1 -- 172.21.15.87:0/3734397905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab8063fb0 con 0x7feab80ca9c0 2024-08-17T02:23:18.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.239+0000 7feaaea00640 1 -- 172.21.15.87:0/3734397905 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7feaa8021060 con 0x7feab80ca9c0 2024-08-17T02:23:18.275 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:18.275+0000 7f902ea0fec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:23:18.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.314+0000 7feabe800640 1 -- 172.21.15.87:0/3734397905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f85e35d3-ad8e-47fc-be7e-91ff326e2c65", "id": 3} v 0) v1 -- 0x7feab8147f80 con 0x7feab80ca9c0 2024-08-17T02:23:18.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.318+0000 7feaaea00640 1 -- 172.21.15.87:0/3734397905 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f85e35d3-ad8e-47fc-be7e-91ff326e2c65", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7feaa8029020 con 0x7feab80ca9c0 2024-08-17T02:23:18.318 INFO:teuthology.orchestra.run.smithi087.stdout:3 2024-08-17T02:23:18.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.319+0000 7feabe800640 1 -- 172.21.15.87:0/3734397905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab80ca9c0 msgr2=0x7feab8149ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.319+0000 7feabe800640 1 --2- 172.21.15.87:0/3734397905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab80ca9c0 0x7feab8149ec0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7feaa800ea20 tx=0x7feaa80090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.319+0000 7feabe800640 1 -- 172.21.15.87:0/3734397905 shutdown_connections 2024-08-17T02:23:18.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.319+0000 7feabe800640 1 --2- 172.21.15.87:0/3734397905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feab81589e0 0x7feab80b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.319+0000 7feabe800640 1 --2- 172.21.15.87:0/3734397905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab80cda30 0x7feab80b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.319+0000 7feabe800640 1 --2- 172.21.15.87:0/3734397905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab80ca9c0 0x7feab8149ec0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.319+0000 7feabe800640 1 -- 172.21.15.87:0/3734397905 >> 172.21.15.87:0/3734397905 conn(0x7feab806e590 msgr2=0x7feab8157640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:18.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.320+0000 7feabe800640 1 -- 172.21.15.87:0/3734397905 shutdown_connections 2024-08-17T02:23:18.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.320+0000 7feabe800640 1 -- 172.21.15.87:0/3734397905 wait complete. 2024-08-17T02:23:18.339 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 21451c33-466e-4b5e-a702-c5885e74efdc 4 2024-08-17T02:23:18.407 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:18.407+0000 7fef1ee11ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:23:18.470 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:18.470+0000 7fef1ee11ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:23:18.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.483+0000 7f6d54e00640 1 Processor -- start 2024-08-17T02:23:18.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.484+0000 7f6d54e00640 1 -- start start 2024-08-17T02:23:18.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.484+0000 7f6d54e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d50158a00 0x7f6d50158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.485+0000 7f6d54e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6d5006eca0 0x7f6d500cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.485+0000 7f6d54e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d500cbc50 con 0x7f6d500cb190 2024-08-17T02:23:18.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.485+0000 7f6d54e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d500cbf30 con 0x7f6d5006eca0 2024-08-17T02:23:18.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.485+0000 7f6d54e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d500cc210 con 0x7f6d50158a00 2024-08-17T02:23:18.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.485+0000 7f6d4fe00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6d5006eca0 0x7f6d500cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.485+0000 7f6d4fe00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6d5006eca0 0x7f6d500cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36476/0 (socket says 172.21.15.87:36476) 2024-08-17T02:23:18.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.485+0000 7f6d4fe00640 1 -- 172.21.15.87:0/3209482822 learned_addr learned my addr 172.21.15.87:0/3209482822 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-08-17T02:23:18.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.485+0000 7f6d4f400640 1 --2- 172.21.15.87:0/3209482822 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d50158a00 0x7f6d50158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.485+0000 7f6d4fe00640 1 -- 172.21.15.87:0/3209482822 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d50158a00 msgr2=0x7f6d50158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:18.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.485+0000 7f6d4fe00640 1 --2- 172.21.15.87:0/3209482822 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d50158a00 0x7f6d50158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.485+0000 7f6d4fe00640 1 -- 172.21.15.87:0/3209482822 >> v1:172.21.15.87:6789/0 conn(0x7f6d500cb190 legacy=0x7f6d5006e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.485+0000 7f6d4fe00640 1 -- 172.21.15.87:0/3209482822 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d500b2930 con 0x7f6d5006eca0 2024-08-17T02:23:18.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.486+0000 7f6d4fe00640 1 --2- 172.21.15.87:0/3209482822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5006eca0 0x7f6d500cb5c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009f20 tx=0x7f6d48009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20213287c67495ec server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:18.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.487+0000 7f6d4ea00640 1 -- 172.21.15.87:0/3209482822 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48031400 con 0x7f6d5006eca0 2024-08-17T02:23:18.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.487+0000 7f6d4ea00640 1 -- 172.21.15.87:0/3209482822 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4802d050 con 0x7f6d5006eca0 2024-08-17T02:23:18.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.487+0000 7f6d4ea00640 1 -- 172.21.15.87:0/3209482822 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d480317d0 con 0x7f6d5006eca0 2024-08-17T02:23:18.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.487+0000 7f6d54e00640 1 -- 172.21.15.87:0/3209482822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5006eca0 msgr2=0x7f6d500cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.487+0000 7f6d54e00640 1 --2- 172.21.15.87:0/3209482822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5006eca0 0x7f6d500cb5c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009f20 tx=0x7f6d48009840 comp rx=0 tx=0).stop 2024-08-17T02:23:18.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.487+0000 7f6d54e00640 1 -- 172.21.15.87:0/3209482822 shutdown_connections 2024-08-17T02:23:18.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.487+0000 7f6d54e00640 1 --2- 172.21.15.87:0/3209482822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5006eca0 0x7f6d500cb5c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.487+0000 7f6d54e00640 1 --2- 172.21.15.87:0/3209482822 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d50158a00 0x7f6d50158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.487+0000 7f6d54e00640 1 -- 172.21.15.87:0/3209482822 >> 172.21.15.87:0/3209482822 conn(0x7f6d500cfb80 msgr2=0x7f6d500cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:18.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.487+0000 7f6d54e00640 1 -- 172.21.15.87:0/3209482822 shutdown_connections 2024-08-17T02:23:18.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.487+0000 7f6d54e00640 1 -- 172.21.15.87:0/3209482822 wait complete. 2024-08-17T02:23:18.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.490+0000 7f6d54e00640 1 Processor -- start 2024-08-17T02:23:18.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.490+0000 7f6d54e00640 1 -- start start 2024-08-17T02:23:18.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.491+0000 7f6d54e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5006eca0 0x7f6d50157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.491+0000 7f6d54e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d500cb190 0x7f6d500a6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.491+0000 7f6d54e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d50158a00 0x7f6d500cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.491+0000 7f6d54e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d500aaf40 con 0x7f6d500cb190 2024-08-17T02:23:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.491+0000 7f6d54e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d500a9c90 con 0x7f6d5006eca0 2024-08-17T02:23:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.491+0000 7f6d54e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50157750 con 0x7f6d50158a00 2024-08-17T02:23:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.491+0000 7f6d4f400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5006eca0 0x7f6d50157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.492+0000 7f6d4fe00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d50158a00 0x7f6d500cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.492+0000 7f6d4f400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5006eca0 0x7f6d50157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36480/0 (socket says 172.21.15.87:36480) 2024-08-17T02:23:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.492+0000 7f6d4f400640 1 -- 172.21.15.87:0/1518376865 learned_addr learned my addr 172.21.15.87:0/1518376865 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-08-17T02:23:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.492+0000 7f6d47e00640 1 --2- 172.21.15.87:0/1518376865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d500cb190 0x7f6d500a6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.492+0000 7f6d4fe00640 1 -- 172.21.15.87:0/1518376865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5006eca0 msgr2=0x7f6d50157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.492+0000 7f6d4fe00640 1 --2- 172.21.15.87:0/1518376865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5006eca0 0x7f6d50157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.492+0000 7f6d4fe00640 1 -- 172.21.15.87:0/1518376865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d500cb190 msgr2=0x7f6d500a6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.492+0000 7f6d4fe00640 1 --2- 172.21.15.87:0/1518376865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d500cb190 0x7f6d500a6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.492+0000 7f6d4fe00640 1 -- 172.21.15.87:0/1518376865 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d48009ae0 con 0x7f6d50158a00 2024-08-17T02:23:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.492+0000 7f6d4f400640 1 --2- 172.21.15.87:0/1518376865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5006eca0 0x7f6d50157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:18.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.492+0000 7f6d4fe00640 1 --2- 172.21.15.87:0/1518376865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d50158a00 0x7f6d500cc450 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6d48030000 tx=0x7f6d48036000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.492+0000 7f6d46a00640 1 -- 172.21.15.87:0/1518376865 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48008e50 con 0x7f6d50158a00 2024-08-17T02:23:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.493+0000 7f6d46a00640 1 -- 172.21.15.87:0/1518376865 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4803b410 con 0x7f6d50158a00 2024-08-17T02:23:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.493+0000 7f6d54e00640 1 -- 172.21.15.87:0/1518376865 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d500a9080 con 0x7f6d50158a00 2024-08-17T02:23:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.493+0000 7f6d46a00640 1 -- 172.21.15.87:0/1518376865 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4803b7d0 con 0x7f6d50158a00 2024-08-17T02:23:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.493+0000 7f6d54e00640 1 -- 172.21.15.87:0/1518376865 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d500a9640 con 0x7f6d50158a00 2024-08-17T02:23:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.493+0000 7f6d46a00640 1 -- 172.21.15.87:0/1518376865 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f6d48038050 con 0x7f6d50158a00 2024-08-17T02:23:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.493+0000 7f6d46a00640 1 -- 172.21.15.87:0/1518376865 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f6d4803bdc0 con 0x7f6d50158a00 2024-08-17T02:23:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.494+0000 7f6d54e00640 1 -- 172.21.15.87:0/1518376865 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d50070720 con 0x7f6d50158a00 2024-08-17T02:23:18.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.496+0000 7f6d46a00640 1 -- 172.21.15.87:0/1518376865 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f6d48048060 con 0x7f6d50158a00 2024-08-17T02:23:18.535 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:18.535+0000 7fef1ee11ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:23:18.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.570+0000 7f6d54e00640 1 -- 172.21.15.87:0/1518376865 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd new", "uuid": "21451c33-466e-4b5e-a702-c5885e74efdc", "id": 4} v 0) v1 -- 0x7f6d500a9dd0 con 0x7f6d50158a00 2024-08-17T02:23:18.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.574+0000 7f6d46a00640 1 -- 172.21.15.87:0/1518376865 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "21451c33-466e-4b5e-a702-c5885e74efdc", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6d4803f070 con 0x7f6d50158a00 2024-08-17T02:23:18.575 INFO:teuthology.orchestra.run.smithi087.stdout:4 2024-08-17T02:23:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.575+0000 7f6d54e00640 1 -- 172.21.15.87:0/1518376865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d50158a00 msgr2=0x7f6d500cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.575+0000 7f6d54e00640 1 --2- 172.21.15.87:0/1518376865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d50158a00 0x7f6d500cc450 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6d48030000 tx=0x7f6d48036000 comp rx=0 tx=0).stop 2024-08-17T02:23:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.575+0000 7f6d54e00640 1 -- 172.21.15.87:0/1518376865 shutdown_connections 2024-08-17T02:23:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.575+0000 7f6d54e00640 1 --2- 172.21.15.87:0/1518376865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d50158a00 0x7f6d500cc450 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.575+0000 7f6d54e00640 1 --2- 172.21.15.87:0/1518376865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d500cb190 0x7f6d500a6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.575+0000 7f6d54e00640 1 --2- 172.21.15.87:0/1518376865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5006eca0 0x7f6d50157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.575+0000 7f6d54e00640 1 -- 172.21.15.87:0/1518376865 >> 172.21.15.87:0/1518376865 conn(0x7f6d500cfb80 msgr2=0x7f6d5015b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.576+0000 7f6d54e00640 1 -- 172.21.15.87:0/1518376865 shutdown_connections 2024-08-17T02:23:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.576+0000 7f6d54e00640 1 -- 172.21.15.87:0/1518376865 wait complete. 2024-08-17T02:23:18.590 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 947f783e-9840-4139-9861-5d4bafdf0a9b 5 2024-08-17T02:23:18.648 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:18.647+0000 7fef1ee11ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:23:18.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.733+0000 7f48ebe00640 1 Processor -- start 2024-08-17T02:23:18.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.733+0000 7f48ebe00640 1 -- start start 2024-08-17T02:23:18.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.735+0000 7f48ebe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48e41589e0 0x7f48e4158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.735+0000 7f48ebe00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48e40ca9c0 0x7f48e40cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.735+0000 7f48ebe00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e40af9a0 con 0x7f48e40cda30 2024-08-17T02:23:18.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.735+0000 7f48ebe00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e40af810 con 0x7f48e41589e0 2024-08-17T02:23:18.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.735+0000 7f48ebe00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e40cb310 con 0x7f48e40ca9c0 2024-08-17T02:23:18.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.735+0000 7f48e8a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48e40ca9c0 0x7f48e40cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.735+0000 7f48e8a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48e40ca9c0 0x7f48e40cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:50482/0 (socket says 172.21.15.87:50482) 2024-08-17T02:23:18.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.735+0000 7f48e8a00640 1 -- 172.21.15.87:0/2867326886 learned_addr learned my addr 172.21.15.87:0/2867326886 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-08-17T02:23:18.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.735+0000 7f48e9400640 1 --2- 172.21.15.87:0/2867326886 >> v2:172.21.15.5:3300/0 conn(0x7f48e41589e0 0x7f48e4158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.735+0000 7f48e8a00640 1 -- 172.21.15.87:0/2867326886 >> v2:172.21.15.5:3300/0 conn(0x7f48e41589e0 msgr2=0x7f48e4158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:18.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.735+0000 7f48e8a00640 1 --2- 172.21.15.87:0/2867326886 >> v2:172.21.15.5:3300/0 conn(0x7f48e41589e0 0x7f48e4158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.735+0000 7f48e8a00640 1 -- 172.21.15.87:0/2867326886 >> v1:172.21.15.5:6789/0 conn(0x7f48e40cda30 legacy=0x7f48e40cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.735+0000 7f48e8a00640 1 -- 172.21.15.87:0/2867326886 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e40ce740 con 0x7f48e40ca9c0 2024-08-17T02:23:18.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.736+0000 7f48e8a00640 1 --2- 172.21.15.87:0/2867326886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48e40ca9c0 0x7f48e40cadd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009910 tx=0x7f48d00091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=816506709981be4a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:18.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.736+0000 7f48e3e00640 1 -- 172.21.15.87:0/2867326886 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d002ae40 con 0x7f48e40ca9c0 2024-08-17T02:23:18.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.737+0000 7f48e3e00640 1 -- 172.21.15.87:0/2867326886 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d0032440 con 0x7f48e40ca9c0 2024-08-17T02:23:18.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.737+0000 7f48e3e00640 1 -- 172.21.15.87:0/2867326886 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0032820 con 0x7f48e40ca9c0 2024-08-17T02:23:18.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.737+0000 7f48ebe00640 1 -- 172.21.15.87:0/2867326886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48e40ca9c0 msgr2=0x7f48e40cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.737+0000 7f48ebe00640 1 --2- 172.21.15.87:0/2867326886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48e40ca9c0 0x7f48e40cadd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009910 tx=0x7f48d00091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.737+0000 7f48ebe00640 1 -- 172.21.15.87:0/2867326886 shutdown_connections 2024-08-17T02:23:18.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.737+0000 7f48ebe00640 1 --2- 172.21.15.87:0/2867326886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48e40ca9c0 0x7f48e40cadd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.737+0000 7f48ebe00640 1 --2- 172.21.15.87:0/2867326886 >> v2:172.21.15.5:3300/0 conn(0x7f48e41589e0 0x7f48e4158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.737+0000 7f48ebe00640 1 -- 172.21.15.87:0/2867326886 >> 172.21.15.87:0/2867326886 conn(0x7f48e406e590 msgr2=0x7f48e406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:18.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.737+0000 7f48ebe00640 1 -- 172.21.15.87:0/2867326886 shutdown_connections 2024-08-17T02:23:18.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.737+0000 7f48ebe00640 1 -- 172.21.15.87:0/2867326886 wait complete. 2024-08-17T02:23:18.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.739+0000 7f48ebe00640 1 Processor -- start 2024-08-17T02:23:18.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.739+0000 7f48ebe00640 1 -- start start 2024-08-17T02:23:18.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.740+0000 7f48ebe00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48e40ca9c0 0x7f48e4155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.740+0000 7f48ebe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48e40cda30 0x7f48e4148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.740+0000 7f48ebe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48e41589e0 0x7f48e4148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.740+0000 7f48ebe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e40c7c20 con 0x7f48e41589e0 2024-08-17T02:23:18.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.740+0000 7f48ebe00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e40c6e60 con 0x7f48e40cda30 2024-08-17T02:23:18.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.740+0000 7f48ebe00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e40c7140 con 0x7f48e40ca9c0 2024-08-17T02:23:18.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.740+0000 7f48e9400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48e40ca9c0 0x7f48e4155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.740+0000 7f48e9400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48e40ca9c0 0x7f48e4155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:50488/0 (socket says 172.21.15.87:50488) 2024-08-17T02:23:18.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.740+0000 7f48e9400640 1 -- 172.21.15.87:0/478572672 learned_addr learned my addr 172.21.15.87:0/478572672 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-08-17T02:23:18.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.740+0000 7f48e8a00640 1 --2- 172.21.15.87:0/478572672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48e40cda30 0x7f48e4148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.740+0000 7f48e9e00640 1 --2- 172.21.15.87:0/478572672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48e41589e0 0x7f48e4148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.740+0000 7f48e9400640 1 -- 172.21.15.87:0/478572672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48e40cda30 msgr2=0x7f48e4148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.740+0000 7f48e9400640 1 --2- 172.21.15.87:0/478572672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48e40cda30 0x7f48e4148340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.740+0000 7f48e9400640 1 -- 172.21.15.87:0/478572672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48e41589e0 msgr2=0x7f48e4148880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.740+0000 7f48e9400640 1 --2- 172.21.15.87:0/478572672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48e41589e0 0x7f48e4148880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.740+0000 7f48e9400640 1 -- 172.21.15.87:0/478572672 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d0009450 con 0x7f48e40ca9c0 2024-08-17T02:23:18.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.741+0000 7f48e9400640 1 --2- 172.21.15.87:0/478572672 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48e40ca9c0 0x7f48e4155310 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f48d800e900 tx=0x7f48d80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:18.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.741+0000 7f48e0c00640 1 -- 172.21.15.87:0/478572672 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d800c8e0 con 0x7f48e40ca9c0 2024-08-17T02:23:18.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.741+0000 7f48e0c00640 1 -- 172.21.15.87:0/478572672 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d800ca40 con 0x7f48e40ca9c0 2024-08-17T02:23:18.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.741+0000 7f48e0c00640 1 -- 172.21.15.87:0/478572672 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d800cde0 con 0x7f48e40ca9c0 2024-08-17T02:23:18.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.741+0000 7f48ebe00640 1 -- 172.21.15.87:0/478572672 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e40c7420 con 0x7f48e40ca9c0 2024-08-17T02:23:18.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.741+0000 7f48ebe00640 1 -- 172.21.15.87:0/478572672 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e4159550 con 0x7f48e40ca9c0 2024-08-17T02:23:18.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.741+0000 7f48e0c00640 1 -- 172.21.15.87:0/478572672 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f48d8005970 con 0x7f48e40ca9c0 2024-08-17T02:23:18.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.741+0000 7f48e0c00640 1 -- 172.21.15.87:0/478572672 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f48d8006020 con 0x7f48e40ca9c0 2024-08-17T02:23:18.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.742+0000 7f48ebe00640 1 -- 172.21.15.87:0/478572672 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e40c78a0 con 0x7f48e40ca9c0 2024-08-17T02:23:18.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.746+0000 7f48e0c00640 1 -- 172.21.15.87:0/478572672 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f48d8021060 con 0x7f48e40ca9c0 2024-08-17T02:23:18.754 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:18.754+0000 7f902ea0fec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:23:18.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.819+0000 7f48ebe00640 1 -- 172.21.15.87:0/478572672 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd new", "uuid": "947f783e-9840-4139-9861-5d4bafdf0a9b", "id": 5} v 0) v1 -- 0x7f48e4063fb0 con 0x7f48e40ca9c0 2024-08-17T02:23:18.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.824+0000 7f48e0c00640 1 -- 172.21.15.87:0/478572672 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "947f783e-9840-4139-9861-5d4bafdf0a9b", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f48d8017070 con 0x7f48e40ca9c0 2024-08-17T02:23:18.824 INFO:teuthology.orchestra.run.smithi087.stdout:5 2024-08-17T02:23:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.824+0000 7f48ebe00640 1 -- 172.21.15.87:0/478572672 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48e40ca9c0 msgr2=0x7f48e4155310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.824+0000 7f48ebe00640 1 --2- 172.21.15.87:0/478572672 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48e40ca9c0 0x7f48e4155310 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f48d800e900 tx=0x7f48d80090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.825+0000 7f48ebe00640 1 -- 172.21.15.87:0/478572672 shutdown_connections 2024-08-17T02:23:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.825+0000 7f48ebe00640 1 --2- 172.21.15.87:0/478572672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48e41589e0 0x7f48e4148880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.825+0000 7f48ebe00640 1 --2- 172.21.15.87:0/478572672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48e40cda30 0x7f48e4148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.825+0000 7f48ebe00640 1 --2- 172.21.15.87:0/478572672 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48e40ca9c0 0x7f48e4155310 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.825+0000 7f48ebe00640 1 -- 172.21.15.87:0/478572672 >> 172.21.15.87:0/478572672 conn(0x7f48e406e590 msgr2=0x7f48e40b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.825+0000 7f48ebe00640 1 -- 172.21.15.87:0/478572672 shutdown_connections 2024-08-17T02:23:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.825+0000 7f48ebe00640 1 -- 172.21.15.87:0/478572672 wait complete. 2024-08-17T02:23:18.838 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 40e2bc2d-f473-41bc-a9c5-e27fce4befc2 6 2024-08-17T02:23:18.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.985+0000 7fd8aa400640 1 Processor -- start 2024-08-17T02:23:18.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.985+0000 7fd8aa400640 1 -- start start 2024-08-17T02:23:18.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.987+0000 7fd8aa400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8a40b0e40 0x7fd8a40ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.987+0000 7fd8aa400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a40af9a0 con 0x7fd8a40cb0d0 2024-08-17T02:23:18.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.987+0000 7fd8aa400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a40ce740 con 0x7fd8a41589e0 2024-08-17T02:23:18.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.987+0000 7fd8aa400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a40af810 con 0x7fd8a40b0e40 2024-08-17T02:23:18.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.987+0000 7fd8a3400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd8a41589e0 0x7fd8a40ca9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:35498/0 (socket says 172.21.15.87:35498) 2024-08-17T02:23:18.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.987+0000 7fd8a3400640 1 -- 172.21.15.87:0/253436916 learned_addr learned my addr 172.21.15.87:0/253436916 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-08-17T02:23:18.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.987+0000 7fd8a3e00640 1 --2- 172.21.15.87:0/253436916 >> v2:172.21.15.5:3300/0 conn(0x7fd8a40b0e40 0x7fd8a40ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.988+0000 7fd8a2000640 1 -- 172.21.15.87:0/253436916 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402729421 0 0) 0x7fd8a40ce740 con 0x7fd8a41589e0 2024-08-17T02:23:18.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.988+0000 7fd8a2000640 1 -- 172.21.15.87:0/253436916 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8880034e0 con 0x7fd8a41589e0 2024-08-17T02:23:18.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.988+0000 7fd8a3e00640 1 -- 172.21.15.87:0/253436916 >> v1:172.21.15.87:6789/0 conn(0x7fd8a41589e0 legacy=0x7fd8a40ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.988+0000 7fd8a3e00640 1 -- 172.21.15.87:0/253436916 >> v1:172.21.15.5:6789/0 conn(0x7fd8a40cb0d0 legacy=0x7fd8a40cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.988+0000 7fd8a2000640 1 -- 172.21.15.87:0/253436916 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721954925 0 0) 0x7fd8a40af9a0 con 0x7fd8a40cb0d0 2024-08-17T02:23:18.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.988+0000 7fd8a3e00640 1 -- 172.21.15.87:0/253436916 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a40cea00 con 0x7fd8a40b0e40 2024-08-17T02:23:18.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.989+0000 7fd8a3e00640 1 --2- 172.21.15.87:0/253436916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8a40b0e40 0x7fd8a40ce140 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009e60 tx=0x7fd89c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421e48291baf2145 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:18.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.989+0000 7fd8a2000640 1 -- 172.21.15.87:0/253436916 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c007550 con 0x7fd8a40b0e40 2024-08-17T02:23:18.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.989+0000 7fd8a2000640 1 -- 172.21.15.87:0/253436916 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c02d050 con 0x7fd8a40b0e40 2024-08-17T02:23:18.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.989+0000 7fd8a2000640 1 -- 172.21.15.87:0/253436916 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0078c0 con 0x7fd8a40b0e40 2024-08-17T02:23:18.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.990+0000 7fd8aa400640 1 -- 172.21.15.87:0/253436916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8a40b0e40 msgr2=0x7fd8a40ce140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.990+0000 7fd8aa400640 1 --2- 172.21.15.87:0/253436916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8a40b0e40 0x7fd8a40ce140 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009e60 tx=0x7fd89c009780 comp rx=0 tx=0).stop 2024-08-17T02:23:18.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.990+0000 7fd8aa400640 1 -- 172.21.15.87:0/253436916 shutdown_connections 2024-08-17T02:23:18.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.990+0000 7fd8aa400640 1 --2- 172.21.15.87:0/253436916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8a40b0e40 0x7fd8a40ce140 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.990+0000 7fd8aa400640 1 -- 172.21.15.87:0/253436916 >> 172.21.15.87:0/253436916 conn(0x7fd8a406e590 msgr2=0x7fd8a406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:18.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.990+0000 7fd8aa400640 1 -- 172.21.15.87:0/253436916 shutdown_connections 2024-08-17T02:23:18.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.990+0000 7fd8aa400640 1 -- 172.21.15.87:0/253436916 wait complete. 2024-08-17T02:23:18.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.991+0000 7fd8aa400640 1 Processor -- start 2024-08-17T02:23:18.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.991+0000 7fd8aa400640 1 -- start start 2024-08-17T02:23:18.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.992+0000 7fd8aa400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8a40b0e40 0x7fd8a40b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.992+0000 7fd8aa400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8a40cb0d0 0x7fd8a415db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.992+0000 7fd8aa400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8a41589e0 0x7fd8a40b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:18.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.992+0000 7fd8aa400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a40b50e0 con 0x7fd8a40cb0d0 2024-08-17T02:23:18.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.992+0000 7fd8aa400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a40b4230 con 0x7fd8a40b0e40 2024-08-17T02:23:18.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.992+0000 7fd8aa400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a40b44d0 con 0x7fd8a41589e0 2024-08-17T02:23:18.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.992+0000 7fd8a3400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8a40b0e40 0x7fd8a40b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.992+0000 7fd8a3e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8a41589e0 0x7fd8a40b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.992+0000 7fd8a3400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8a40b0e40 0x7fd8a40b5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36504/0 (socket says 172.21.15.87:36504) 2024-08-17T02:23:18.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.992+0000 7fd8a2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8a40cb0d0 0x7fd8a415db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:18.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.992+0000 7fd8a3400640 1 -- 172.21.15.87:0/134889370 learned_addr learned my addr 172.21.15.87:0/134889370 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-08-17T02:23:18.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.993+0000 7fd8a3400640 1 -- 172.21.15.87:0/134889370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8a41589e0 msgr2=0x7fd8a40b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.993+0000 7fd8a3400640 1 --2- 172.21.15.87:0/134889370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8a41589e0 0x7fd8a40b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.993+0000 7fd8a3400640 1 -- 172.21.15.87:0/134889370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8a40cb0d0 msgr2=0x7fd8a415db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:18.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.993+0000 7fd8a3400640 1 --2- 172.21.15.87:0/134889370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8a40cb0d0 0x7fd8a415db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:18.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.993+0000 7fd8a3400640 1 -- 172.21.15.87:0/134889370 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c009a20 con 0x7fd8a40b0e40 2024-08-17T02:23:18.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.993+0000 7fd8a3400640 1 --2- 172.21.15.87:0/134889370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8a40b0e40 0x7fd8a40b5570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd89400c4b0 tx=0x7fd894007d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:18.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.993+0000 7fd89aa00640 1 -- 172.21.15.87:0/134889370 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894005aa0 con 0x7fd8a40b0e40 2024-08-17T02:23:18.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.993+0000 7fd89aa00640 1 -- 172.21.15.87:0/134889370 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd894005c00 con 0x7fd8a40b0e40 2024-08-17T02:23:18.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.993+0000 7fd8aa400640 1 -- 172.21.15.87:0/134889370 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a40b47b0 con 0x7fd8a40b0e40 2024-08-17T02:23:18.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.993+0000 7fd89aa00640 1 -- 172.21.15.87:0/134889370 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8940070d0 con 0x7fd8a40b0e40 2024-08-17T02:23:18.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.994+0000 7fd8aa400640 1 -- 172.21.15.87:0/134889370 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a40b4d70 con 0x7fd8a40b0e40 2024-08-17T02:23:18.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.994+0000 7fd89aa00640 1 -- 172.21.15.87:0/134889370 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fd8940074c0 con 0x7fd8a40b0e40 2024-08-17T02:23:18.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.994+0000 7fd89aa00640 1 -- 172.21.15.87:0/134889370 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fd89401c440 con 0x7fd8a40b0e40 2024-08-17T02:23:18.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.995+0000 7fd8aa400640 1 -- 172.21.15.87:0/134889370 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a4063fb0 con 0x7fd8a40b0e40 2024-08-17T02:23:19.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:18.997+0000 7fd89aa00640 1 -- 172.21.15.87:0/134889370 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fd894017070 con 0x7fd8a40b0e40 2024-08-17T02:23:19.038 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:19.037+0000 7f902ea0fec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:23:19.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.069+0000 7fd8aa400640 1 -- 172.21.15.87:0/134889370 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "40e2bc2d-f473-41bc-a9c5-e27fce4befc2", "id": 6} v 0) v1 -- 0x7fd8a40b2110 con 0x7fd8a40b0e40 2024-08-17T02:23:19.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.072+0000 7fd89aa00640 1 -- 172.21.15.87:0/134889370 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "40e2bc2d-f473-41bc-a9c5-e27fce4befc2", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd89401c9e0 con 0x7fd8a40b0e40 2024-08-17T02:23:19.073 INFO:teuthology.orchestra.run.smithi087.stdout:6 2024-08-17T02:23:19.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.074+0000 7fd8aa400640 1 -- 172.21.15.87:0/134889370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8a40b0e40 msgr2=0x7fd8a40b5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:19.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.074+0000 7fd8aa400640 1 --2- 172.21.15.87:0/134889370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8a40b0e40 0x7fd8a40b5570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd89400c4b0 tx=0x7fd894007d60 comp rx=0 tx=0).stop 2024-08-17T02:23:19.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.074+0000 7fd8aa400640 1 -- 172.21.15.87:0/134889370 shutdown_connections 2024-08-17T02:23:19.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.074+0000 7fd8aa400640 1 --2- 172.21.15.87:0/134889370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8a41589e0 0x7fd8a40b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.074+0000 7fd8aa400640 1 --2- 172.21.15.87:0/134889370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8a40cb0d0 0x7fd8a415db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.074+0000 7fd8aa400640 1 --2- 172.21.15.87:0/134889370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8a40b0e40 0x7fd8a40b5570 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.074+0000 7fd8aa400640 1 -- 172.21.15.87:0/134889370 >> 172.21.15.87:0/134889370 conn(0x7fd8a406e590 msgr2=0x7fd8a40cd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:19.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.074+0000 7fd8aa400640 1 -- 172.21.15.87:0/134889370 shutdown_connections 2024-08-17T02:23:19.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.074+0000 7fd8aa400640 1 -- 172.21.15.87:0/134889370 wait complete. 2024-08-17T02:23:19.088 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 8dde8102-4556-4322-9521-15076220af61 7 2024-08-17T02:23:19.100 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:19.100+0000 7f902ea0fec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:23:19.126 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:19.126+0000 7fef1ee11ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:23:19.217 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:19.217+0000 7f902ea0fec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:23:19.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.232+0000 7f5571800640 1 Processor -- start 2024-08-17T02:23:19.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.232+0000 7f5571800640 1 -- start start 2024-08-17T02:23:19.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.234+0000 7f5571800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f556c158a00 0x7f556c158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:19.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.234+0000 7f5571800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f556c0cb190 0x7f556c0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:19.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.234+0000 7f5571800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f556c06e590 0x7f556c06e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:19.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.234+0000 7f5571800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f556c06ef10 con 0x7f556c06e590 2024-08-17T02:23:19.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.234+0000 7f5571800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f556c0cbc50 con 0x7f556c0cb190 2024-08-17T02:23:19.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.234+0000 7f5571800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c0cbf30 con 0x7f556c158a00 2024-08-17T02:23:19.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.234+0000 7f556be00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f556c158a00 0x7f556c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:19.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.234+0000 7f556be00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f556c158a00 0x7f556c158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:50504/0 (socket says 172.21.15.87:50504) 2024-08-17T02:23:19.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.234+0000 7f5563e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f556c0cb190 0x7f556c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:19.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.234+0000 7f556be00640 1 -- 172.21.15.87:0/238445401 learned_addr learned my addr 172.21.15.87:0/238445401 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-08-17T02:23:19.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.234+0000 7f5570e00640 1 --2- 172.21.15.87:0/238445401 >> v2:172.21.15.5:3300/0 conn(0x7f556c06e590 0x7f556c06e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:19.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.234+0000 7f556be00640 1 -- 172.21.15.87:0/238445401 >> v2:172.21.15.87:3300/0 conn(0x7f556c0cb190 msgr2=0x7f556c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:19.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.234+0000 7f556be00640 1 --2- 172.21.15.87:0/238445401 >> v2:172.21.15.87:3300/0 conn(0x7f556c0cb190 0x7f556c0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.234+0000 7f556be00640 1 -- 172.21.15.87:0/238445401 >> v2:172.21.15.5:3300/0 conn(0x7f556c06e590 msgr2=0x7f556c06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:19.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.234+0000 7f556be00640 1 --2- 172.21.15.87:0/238445401 >> v2:172.21.15.5:3300/0 conn(0x7f556c06e590 0x7f556c06e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.234+0000 7f556be00640 1 -- 172.21.15.87:0/238445401 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c0cc210 con 0x7f556c158a00 2024-08-17T02:23:19.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.234+0000 7f5563e00640 1 --2- 172.21.15.87:0/238445401 >> v2:172.21.15.87:3300/0 conn(0x7f556c0cb190 0x7f556c0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:19.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.235+0000 7f556be00640 1 --2- 172.21.15.87:0/238445401 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f556c158a00 0x7f556c158dd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f556c069450 tx=0x7f555c0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12f9016fe7b70f7d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:19.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.236+0000 7f556b400640 1 -- 172.21.15.87:0/238445401 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c02add0 con 0x7f556c158a00 2024-08-17T02:23:19.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.236+0000 7f556b400640 1 -- 172.21.15.87:0/238445401 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555c032440 con 0x7f556c158a00 2024-08-17T02:23:19.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.236+0000 7f556b400640 1 -- 172.21.15.87:0/238445401 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c032820 con 0x7f556c158a00 2024-08-17T02:23:19.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.236+0000 7f5571800640 1 -- 172.21.15.87:0/238445401 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f556c158a00 msgr2=0x7f556c158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:19.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.236+0000 7f5571800640 1 --2- 172.21.15.87:0/238445401 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f556c158a00 0x7f556c158dd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f556c069450 tx=0x7f555c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.236+0000 7f5571800640 1 -- 172.21.15.87:0/238445401 shutdown_connections 2024-08-17T02:23:19.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.236+0000 7f5571800640 1 --2- 172.21.15.87:0/238445401 >> v2:172.21.15.5:3300/0 conn(0x7f556c06e590 0x7f556c06e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.236+0000 7f5571800640 1 --2- 172.21.15.87:0/238445401 >> v2:172.21.15.87:3300/0 conn(0x7f556c0cb190 0x7f556c0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.236+0000 7f5571800640 1 --2- 172.21.15.87:0/238445401 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f556c158a00 0x7f556c158dd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.236+0000 7f5571800640 1 -- 172.21.15.87:0/238445401 >> 172.21.15.87:0/238445401 conn(0x7f556c0cfb80 msgr2=0x7f556c0cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:19.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.236+0000 7f5571800640 1 -- 172.21.15.87:0/238445401 shutdown_connections 2024-08-17T02:23:19.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.236+0000 7f5571800640 1 -- 172.21.15.87:0/238445401 wait complete. 2024-08-17T02:23:19.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.238+0000 7f5571800640 1 Processor -- start 2024-08-17T02:23:19.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.238+0000 7f5571800640 1 -- start start 2024-08-17T02:23:19.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.239+0000 7f5571800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f556c06e590 0x7f556c169860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:19.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.239+0000 7f5571800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f556c0cb190 0x7f556c0aa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:19.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.239+0000 7f5571800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f556c158a00 0x7f556c0aac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:19.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.239+0000 7f5571800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c0ab290 con 0x7f556c0cb190 2024-08-17T02:23:19.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.239+0000 7f5571800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c16a3b0 con 0x7f556c158a00 2024-08-17T02:23:19.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.239+0000 7f5571800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c16a690 con 0x7f556c06e590 2024-08-17T02:23:19.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.239+0000 7f556be00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f556c06e590 0x7f556c169860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:19.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.239+0000 7f5570e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f556c158a00 0x7f556c0aac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:19.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.239+0000 7f556be00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f556c06e590 0x7f556c169860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:50520/0 (socket says 172.21.15.87:50520) 2024-08-17T02:23:19.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.239+0000 7f556be00640 1 -- 172.21.15.87:0/1153882173 learned_addr learned my addr 172.21.15.87:0/1153882173 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-08-17T02:23:19.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.239+0000 7f5563e00640 1 --2- 172.21.15.87:0/1153882173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f556c0cb190 0x7f556c0aa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:19.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.239+0000 7f556be00640 1 -- 172.21.15.87:0/1153882173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f556c158a00 msgr2=0x7f556c0aac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:19.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.239+0000 7f556be00640 1 --2- 172.21.15.87:0/1153882173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f556c158a00 0x7f556c0aac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.239+0000 7f556be00640 1 -- 172.21.15.87:0/1153882173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f556c0cb190 msgr2=0x7f556c0aa6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:19.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.239+0000 7f556be00640 1 --2- 172.21.15.87:0/1153882173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f556c0cb190 0x7f556c0aa6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.239+0000 7f556be00640 1 -- 172.21.15.87:0/1153882173 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5554009390 con 0x7f556c06e590 2024-08-17T02:23:19.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.239+0000 7f5570e00640 1 --2- 172.21.15.87:0/1153882173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f556c158a00 0x7f556c0aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:19.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.240+0000 7f556be00640 1 --2- 172.21.15.87:0/1153882173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f556c06e590 0x7f556c169860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f555c035040 tx=0x7f555c032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:19.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.240+0000 7f5563400640 1 -- 172.21.15.87:0/1153882173 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c031bb0 con 0x7f556c06e590 2024-08-17T02:23:19.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.240+0000 7f5563400640 1 -- 172.21.15.87:0/1153882173 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555c031d50 con 0x7f556c06e590 2024-08-17T02:23:19.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.240+0000 7f5571800640 1 -- 172.21.15.87:0/1153882173 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555c009450 con 0x7f556c06e590 2024-08-17T02:23:19.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.240+0000 7f5563400640 1 -- 172.21.15.87:0/1153882173 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c03d670 con 0x7f556c06e590 2024-08-17T02:23:19.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.240+0000 7f5571800640 1 -- 172.21.15.87:0/1153882173 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556c16ac50 con 0x7f556c06e590 2024-08-17T02:23:19.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.240+0000 7f5563400640 1 -- 172.21.15.87:0/1153882173 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f555c039040 con 0x7f556c06e590 2024-08-17T02:23:19.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.240+0000 7f5563400640 1 -- 172.21.15.87:0/1153882173 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f555c03ddc0 con 0x7f556c06e590 2024-08-17T02:23:19.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.241+0000 7f5571800640 1 -- 172.21.15.87:0/1153882173 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f556c16ae40 con 0x7f556c06e590 2024-08-17T02:23:19.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.245+0000 7f5563400640 1 -- 172.21.15.87:0/1153882173 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f555c042070 con 0x7f556c06e590 2024-08-17T02:23:19.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.318+0000 7f5571800640 1 -- 172.21.15.87:0/1153882173 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8dde8102-4556-4322-9521-15076220af61", "id": 7} v 0) v1 -- 0x7f556c070720 con 0x7f556c06e590 2024-08-17T02:23:19.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.328+0000 7f5563400640 1 -- 172.21.15.87:0/1153882173 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8dde8102-4556-4322-9521-15076220af61", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f555c037070 con 0x7f556c06e590 2024-08-17T02:23:19.328 INFO:teuthology.orchestra.run.smithi087.stdout:7 2024-08-17T02:23:19.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.329+0000 7f5571800640 1 -- 172.21.15.87:0/1153882173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f556c06e590 msgr2=0x7f556c169860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:19.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.329+0000 7f5571800640 1 --2- 172.21.15.87:0/1153882173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f556c06e590 0x7f556c169860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f555c035040 tx=0x7f555c032000 comp rx=0 tx=0).stop 2024-08-17T02:23:19.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.329+0000 7f5571800640 1 -- 172.21.15.87:0/1153882173 shutdown_connections 2024-08-17T02:23:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.329+0000 7f5571800640 1 --2- 172.21.15.87:0/1153882173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f556c158a00 0x7f556c0aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.329+0000 7f5571800640 1 --2- 172.21.15.87:0/1153882173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f556c0cb190 0x7f556c0aa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.329+0000 7f5571800640 1 --2- 172.21.15.87:0/1153882173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f556c06e590 0x7f556c169860 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.329+0000 7f5571800640 1 -- 172.21.15.87:0/1153882173 >> 172.21.15.87:0/1153882173 conn(0x7f556c0cfb80 msgr2=0x7f556c0cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.329+0000 7f5571800640 1 -- 172.21.15.87:0/1153882173 shutdown_connections 2024-08-17T02:23:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-08-17T02:23:19.329+0000 7f5571800640 1 -- 172.21.15.87:0/1153882173 wait complete. 2024-08-17T02:23:19.343 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:23:19.343 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:23:19.348 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:23:19.348 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:23:19.348 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:23:19.352 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:23:19.353 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:23:19.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:23:19.357 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:23:19.357 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:23:19.358 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:23:19.362 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:23:19.363 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:23:19.363 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:23:19.389 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:23:19.390 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:23:19.390 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:23:19.394 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:23:19.394 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:23:19.394 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:23:19.398 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:23:19.398 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:23:19.398 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:23:19.403 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:23:19.403 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:19.414 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:19.414+0000 7fef1ee11ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:23:19.486 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:19.486+0000 7fef1ee11ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:23:19.574 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:19.574+0000 7f902ea0fec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:23:19.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.589+0000 7f8abbe00640 1 Processor -- start 2024-08-17T02:23:19.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.589+0000 7f8abbe00640 1 -- start start 2024-08-17T02:23:19.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.590+0000 7f8abbe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8abc158c60 0x7f8abc15a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:19.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.590+0000 7f8abbe00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8abc0b1920 0x7f8abc0b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:19.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.590+0000 7f8abbe00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc15b6b0 con 0x7f8abc159030 2024-08-17T02:23:19.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.590+0000 7f8abbe00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8abc0b0540 con 0x7f8abc158c60 2024-08-17T02:23:19.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.590+0000 7f8abbe00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8abc15aac0 con 0x7f8abc0b1920 2024-08-17T02:23:19.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.590+0000 7f8abaa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8abc158c60 0x7f8abc15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:19.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.590+0000 7f8abaa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8abc158c60 0x7f8abc15a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33498/0 (socket says 172.21.15.5:33498) 2024-08-17T02:23:19.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.590+0000 7f8abaa00640 1 -- 172.21.15.5:0/2085200376 learned_addr learned my addr 172.21.15.5:0/2085200376 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:19.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.590+0000 7f8abb400640 1 --2- 172.21.15.5:0/2085200376 >> v2:172.21.15.87:3300/0 conn(0x7f8abc0b1920 0x7f8abc0b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:19.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.591+0000 7f8abaa00640 1 -- 172.21.15.5:0/2085200376 >> v2:172.21.15.87:3300/0 conn(0x7f8abc0b1920 msgr2=0x7f8abc0b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:19.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.591+0000 7f8abaa00640 1 --2- 172.21.15.5:0/2085200376 >> v2:172.21.15.87:3300/0 conn(0x7f8abc0b1920 0x7f8abc0b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.591+0000 7f8abaa00640 1 -- 172.21.15.5:0/2085200376 >> v1:172.21.15.87:6789/0 conn(0x7f8abc159030 legacy=0x7f8abc0ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:19.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.591+0000 7f8abaa00640 1 -- 172.21.15.5:0/2085200376 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc15ad80 con 0x7f8abc158c60 2024-08-17T02:23:19.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.591+0000 7f8abb400640 1 --2- 172.21.15.5:0/2085200376 >> v2:172.21.15.87:3300/0 conn(0x7f8abc0b1920 0x7f8abc0b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:19.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.592+0000 7f8abaa00640 1 --2- 172.21.15.5:0/2085200376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8abc158c60 0x7f8abc15a490 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0c6b30 tx=0x7f8aac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9278d39d2b38e42b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:19.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.592+0000 7f8ab9600640 1 -- 172.21.15.5:0/2085200376 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac02ae80 con 0x7f8abc158c60 2024-08-17T02:23:19.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.592+0000 7f8ab9600640 1 -- 172.21.15.5:0/2085200376 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac032440 con 0x7f8abc158c60 2024-08-17T02:23:19.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.592+0000 7f8ab9600640 1 -- 172.21.15.5:0/2085200376 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac032800 con 0x7f8abc158c60 2024-08-17T02:23:19.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.593+0000 7f8abbe00640 1 -- 172.21.15.5:0/2085200376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8abc158c60 msgr2=0x7f8abc15a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:19.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.593+0000 7f8abbe00640 1 --2- 172.21.15.5:0/2085200376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8abc158c60 0x7f8abc15a490 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0c6b30 tx=0x7f8aac0091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.593+0000 7f8abbe00640 1 -- 172.21.15.5:0/2085200376 shutdown_connections 2024-08-17T02:23:19.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.593+0000 7f8abbe00640 1 --2- 172.21.15.5:0/2085200376 >> v2:172.21.15.87:3300/0 conn(0x7f8abc0b1920 0x7f8abc0b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.593+0000 7f8abbe00640 1 --2- 172.21.15.5:0/2085200376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8abc158c60 0x7f8abc15a490 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.593+0000 7f8abbe00640 1 -- 172.21.15.5:0/2085200376 >> 172.21.15.5:0/2085200376 conn(0x7f8abc06e590 msgr2=0x7f8abc06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:19.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.593+0000 7f8abbe00640 1 -- 172.21.15.5:0/2085200376 shutdown_connections 2024-08-17T02:23:19.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.593+0000 7f8abbe00640 1 -- 172.21.15.5:0/2085200376 wait complete. 2024-08-17T02:23:19.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.594+0000 7f8abbe00640 1 Processor -- start 2024-08-17T02:23:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.594+0000 7f8abbe00640 1 -- start start 2024-08-17T02:23:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.595+0000 7f8abbe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8abc0b1920 0x7f8abc0c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.595+0000 7f8abbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8abc158c60 0x7f8abc168300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.595+0000 7f8abbe00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8abc159030 0x7f8abc15bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.595+0000 7f8abbe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0c48d0 con 0x7f8abc158c60 2024-08-17T02:23:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.595+0000 7f8abbe00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc15e4f0 con 0x7f8abc0b1920 2024-08-17T02:23:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.595+0000 7f8abbe00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0c93f0 con 0x7f8abc159030 2024-08-17T02:23:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.595+0000 7f8aba000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8abc158c60 0x7f8abc168300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.596+0000 7f8abaa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8abc0b1920 0x7f8abc0c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.596+0000 7f8abb400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8abc159030 0x7f8abc15bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.596+0000 7f8aba000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8abc158c60 0x7f8abc168300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33514/0 (socket says 172.21.15.5:33514) 2024-08-17T02:23:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.596+0000 7f8aba000640 1 -- 172.21.15.5:0/3611785038 learned_addr learned my addr 172.21.15.5:0/3611785038 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:19.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.596+0000 7f8abaa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8abc0b1920 0x7f8abc0c4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:44844/0 (socket says 172.21.15.5:44844) 2024-08-17T02:23:19.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.596+0000 7f8aba000640 1 -- 172.21.15.5:0/3611785038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8abc159030 msgr2=0x7f8abc15bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:19.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.596+0000 7f8aba000640 1 --2- 172.21.15.5:0/3611785038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8abc159030 0x7f8abc15bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.596+0000 7f8aba000640 1 -- 172.21.15.5:0/3611785038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8abc0b1920 msgr2=0x7f8abc0c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:19.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.596+0000 7f8aba000640 1 --2- 172.21.15.5:0/3611785038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8abc0b1920 0x7f8abc0c4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.596+0000 7f8aba000640 1 -- 172.21.15.5:0/3611785038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab4009a20 con 0x7f8abc158c60 2024-08-17T02:23:19.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.596+0000 7f8aba000640 1 --2- 172.21.15.5:0/3611785038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8abc158c60 0x7f8abc168300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800c4c0 tx=0x7f8aa8007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:19.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.596+0000 7f8ab2000640 1 -- 172.21.15.5:0/3611785038 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8001080 con 0x7f8abc158c60 2024-08-17T02:23:19.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.596+0000 7f8ab2000640 1 -- 172.21.15.5:0/3611785038 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa8011590 con 0x7f8abc158c60 2024-08-17T02:23:19.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.596+0000 7f8ab2000640 1 -- 172.21.15.5:0/3611785038 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8011950 con 0x7f8abc158c60 2024-08-17T02:23:19.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.596+0000 7f8abbe00640 1 -- 172.21.15.5:0/3611785038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aac009450 con 0x7f8abc158c60 2024-08-17T02:23:19.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.597+0000 7f8abbe00640 1 -- 172.21.15.5:0/3611785038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc168840 con 0x7f8abc158c60 2024-08-17T02:23:19.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.597+0000 7f8ab2000640 1 -- 172.21.15.5:0/3611785038 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f8aa8012420 con 0x7f8abc158c60 2024-08-17T02:23:19.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.597+0000 7f8ab2000640 1 -- 172.21.15.5:0/3611785038 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f8aa8011d80 con 0x7f8abc158c60 2024-08-17T02:23:19.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.598+0000 7f8abbe00640 1 -- 172.21.15.5:0/3611785038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8abc070720 con 0x7f8abc158c60 2024-08-17T02:23:19.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.601+0000 7f8ab2000640 1 -- 172.21.15.5:0/3611785038 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f8aa8021060 con 0x7f8abc158c60 2024-08-17T02:23:19.620 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:19.620+0000 7fef1ee11ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:23:19.633 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:19.633+0000 7f902ea0fec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:23:19.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.665+0000 7f8abbe00640 1 -- 172.21.15.5:0/3611785038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8abc15e630 con 0x7f8abc158c60 2024-08-17T02:23:19.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.666+0000 7f8ab2000640 1 -- 172.21.15.5:0/3611785038 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f8aa8017070 con 0x7f8abc158c60 2024-08-17T02:23:19.667 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:19.667 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:19.320342+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:19.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.667+0000 7f8abbe00640 1 -- 172.21.15.5:0/3611785038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8abc158c60 msgr2=0x7f8abc168300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:19.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.667+0000 7f8abbe00640 1 --2- 172.21.15.5:0/3611785038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8abc158c60 0x7f8abc168300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800c4c0 tx=0x7f8aa8007ef0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.667+0000 7f8abbe00640 1 -- 172.21.15.5:0/3611785038 shutdown_connections 2024-08-17T02:23:19.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.667+0000 7f8abbe00640 1 --2- 172.21.15.5:0/3611785038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8abc159030 0x7f8abc15bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.667+0000 7f8abbe00640 1 --2- 172.21.15.5:0/3611785038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8abc158c60 0x7f8abc168300 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.667+0000 7f8abbe00640 1 --2- 172.21.15.5:0/3611785038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8abc0b1920 0x7f8abc0c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.667+0000 7f8abbe00640 1 -- 172.21.15.5:0/3611785038 >> 172.21.15.5:0/3611785038 conn(0x7f8abc06e590 msgr2=0x7f8abc0b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:19.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.667+0000 7f8abbe00640 1 -- 172.21.15.5:0/3611785038 shutdown_connections 2024-08-17T02:23:19.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:19.667+0000 7f8abbe00640 1 -- 172.21.15.5:0/3611785038 wait complete. 2024-08-17T02:23:19.682 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:23:19.683 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:23:19.823 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:19.822+0000 7f902ea0fec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:23:19.883 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:19.882+0000 7f902ea0fec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:23:19.903 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:19.902+0000 7fef1ee11ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:23:19.955 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:19.955+0000 7fef1ee11ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:23:19.966 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:19.966+0000 7f902ea0fec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:23:20.020 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:20.019+0000 7f902ea0fec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:23:20.023 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-08-17T02:23:20.022+0000 7f2fad25a2c0 -1 Falling back to public interface 2024-08-17T02:23:20.053 INFO:tasks.ceph.osd.5.smithi087.stderr:2024-08-17T02:23:20.053+0000 7f40c3d252c0 -1 Falling back to public interface 2024-08-17T02:23:20.061 INFO:tasks.ceph.osd.6.smithi087.stderr:2024-08-17T02:23:20.061+0000 7f0954c0f2c0 -1 Falling back to public interface 2024-08-17T02:23:20.069 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-08-17T02:23:20.069+0000 7f60494152c0 -1 Falling back to public interface 2024-08-17T02:23:20.074 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-08-17T02:23:20.074+0000 7f10e70182c0 -1 Falling back to public interface 2024-08-17T02:23:20.075 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-08-17T02:23:20.075+0000 7f79985882c0 -1 Falling back to public interface 2024-08-17T02:23:20.077 INFO:tasks.ceph.osd.7.smithi087.stderr:2024-08-17T02:23:20.077+0000 7f840da162c0 -1 Falling back to public interface 2024-08-17T02:23:20.092 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-08-17T02:23:20.092+0000 7fcdd7c202c0 -1 Falling back to public interface 2024-08-17T02:23:20.142 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:20.142+0000 7fef1ee11ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:23:20.198 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:20.198+0000 7fef1ee11ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:23:20.275 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:20.275+0000 7fef1ee11ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:23:20.326 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:20.326+0000 7fef1ee11ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:23:20.488 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:20.587 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:20.587+0000 7f902ea0fec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:23:20.621 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.620+0000 7f6399600640 1 Processor -- start 2024-08-17T02:23:20.621 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.620+0000 7f6399600640 1 -- start start 2024-08-17T02:23:20.622 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.621+0000 7f6399600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63941568f0 0x7f63940ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.623 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.621+0000 7f6399600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6394156cc0 0x7f63940b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.623 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.621+0000 7f6399600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63940674c0 0x7f63940b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.623 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.621+0000 7f6399600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63940cae90 con 0x7f63941568f0 2024-08-17T02:23:20.623 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.621+0000 7f6399600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63940ae3d0 con 0x7f6394156cc0 2024-08-17T02:23:20.623 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.621+0000 7f6399600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63940ab400 con 0x7f63940674c0 2024-08-17T02:23:20.623 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.622+0000 7f6392a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63941568f0 0x7f63940ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.623 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.622+0000 7f6392a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63941568f0 0x7f63940ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46894/0 (socket says 172.21.15.5:46894) 2024-08-17T02:23:20.623 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.622+0000 7f6392a00640 1 -- 172.21.15.5:0/193981753 learned_addr learned my addr 172.21.15.5:0/193981753 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:20.623 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.622+0000 7f638be00640 1 --2- 172.21.15.5:0/193981753 >> v2:172.21.15.87:3300/0 conn(0x7f6394156cc0 0x7f63940b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.623 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.622+0000 7f6393400640 1 --2- 172.21.15.5:0/193981753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63940674c0 0x7f63940b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.623 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.622+0000 7f6392a00640 1 -- 172.21.15.5:0/193981753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63940674c0 msgr2=0x7f63940b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:20.624 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.622+0000 7f6392a00640 1 --2- 172.21.15.5:0/193981753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63940674c0 0x7f63940b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.624 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.622+0000 7f6392a00640 1 -- 172.21.15.5:0/193981753 >> v2:172.21.15.87:3300/0 conn(0x7f6394156cc0 msgr2=0x7f63940b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:20.624 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.622+0000 7f6392a00640 1 --2- 172.21.15.5:0/193981753 >> v2:172.21.15.87:3300/0 conn(0x7f6394156cc0 0x7f63940b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.624 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.622+0000 7f6392a00640 1 -- 172.21.15.5:0/193981753 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63940abca0 con 0x7f63941568f0 2024-08-17T02:23:20.625 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.623+0000 7f6392a00640 1 --2- 172.21.15.5:0/193981753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63941568f0 0x7f63940ca950 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6394063600 tx=0x7f63840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7cb02fca364c68 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:20.625 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.624+0000 7f6392000640 1 -- 172.21.15.5:0/193981753 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638402ad40 con 0x7f63941568f0 2024-08-17T02:23:20.625 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.624+0000 7f6392000640 1 -- 172.21.15.5:0/193981753 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6384032440 con 0x7f63941568f0 2024-08-17T02:23:20.626 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.624+0000 7f6392000640 1 -- 172.21.15.5:0/193981753 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638402aea0 con 0x7f63941568f0 2024-08-17T02:23:20.626 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.624+0000 7f6399600640 1 -- 172.21.15.5:0/193981753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63941568f0 msgr2=0x7f63940ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.626 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.624+0000 7f6399600640 1 --2- 172.21.15.5:0/193981753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63941568f0 0x7f63940ca950 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6394063600 tx=0x7f63840091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.626 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.624+0000 7f6399600640 1 -- 172.21.15.5:0/193981753 shutdown_connections 2024-08-17T02:23:20.626 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.624+0000 7f6399600640 1 --2- 172.21.15.5:0/193981753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63940674c0 0x7f63940b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.626 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.624+0000 7f6399600640 1 --2- 172.21.15.5:0/193981753 >> v2:172.21.15.87:3300/0 conn(0x7f6394156cc0 0x7f63940b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.626 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.624+0000 7f6399600640 1 --2- 172.21.15.5:0/193981753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63941568f0 0x7f63940ca950 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.626 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.624+0000 7f6399600640 1 -- 172.21.15.5:0/193981753 >> 172.21.15.5:0/193981753 conn(0x7f63940cc390 msgr2=0x7f6394066db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:20.626 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.624+0000 7f6399600640 1 -- 172.21.15.5:0/193981753 shutdown_connections 2024-08-17T02:23:20.626 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.624+0000 7f6399600640 1 -- 172.21.15.5:0/193981753 wait complete. 2024-08-17T02:23:20.628 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.626+0000 7f6399600640 1 Processor -- start 2024-08-17T02:23:20.628 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.626+0000 7f6399600640 1 -- start start 2024-08-17T02:23:20.628 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.627+0000 7f6399600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63940674c0 0x7f6394167010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.628 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.627+0000 7f6399600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63941568f0 0x7f639414ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.628 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.627+0000 7f6399600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6394156cc0 0x7f6394169be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.628 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.627+0000 7f6399600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6394157130 con 0x7f6394156cc0 2024-08-17T02:23:20.628 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.627+0000 7f6399600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6394157680 con 0x7f63940674c0 2024-08-17T02:23:20.628 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.627+0000 7f6399600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6394167550 con 0x7f63941568f0 2024-08-17T02:23:20.629 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.627+0000 7f6392a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63940674c0 0x7f6394167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.629 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.627+0000 7f6392a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63940674c0 0x7f6394167010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:55182/0 (socket says 172.21.15.5:55182) 2024-08-17T02:23:20.629 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.627+0000 7f6392a00640 1 -- 172.21.15.5:0/2619751886 learned_addr learned my addr 172.21.15.5:0/2619751886 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:20.629 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.627+0000 7f638be00640 1 --2- 172.21.15.5:0/2619751886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63941568f0 0x7f639414ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.629 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.627+0000 7f6393400640 1 --2- 172.21.15.5:0/2619751886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6394156cc0 0x7f6394169be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.629 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.627+0000 7f6392a00640 1 -- 172.21.15.5:0/2619751886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63941568f0 msgr2=0x7f639414ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.629 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.627+0000 7f6392a00640 1 --2- 172.21.15.5:0/2619751886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63941568f0 0x7f639414ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.629 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.627+0000 7f6392a00640 1 -- 172.21.15.5:0/2619751886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6394156cc0 msgr2=0x7f6394169be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.629 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.627+0000 7f6392a00640 1 --2- 172.21.15.5:0/2619751886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6394156cc0 0x7f6394169be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.629 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.627+0000 7f6392a00640 1 -- 172.21.15.5:0/2619751886 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6384009450 con 0x7f63940674c0 2024-08-17T02:23:20.629 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.628+0000 7f6392a00640 1 --2- 172.21.15.5:0/2619751886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63940674c0 0x7f6394167010 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6384009210 tx=0x7f6384032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:20.630 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.628+0000 7f638a000640 1 -- 172.21.15.5:0/2619751886 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63840317b0 con 0x7f63940674c0 2024-08-17T02:23:20.631 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.628+0000 7f638a000640 1 -- 172.21.15.5:0/2619751886 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6384031930 con 0x7f63940674c0 2024-08-17T02:23:20.631 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.628+0000 7f6399600640 1 -- 172.21.15.5:0/2619751886 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639414b580 con 0x7f63940674c0 2024-08-17T02:23:20.631 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.628+0000 7f638a000640 1 -- 172.21.15.5:0/2619751886 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6384031d30 con 0x7f63940674c0 2024-08-17T02:23:20.631 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.628+0000 7f6399600640 1 -- 172.21.15.5:0/2619751886 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6394157310 con 0x7f63940674c0 2024-08-17T02:23:20.631 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.628+0000 7f638a000640 1 -- 172.21.15.5:0/2619751886 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f638403e660 con 0x7f63940674c0 2024-08-17T02:23:20.631 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.628+0000 7f638a000640 1 -- 172.21.15.5:0/2619751886 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f638403cae0 con 0x7f63940674c0 2024-08-17T02:23:20.631 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.630+0000 7f6399600640 1 -- 172.21.15.5:0/2619751886 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6394064540 con 0x7f63940674c0 2024-08-17T02:23:20.632 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.632+0000 7f638a000640 1 -- 172.21.15.5:0/2619751886 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f6384043070 con 0x7f63940674c0 2024-08-17T02:23:20.697 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.696+0000 7f6399600640 1 -- 172.21.15.5:0/2619751886 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6394150d20 con 0x7f63940674c0 2024-08-17T02:23:20.698 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.697+0000 7f638a000640 1 -- 172.21.15.5:0/2619751886 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f6384037070 con 0x7f63940674c0 2024-08-17T02:23:20.698 INFO:teuthology.misc.health.smithi005.stdout: 2024-08-17T02:23:20.698 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:19.320342+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:20.700 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.698+0000 7f6399600640 1 -- 172.21.15.5:0/2619751886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63940674c0 msgr2=0x7f6394167010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.700 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.698+0000 7f6399600640 1 --2- 172.21.15.5:0/2619751886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63940674c0 0x7f6394167010 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6384009210 tx=0x7f6384032000 comp rx=0 tx=0).stop 2024-08-17T02:23:20.700 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.698+0000 7f6399600640 1 -- 172.21.15.5:0/2619751886 shutdown_connections 2024-08-17T02:23:20.700 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.698+0000 7f6399600640 1 --2- 172.21.15.5:0/2619751886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63941568f0 0x7f639414ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.700 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.698+0000 7f6399600640 1 --2- 172.21.15.5:0/2619751886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6394156cc0 0x7f6394169be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.701 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.698+0000 7f6399600640 1 --2- 172.21.15.5:0/2619751886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63940674c0 0x7f6394167010 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.701 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.698+0000 7f6399600640 1 -- 172.21.15.5:0/2619751886 >> 172.21.15.5:0/2619751886 conn(0x7f63940cc390 msgr2=0x7f639415a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:20.701 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.698+0000 7f6399600640 1 -- 172.21.15.5:0/2619751886 shutdown_connections 2024-08-17T02:23:20.701 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:20.698+0000 7f6399600640 1 -- 172.21.15.5:0/2619751886 wait complete. 2024-08-17T02:23:20.706 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:20.706+0000 7f902ea0fec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:23:20.710 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:23:20.858 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:20.858+0000 7fef1ee11ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:23:20.970 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-08-17T02:23:20.969+0000 7fef1ee11ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:23:21.728 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:21.727+0000 7f9013200640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:23:21.728 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:23:21.728+0000 7f9013200640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:23:23.523 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-08-17T02:23:23.522+0000 7f2fad25a2c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:23:23.597 INFO:tasks.ceph.osd.5.smithi087.stderr:2024-08-17T02:23:23.597+0000 7f40c3d252c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:23:23.600 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-08-17T02:23:23.599+0000 7f60494152c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:23:23.651 INFO:tasks.ceph.osd.6.smithi087.stderr:2024-08-17T02:23:23.651+0000 7f0954c0f2c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:23:23.656 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-08-17T02:23:23.655+0000 7f79985882c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:23:23.668 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-08-17T02:23:23.666+0000 7f10e70182c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:23:23.677 INFO:tasks.ceph.osd.7.smithi087.stderr:2024-08-17T02:23:23.677+0000 7f840da162c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:23:23.724 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-08-17T02:23:23.724+0000 7fcdd7c202c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:23:26.515 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-08-17T02:23:26.514+0000 7f2fa7000640 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:23:26.526 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-08-17T02:23:26.524+0000 7f2f9e400640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:23:26.536 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-08-17T02:23:26.535+0000 7f6042800640 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:23:26.545 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-08-17T02:23:26.543+0000 7f6039c00640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:23:26.548 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-08-17T02:23:26.547+0000 7f10e0400640 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:23:26.555 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-08-17T02:23:26.554+0000 7f10d7800640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:23:26.559 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-08-17T02:23:26.558+0000 7f7991c00640 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:23:26.564 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-08-17T02:23:26.563+0000 7f7989000640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:23:26.631 INFO:tasks.ceph.osd.5.smithi087.stderr:2024-08-17T02:23:26.630+0000 7f40bd400640 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:23:26.641 INFO:tasks.ceph.osd.5.smithi087.stderr:2024-08-17T02:23:26.640+0000 7f40b4800640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:23:26.696 INFO:tasks.ceph.osd.6.smithi087.stderr:2024-08-17T02:23:26.696+0000 7f094e000640 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:23:26.703 INFO:tasks.ceph.osd.6.smithi087.stderr:2024-08-17T02:23:26.703+0000 7f0945400640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:23:26.717 INFO:tasks.ceph.osd.7.smithi087.stderr:2024-08-17T02:23:26.717+0000 7f8408c00640 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:23:26.723 INFO:tasks.ceph.osd.7.smithi087.stderr:2024-08-17T02:23:26.724+0000 7f83fe200640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:23:27.132 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-08-17T02:23:27.132+0000 7fcdd1000640 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:23:27.137 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-08-17T02:23:27.137+0000 7fcdc8400640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:23:27.517 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:27.668 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.667+0000 7f7a80a00640 1 Processor -- start 2024-08-17T02:23:27.668 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.667+0000 7f7a80a00640 1 -- start start 2024-08-17T02:23:27.669 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.668+0000 7f7a80a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a7c158fe0 0x7f7a7c0cd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:27.669 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.668+0000 7f7a80a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7c0ce430 con 0x7f7a7c0cac90 2024-08-17T02:23:27.669 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.668+0000 7f7a80a00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7c0cdb00 con 0x7f7a7c158c10 2024-08-17T02:23:27.669 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.668+0000 7f7a80a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7c0cdde0 con 0x7f7a7c158fe0 2024-08-17T02:23:27.670 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.668+0000 7f7a73e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a7c158fe0 0x7f7a7c0cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:27.671 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.668+0000 7f7a7be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7a7c0cac90 0x7f7a7c0cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41220/0 (socket says 172.21.15.5:41220) 2024-08-17T02:23:27.671 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.668+0000 7f7a7be00640 1 -- 172.21.15.5:0/2899780426 learned_addr learned my addr 172.21.15.5:0/2899780426 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:27.671 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.669+0000 7f7a73e00640 1 -- 172.21.15.5:0/2899780426 >> v1:172.21.15.87:6789/0 conn(0x7f7a7c158c10 legacy=0x7f7a7c0ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:27.671 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.669+0000 7f7a73e00640 1 -- 172.21.15.5:0/2899780426 >> v1:172.21.15.5:6789/0 conn(0x7f7a7c0cac90 legacy=0x7f7a7c0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:27.671 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.669+0000 7f7a7aa00640 1 -- 172.21.15.5:0/2899780426 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650874024 0 0) 0x7f7a7c0cdb00 con 0x7f7a7c158c10 2024-08-17T02:23:27.671 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.669+0000 7f7a73e00640 1 -- 172.21.15.5:0/2899780426 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c0ce0c0 con 0x7f7a7c158fe0 2024-08-17T02:23:27.671 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.670+0000 7f7a73e00640 1 --2- 172.21.15.5:0/2899780426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a7c158fe0 0x7f7a7c0cd210 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009850 tx=0x7f7a640090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecc3c3449d99c1a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:27.672 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.670+0000 7f7a7aa00640 1 -- 172.21.15.5:0/2899780426 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6402ac60 con 0x7f7a7c158fe0 2024-08-17T02:23:27.672 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.670+0000 7f7a7aa00640 1 -- 172.21.15.5:0/2899780426 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6402adc0 con 0x7f7a7c158fe0 2024-08-17T02:23:27.672 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.670+0000 7f7a7aa00640 1 -- 172.21.15.5:0/2899780426 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64032670 con 0x7f7a7c158fe0 2024-08-17T02:23:27.673 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.671+0000 7f7a80a00640 1 -- 172.21.15.5:0/2899780426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a7c158fe0 msgr2=0x7f7a7c0cd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:27.673 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.671+0000 7f7a80a00640 1 --2- 172.21.15.5:0/2899780426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a7c158fe0 0x7f7a7c0cd210 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009850 tx=0x7f7a640090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:27.673 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.671+0000 7f7a80a00640 1 -- 172.21.15.5:0/2899780426 shutdown_connections 2024-08-17T02:23:27.673 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.671+0000 7f7a80a00640 1 --2- 172.21.15.5:0/2899780426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a7c158fe0 0x7f7a7c0cd210 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:27.673 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.671+0000 7f7a80a00640 1 -- 172.21.15.5:0/2899780426 >> 172.21.15.5:0/2899780426 conn(0x7f7a7c06e4e0 msgr2=0x7f7a7c06e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:27.673 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.671+0000 7f7a80a00640 1 -- 172.21.15.5:0/2899780426 shutdown_connections 2024-08-17T02:23:27.673 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.671+0000 7f7a80a00640 1 -- 172.21.15.5:0/2899780426 wait complete. 2024-08-17T02:23:27.673 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.672+0000 7f7a80a00640 1 Processor -- start 2024-08-17T02:23:27.674 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.672+0000 7f7a80a00640 1 -- start start 2024-08-17T02:23:27.675 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.673+0000 7f7a80a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a7c0cac90 0x7f7a7c14d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:27.676 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.673+0000 7f7a80a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a7c158c10 0x7f7a7c0b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:27.676 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.673+0000 7f7a80a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7c158fe0 0x7f7a7c0c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:27.676 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.673+0000 7f7a80a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0c7d90 con 0x7f7a7c158c10 2024-08-17T02:23:27.676 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.673+0000 7f7a80a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c1598c0 con 0x7f7a7c158fe0 2024-08-17T02:23:27.676 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.673+0000 7f7a80a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c14ded0 con 0x7f7a7c0cac90 2024-08-17T02:23:27.676 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.674+0000 7f7a73e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a7c158c10 0x7f7a7c0b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:27.676 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.674+0000 7f7a73e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a7c158c10 0x7f7a7c0b2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47022/0 (socket says 172.21.15.5:47022) 2024-08-17T02:23:27.676 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.674+0000 7f7a73e00640 1 -- 172.21.15.5:0/3899325098 learned_addr learned my addr 172.21.15.5:0/3899325098 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:27.676 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.674+0000 7f7a7b400640 1 --2- 172.21.15.5:0/3899325098 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a7c0cac90 0x7f7a7c14d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:27.676 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.674+0000 7f7a7be00640 1 --2- 172.21.15.5:0/3899325098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7c158fe0 0x7f7a7c0c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:27.676 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.674+0000 7f7a73e00640 1 -- 172.21.15.5:0/3899325098 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a7c0cac90 msgr2=0x7f7a7c14d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:27.676 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.674+0000 7f7a73e00640 1 --2- 172.21.15.5:0/3899325098 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a7c0cac90 0x7f7a7c14d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:27.677 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.674+0000 7f7a73e00640 1 -- 172.21.15.5:0/3899325098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7c158fe0 msgr2=0x7f7a7c0c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:27.677 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.674+0000 7f7a73e00640 1 --2- 172.21.15.5:0/3899325098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7c158fe0 0x7f7a7c0c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:27.677 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.674+0000 7f7a73e00640 1 -- 172.21.15.5:0/3899325098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a64009390 con 0x7f7a7c158c10 2024-08-17T02:23:27.677 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.674+0000 7f7a73e00640 1 --2- 172.21.15.5:0/3899325098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a7c158c10 0x7f7a7c0b2b50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009850 tx=0x7f7a64032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:27.678 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.675+0000 7f7a72a00640 1 -- 172.21.15.5:0/3899325098 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64031730 con 0x7f7a7c158c10 2024-08-17T02:23:27.678 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.675+0000 7f7a72a00640 1 -- 172.21.15.5:0/3899325098 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a640318d0 con 0x7f7a7c158c10 2024-08-17T02:23:27.678 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.675+0000 7f7a72a00640 1 -- 172.21.15.5:0/3899325098 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64031c90 con 0x7f7a7c158c10 2024-08-17T02:23:27.678 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.675+0000 7f7a80a00640 1 -- 172.21.15.5:0/3899325098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7c0c77d0 con 0x7f7a7c158c10 2024-08-17T02:23:27.678 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.675+0000 7f7a80a00640 1 -- 172.21.15.5:0/3899325098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c159550 con 0x7f7a7c158c10 2024-08-17T02:23:27.678 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.676+0000 7f7a80a00640 1 -- 172.21.15.5:0/3899325098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7c159a30 con 0x7f7a7c158c10 2024-08-17T02:23:27.678 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.677+0000 7f7a72a00640 1 -- 172.21.15.5:0/3899325098 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f7a64039050 con 0x7f7a7c158c10 2024-08-17T02:23:27.679 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.677+0000 7f7a72a00640 1 --2- 172.21.15.5:0/3899325098 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7a580650c0 0x7f7a58067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:27.679 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.677+0000 7f7a72a00640 1 -- 172.21.15.5:0/3899325098 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f7a640a24e0 con 0x7f7a7c158c10 2024-08-17T02:23:27.679 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.678+0000 7f7a7b400640 1 --2- 172.21.15.5:0/3899325098 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7a580650c0 0x7f7a58067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:27.680 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.678+0000 7f7a7b400640 1 --2- 172.21.15.5:0/3899325098 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7a580650c0 0x7f7a58067570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0011e0 tx=0x7f7a6c007ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:27.684 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.682+0000 7f7a72a00640 1 -- 172.21.15.5:0/3899325098 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7a64070b60 con 0x7f7a7c158c10 2024-08-17T02:23:27.872 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.871+0000 7f7a80a00640 1 -- 172.21.15.5:0/3899325098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a7c064540 con 0x7f7a7c158c10 2024-08-17T02:23:27.873 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.872+0000 7f7a72a00640 1 -- 172.21.15.5:0/3899325098 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10300 (secure 0 0 0) 0x7f7a64089850 con 0x7f7a7c158c10 2024-08-17T02:23:27.873 INFO:teuthology.misc.health.smithi005.stdout: 2024-08-17T02:23:27.874 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":14,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:27.519369+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:27.876 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.874+0000 7f7a80a00640 1 -- 172.21.15.5:0/3899325098 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7a580650c0 msgr2=0x7f7a58067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:27.876 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.874+0000 7f7a80a00640 1 --2- 172.21.15.5:0/3899325098 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7a580650c0 0x7f7a58067570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0011e0 tx=0x7f7a6c007ca0 comp rx=0 tx=0).stop 2024-08-17T02:23:27.876 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.874+0000 7f7a80a00640 1 -- 172.21.15.5:0/3899325098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a7c158c10 msgr2=0x7f7a7c0b2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:27.876 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.874+0000 7f7a80a00640 1 --2- 172.21.15.5:0/3899325098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a7c158c10 0x7f7a7c0b2b50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009850 tx=0x7f7a64032000 comp rx=0 tx=0).stop 2024-08-17T02:23:27.876 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.874+0000 7f7a80a00640 1 -- 172.21.15.5:0/3899325098 shutdown_connections 2024-08-17T02:23:27.876 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.874+0000 7f7a80a00640 1 --2- 172.21.15.5:0/3899325098 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7a580650c0 0x7f7a58067570 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:27.877 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.874+0000 7f7a80a00640 1 --2- 172.21.15.5:0/3899325098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7c158fe0 0x7f7a7c0c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:27.877 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.874+0000 7f7a80a00640 1 --2- 172.21.15.5:0/3899325098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a7c158c10 0x7f7a7c0b2b50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:27.877 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.874+0000 7f7a80a00640 1 --2- 172.21.15.5:0/3899325098 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a7c0cac90 0x7f7a7c14d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:27.877 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.874+0000 7f7a80a00640 1 -- 172.21.15.5:0/3899325098 >> 172.21.15.5:0/3899325098 conn(0x7f7a7c06e4e0 msgr2=0x7f7a7c0b0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:27.877 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.874+0000 7f7a80a00640 1 -- 172.21.15.5:0/3899325098 shutdown_connections 2024-08-17T02:23:27.878 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:23:27.874+0000 7f7a80a00640 1 -- 172.21.15.5:0/3899325098 wait complete. 2024-08-17T02:23:27.889 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:23:27.889 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:23:27.889 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:23:27.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:23:27.894 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:23:27.894 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:23:27.894 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:23:27.898 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:23:27.898 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:23:27.898 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:23:27.902 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:23:27.902 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:23:27.902 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:23:27.905 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:23:27.906 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:23:27.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:28.021 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-17T02:23:28.022 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-17T02:23:28.024 INFO:tasks.ceph.mds.d.smithi087.stdout:starting mds.d at 2024-08-17T02:23:28.025 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-08-17T02:23:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.068+0000 7f0cc7e00640 1 Processor -- start 2024-08-17T02:23:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.068+0000 7f0cc7e00640 1 -- start start 2024-08-17T02:23:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.069+0000 7f0cc7e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cc01589e0 0x7f0cc0158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.069+0000 7f0cc7e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc00af9a0 con 0x7f0cc00cda30 2024-08-17T02:23:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.070+0000 7f0cc7e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc00ce740 con 0x7f0cc00ca9c0 2024-08-17T02:23:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.070+0000 7f0cc7e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00af810 con 0x7f0cc01589e0 2024-08-17T02:23:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.070+0000 7f0cc5e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0cc00cda30 0x7f0cc00cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41242/0 (socket says 172.21.15.5:41242) 2024-08-17T02:23:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.070+0000 7f0cc5e00640 1 -- 172.21.15.5:0/3010980201 learned_addr learned my addr 172.21.15.5:0/3010980201 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.070+0000 7f0cc5400640 1 --2- 172.21.15.5:0/3010980201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cc01589e0 0x7f0cc0158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.070+0000 7f0cc5400640 1 -- 172.21.15.5:0/3010980201 >> v1:172.21.15.87:6789/0 conn(0x7f0cc00ca9c0 legacy=0x7f0cc00cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.070+0000 7f0cc5400640 1 -- 172.21.15.5:0/3010980201 >> v1:172.21.15.5:6789/0 conn(0x7f0cc00cda30 legacy=0x7f0cc00cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.070+0000 7f0cbfe00640 1 -- 172.21.15.5:0/3010980201 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676430654 0 0) 0x7f0cc00ce740 con 0x7f0cc00ca9c0 2024-08-17T02:23:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.070+0000 7f0cc5400640 1 -- 172.21.15.5:0/3010980201 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc00cea00 con 0x7f0cc01589e0 2024-08-17T02:23:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.071+0000 7f0cc5400640 1 --2- 172.21.15.5:0/3010980201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cc01589e0 0x7f0cc0158db0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4009880 tx=0x7f0cb40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=773980cce38a268 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.071+0000 7f0cbfe00640 1 -- 172.21.15.5:0/3010980201 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb402ac40 con 0x7f0cc01589e0 2024-08-17T02:23:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.072+0000 7f0cbfe00640 1 -- 172.21.15.5:0/3010980201 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb402ada0 con 0x7f0cc01589e0 2024-08-17T02:23:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.072+0000 7f0cbfe00640 1 -- 172.21.15.5:0/3010980201 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4032670 con 0x7f0cc01589e0 2024-08-17T02:23:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.072+0000 7f0cc7e00640 1 -- 172.21.15.5:0/3010980201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cc01589e0 msgr2=0x7f0cc0158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.072+0000 7f0cc7e00640 1 --2- 172.21.15.5:0/3010980201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cc01589e0 0x7f0cc0158db0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4009880 tx=0x7f0cb40090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.072+0000 7f0cc7e00640 1 -- 172.21.15.5:0/3010980201 shutdown_connections 2024-08-17T02:23:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.072+0000 7f0cc7e00640 1 --2- 172.21.15.5:0/3010980201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cc01589e0 0x7f0cc0158db0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.072+0000 7f0cc7e00640 1 -- 172.21.15.5:0/3010980201 >> 172.21.15.5:0/3010980201 conn(0x7f0cc006e590 msgr2=0x7f0cc006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.072+0000 7f0cc7e00640 1 -- 172.21.15.5:0/3010980201 shutdown_connections 2024-08-17T02:23:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.072+0000 7f0cc7e00640 1 -- 172.21.15.5:0/3010980201 wait complete. 2024-08-17T02:23:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.074+0000 7f0cc7e00640 1 Processor -- start 2024-08-17T02:23:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.074+0000 7f0cc7e00640 1 -- start start 2024-08-17T02:23:28.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.075+0000 7f0cc7e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cc00ca9c0 0x7f0cc0158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.075+0000 7f0cc7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc00cda30 0x7f0cc015ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.075+0000 7f0cc7e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cc01589e0 0x7f0cc015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.075+0000 7f0cc7e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc015a050 con 0x7f0cc00cda30 2024-08-17T02:23:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.075+0000 7f0cc7e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc0159440 con 0x7f0cc00ca9c0 2024-08-17T02:23:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.075+0000 7f0cc7e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc0159720 con 0x7f0cc01589e0 2024-08-17T02:23:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.075+0000 7f0cc5400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cc00ca9c0 0x7f0cc0158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.075+0000 7f0cc5400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cc00ca9c0 0x7f0cc0158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:55304/0 (socket says 172.21.15.5:55304) 2024-08-17T02:23:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.075+0000 7f0cc5400640 1 -- 172.21.15.5:0/2709771373 learned_addr learned my addr 172.21.15.5:0/2709771373 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.075+0000 7f0cc5e00640 1 --2- 172.21.15.5:0/2709771373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cc01589e0 0x7f0cc015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.075+0000 7f0cc4a00640 1 --2- 172.21.15.5:0/2709771373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc00cda30 0x7f0cc015ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.075+0000 7f0cc5400640 1 -- 172.21.15.5:0/2709771373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cc01589e0 msgr2=0x7f0cc015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.075+0000 7f0cc5400640 1 --2- 172.21.15.5:0/2709771373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cc01589e0 0x7f0cc015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.075+0000 7f0cc5400640 1 -- 172.21.15.5:0/2709771373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc00cda30 msgr2=0x7f0cc015ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.075+0000 7f0cc5400640 1 --2- 172.21.15.5:0/2709771373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc00cda30 0x7f0cc015ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.075+0000 7f0cc5400640 1 -- 172.21.15.5:0/2709771373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb4009390 con 0x7f0cc00ca9c0 2024-08-17T02:23:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.076+0000 7f0cc5400640 1 --2- 172.21.15.5:0/2709771373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cc00ca9c0 0x7f0cc0158db0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40097d0 tx=0x7f0cb4032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.076+0000 7f0cbcc00640 1 -- 172.21.15.5:0/2709771373 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4031880 con 0x7f0cc00ca9c0 2024-08-17T02:23:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.076+0000 7f0cbcc00640 1 -- 172.21.15.5:0/2709771373 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb4031a20 con 0x7f0cc00ca9c0 2024-08-17T02:23:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.076+0000 7f0cbcc00640 1 -- 172.21.15.5:0/2709771373 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4031de0 con 0x7f0cc00ca9c0 2024-08-17T02:23:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.076+0000 7f0cc7e00640 1 -- 172.21.15.5:0/2709771373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc0159a00 con 0x7f0cc00ca9c0 2024-08-17T02:23:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.076+0000 7f0cc7e00640 1 -- 172.21.15.5:0/2709771373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc0169b30 con 0x7f0cc00ca9c0 2024-08-17T02:23:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.077+0000 7f0cc7e00640 1 -- 172.21.15.5:0/2709771373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc0063fb0 con 0x7f0cc00ca9c0 2024-08-17T02:23:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.078+0000 7f0cbcc00640 1 -- 172.21.15.5:0/2709771373 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f0cb4039050 con 0x7f0cc00ca9c0 2024-08-17T02:23:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.079+0000 7f0cbcc00640 1 --2- 172.21.15.5:0/2709771373 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0ca00650c0 0x7f0ca0067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.079+0000 7f0cbcc00640 1 -- 172.21.15.5:0/2709771373 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f0cb40a2980 con 0x7f0cc00ca9c0 2024-08-17T02:23:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.080+0000 7f0cc4a00640 1 --2- 172.21.15.5:0/2709771373 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0ca00650c0 0x7f0ca0067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.080+0000 7f0cc4a00640 1 --2- 172.21.15.5:0/2709771373 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0ca00650c0 0x7f0ca0067570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0154930 tx=0x7f0cac007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.083+0000 7f0cbcc00640 1 -- 172.21.15.5:0/2709771373 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0cb4071080 con 0x7f0cc00ca9c0 2024-08-17T02:23:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.266+0000 7f0cc7e00640 1 -- 172.21.15.5:0/2709771373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cc00d0b10 con 0x7f0cc00ca9c0 2024-08-17T02:23:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.267+0000 7f0cbcc00640 1 -- 172.21.15.5:0/2709771373 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10300 (secure 0 0 0) 0x7f0cb40746a0 con 0x7f0cc00ca9c0 2024-08-17T02:23:28.269 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:28.269 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":14,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:27.519369+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:28.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.269+0000 7f0cc7e00640 1 -- 172.21.15.5:0/2709771373 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0ca00650c0 msgr2=0x7f0ca0067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.269+0000 7f0cc7e00640 1 --2- 172.21.15.5:0/2709771373 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0ca00650c0 0x7f0ca0067570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0154930 tx=0x7f0cac007d30 comp rx=0 tx=0).stop 2024-08-17T02:23:28.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.269+0000 7f0cc7e00640 1 -- 172.21.15.5:0/2709771373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cc00ca9c0 msgr2=0x7f0cc0158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.269+0000 7f0cc7e00640 1 --2- 172.21.15.5:0/2709771373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cc00ca9c0 0x7f0cc0158db0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40097d0 tx=0x7f0cb4032000 comp rx=0 tx=0).stop 2024-08-17T02:23:28.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.269+0000 7f0cc7e00640 1 -- 172.21.15.5:0/2709771373 shutdown_connections 2024-08-17T02:23:28.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.269+0000 7f0cc7e00640 1 --2- 172.21.15.5:0/2709771373 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0ca00650c0 0x7f0ca0067570 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.269+0000 7f0cc7e00640 1 --2- 172.21.15.5:0/2709771373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cc01589e0 0x7f0cc015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.269+0000 7f0cc7e00640 1 --2- 172.21.15.5:0/2709771373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc00cda30 0x7f0cc015ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.269+0000 7f0cc7e00640 1 --2- 172.21.15.5:0/2709771373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cc00ca9c0 0x7f0cc0158db0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.269+0000 7f0cc7e00640 1 -- 172.21.15.5:0/2709771373 >> 172.21.15.5:0/2709771373 conn(0x7f0cc006e590 msgr2=0x7f0cc00c4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:28.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.269+0000 7f0cc7e00640 1 -- 172.21.15.5:0/2709771373 shutdown_connections 2024-08-17T02:23:28.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.269+0000 7f0cc7e00640 1 -- 172.21.15.5:0/2709771373 wait complete. 2024-08-17T02:23:28.285 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-08-17T02:23:28.286 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:23:28.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.436+0000 7fee56000640 1 Processor -- start 2024-08-17T02:23:28.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.436+0000 7fee56000640 1 -- start start 2024-08-17T02:23:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.437+0000 7fee56000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fee500ca050 0x7fee50156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.437+0000 7fee56000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee500add30 0x7fee5015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.438+0000 7fee56000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5015b5e0 con 0x7fee500ad960 2024-08-17T02:23:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.438+0000 7fee56000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee500cb160 con 0x7fee500ca050 2024-08-17T02:23:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.438+0000 7fee56000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee500b0d10 con 0x7fee500add30 2024-08-17T02:23:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.438+0000 7fee4f400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fee500ad960 0x7fee50156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41254/0 (socket says 172.21.15.5:41254) 2024-08-17T02:23:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.438+0000 7fee4f400640 1 -- 172.21.15.5:0/44944902 learned_addr learned my addr 172.21.15.5:0/44944902 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.438+0000 7fee46a00640 1 --2- 172.21.15.5:0/44944902 >> v2:172.21.15.5:3300/0 conn(0x7fee500ca050 0x7fee50156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.438+0000 7fee4fe00640 1 --2- 172.21.15.5:0/44944902 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee500add30 0x7fee5015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.438+0000 7fee4ea00640 1 -- 172.21.15.5:0/44944902 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601609119 0 0) 0x7fee40001110 con 0x7fee500ad960 2024-08-17T02:23:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.438+0000 7fee4ea00640 1 -- 172.21.15.5:0/44944902 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee340034e0 con 0x7fee500ad960 2024-08-17T02:23:28.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.438+0000 7fee46a00640 1 -- 172.21.15.5:0/44944902 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee500add30 msgr2=0x7fee5015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:28.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.438+0000 7fee46a00640 1 --2- 172.21.15.5:0/44944902 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee500add30 0x7fee5015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.438+0000 7fee46a00640 1 -- 172.21.15.5:0/44944902 >> v1:172.21.15.5:6789/0 conn(0x7fee500ad960 legacy=0x7fee50156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.438+0000 7fee46a00640 1 -- 172.21.15.5:0/44944902 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee500ca550 con 0x7fee500ca050 2024-08-17T02:23:28.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.439+0000 7fee46a00640 1 --2- 172.21.15.5:0/44944902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee500ca050 0x7fee50156b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee38009850 tx=0x7fee380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572ccfbba1425eb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:28.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.440+0000 7fee4ea00640 1 -- 172.21.15.5:0/44944902 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3802ae10 con 0x7fee500ca050 2024-08-17T02:23:28.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.440+0000 7fee4ea00640 1 -- 172.21.15.5:0/44944902 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee38032440 con 0x7fee500ca050 2024-08-17T02:23:28.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.440+0000 7fee4ea00640 1 -- 172.21.15.5:0/44944902 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee38032820 con 0x7fee500ca050 2024-08-17T02:23:28.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.440+0000 7fee56000640 1 -- 172.21.15.5:0/44944902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee500ca050 msgr2=0x7fee50156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.440+0000 7fee56000640 1 --2- 172.21.15.5:0/44944902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee500ca050 0x7fee50156b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee38009850 tx=0x7fee380090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.440+0000 7fee56000640 1 -- 172.21.15.5:0/44944902 shutdown_connections 2024-08-17T02:23:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.440+0000 7fee56000640 1 --2- 172.21.15.5:0/44944902 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee500add30 0x7fee5015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.440+0000 7fee56000640 1 --2- 172.21.15.5:0/44944902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee500ca050 0x7fee50156b30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.440+0000 7fee56000640 1 -- 172.21.15.5:0/44944902 >> 172.21.15.5:0/44944902 conn(0x7fee50066e60 msgr2=0x7fee50067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.440+0000 7fee56000640 1 -- 172.21.15.5:0/44944902 shutdown_connections 2024-08-17T02:23:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.440+0000 7fee56000640 1 -- 172.21.15.5:0/44944902 wait complete. 2024-08-17T02:23:28.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.442+0000 7fee56000640 1 Processor -- start 2024-08-17T02:23:28.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.442+0000 7fee56000640 1 -- start start 2024-08-17T02:23:28.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.442+0000 7fee56000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee500ad960 0x7fee500a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.443+0000 7fee56000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee500add30 0x7fee50153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.443+0000 7fee56000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee500ca050 0x7fee5014fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.443+0000 7fee56000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee501682d0 con 0x7fee500add30 2024-08-17T02:23:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.443+0000 7fee56000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee501676c0 con 0x7fee500ca050 2024-08-17T02:23:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.443+0000 7fee56000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee501679a0 con 0x7fee500ad960 2024-08-17T02:23:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.443+0000 7fee46a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee500add30 0x7fee50153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.443+0000 7fee46a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee500add30 0x7fee50153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47084/0 (socket says 172.21.15.5:47084) 2024-08-17T02:23:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.443+0000 7fee46a00640 1 -- 172.21.15.5:0/861417697 learned_addr learned my addr 172.21.15.5:0/861417697 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.443+0000 7fee4f400640 1 --2- 172.21.15.5:0/861417697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee500ad960 0x7fee500a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.443+0000 7fee4fe00640 1 --2- 172.21.15.5:0/861417697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee500ca050 0x7fee5014fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.443+0000 7fee46a00640 1 -- 172.21.15.5:0/861417697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee500ad960 msgr2=0x7fee500a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.443+0000 7fee46a00640 1 --2- 172.21.15.5:0/861417697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee500ad960 0x7fee500a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.443+0000 7fee46a00640 1 -- 172.21.15.5:0/861417697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee500ca050 msgr2=0x7fee5014fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.443+0000 7fee46a00640 1 --2- 172.21.15.5:0/861417697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee500ca050 0x7fee5014fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.443+0000 7fee46a00640 1 -- 172.21.15.5:0/861417697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee38009390 con 0x7fee500add30 2024-08-17T02:23:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.444+0000 7fee46a00640 1 --2- 172.21.15.5:0/861417697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee500add30 0x7fee50153490 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fee38035040 tx=0x7fee38032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.444+0000 7fee47400640 1 -- 172.21.15.5:0/861417697 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee38031ca0 con 0x7fee500add30 2024-08-17T02:23:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.444+0000 7fee47400640 1 -- 172.21.15.5:0/861417697 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee38031e00 con 0x7fee500add30 2024-08-17T02:23:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.444+0000 7fee47400640 1 -- 172.21.15.5:0/861417697 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3803e6a0 con 0x7fee500add30 2024-08-17T02:23:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.444+0000 7fee56000640 1 -- 172.21.15.5:0/861417697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee50167c80 con 0x7fee500add30 2024-08-17T02:23:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.444+0000 7fee56000640 1 -- 172.21.15.5:0/861417697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee500a5b60 con 0x7fee500add30 2024-08-17T02:23:28.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.445+0000 7fee56000640 1 -- 172.21.15.5:0/861417697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee50167ae0 con 0x7fee500add30 2024-08-17T02:23:28.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.446+0000 7fee47400640 1 -- 172.21.15.5:0/861417697 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7fee3803c400 con 0x7fee500add30 2024-08-17T02:23:28.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.447+0000 7fee47400640 1 --2- 172.21.15.5:0/861417697 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fee2c0650f0 0x7fee2c0675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:28.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.447+0000 7fee47400640 1 -- 172.21.15.5:0/861417697 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7fee380a2270 con 0x7fee500add30 2024-08-17T02:23:28.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.447+0000 7fee4f400640 1 --2- 172.21.15.5:0/861417697 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fee2c0650f0 0x7fee2c0675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:28.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.448+0000 7fee4f400640 1 --2- 172.21.15.5:0/861417697 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fee2c0650f0 0x7fee2c0675a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee40001270 tx=0x7fee40007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.451+0000 7fee47400640 1 -- 172.21.15.5:0/861417697 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fee50167ae0 con 0x7fee500add30 2024-08-17T02:23:28.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.674+0000 7fee56000640 1 -- 172.21.15.5:0/861417697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee50167ae0 con 0x7fee500add30 2024-08-17T02:23:28.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.674+0000 7fee47400640 1 -- 172.21.15.5:0/861417697 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1250 (secure 0 0 0) 0x7fee38037500 con 0x7fee500add30 2024-08-17T02:23:28.676 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:28.676 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/508600504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":508600504},{"type":"v1","addr":"172.21.15.5:6835","nonce":508600504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:23:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 2 2024-08-17T02:23:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.676+0000 7fee56000640 1 -- 172.21.15.5:0/861417697 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fee2c0650f0 msgr2=0x7fee2c0675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.676+0000 7fee56000640 1 --2- 172.21.15.5:0/861417697 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fee2c0650f0 0x7fee2c0675a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee40001270 tx=0x7fee40007b60 comp rx=0 tx=0).stop 2024-08-17T02:23:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.676+0000 7fee56000640 1 -- 172.21.15.5:0/861417697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee500add30 msgr2=0x7fee50153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.676+0000 7fee56000640 1 --2- 172.21.15.5:0/861417697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee500add30 0x7fee50153490 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fee38035040 tx=0x7fee38032000 comp rx=0 tx=0).stop 2024-08-17T02:23:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.676+0000 7fee56000640 1 -- 172.21.15.5:0/861417697 shutdown_connections 2024-08-17T02:23:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.676+0000 7fee56000640 1 --2- 172.21.15.5:0/861417697 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fee2c0650f0 0x7fee2c0675a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.676+0000 7fee56000640 1 --2- 172.21.15.5:0/861417697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee500ca050 0x7fee5014fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.676+0000 7fee56000640 1 --2- 172.21.15.5:0/861417697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee500add30 0x7fee50153490 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.677+0000 7fee56000640 1 --2- 172.21.15.5:0/861417697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee500ad960 0x7fee500a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.677+0000 7fee56000640 1 -- 172.21.15.5:0/861417697 >> 172.21.15.5:0/861417697 conn(0x7fee50066e60 msgr2=0x7fee5015ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.677+0000 7fee56000640 1 -- 172.21.15.5:0/861417697 shutdown_connections 2024-08-17T02:23:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:28.677+0000 7fee56000640 1 -- 172.21.15.5:0/861417697 wait complete. 2024-08-17T02:23:30.694 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:23:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.857+0000 7f8285a00640 1 Processor -- start 2024-08-17T02:23:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.857+0000 7f8285a00640 1 -- start start 2024-08-17T02:23:30.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.859+0000 7f8285a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82801589a0 0x7f8280158d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:30.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.859+0000 7f8285a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82800ca240 0x7f82800cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:30.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.859+0000 7f8285a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82800ca630 con 0x7f82800cde30 2024-08-17T02:23:30.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.859+0000 7f8285a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82800cb140 con 0x7f82800ca240 2024-08-17T02:23:30.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.859+0000 7f8285a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82800b0ab0 con 0x7f82801589a0 2024-08-17T02:23:30.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.859+0000 7f827f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82800ca240 0x7f82800cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:30.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.859+0000 7f827f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82800ca240 0x7f82800cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58518/0 (socket says 172.21.15.5:58518) 2024-08-17T02:23:30.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.859+0000 7f827f400640 1 -- 172.21.15.5:0/2401052450 learned_addr learned my addr 172.21.15.5:0/2401052450 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:30.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.859+0000 7f8285000640 1 --1- 172.21.15.5:0/2401052450 >> v1:172.21.15.5:6789/0 conn(0x7f82800cde30 0x7f82800cc550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56370/0 (socket says 172.21.15.5:56370) 2024-08-17T02:23:30.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.859+0000 7f827fe00640 1 --2- 172.21.15.5:0/2401052450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82801589a0 0x7f8280158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:30.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.859+0000 7f827f400640 1 -- 172.21.15.5:0/2401052450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82801589a0 msgr2=0x7f8280158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:30.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.859+0000 7f827f400640 1 --2- 172.21.15.5:0/2401052450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82801589a0 0x7f8280158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:30.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.859+0000 7f827f400640 1 -- 172.21.15.5:0/2401052450 >> v1:172.21.15.5:6789/0 conn(0x7f82800cde30 legacy=0x7f82800cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:30.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.860+0000 7f827f400640 1 -- 172.21.15.5:0/2401052450 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82800b01f0 con 0x7f82800ca240 2024-08-17T02:23:30.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.860+0000 7f827ea00640 1 -- 172.21.15.5:0/2401052450 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637519691 0 0) 0x7f8278001490 con 0x7f82800cde30 2024-08-17T02:23:30.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.860+0000 7f827fe00640 1 --2- 172.21.15.5:0/2401052450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82801589a0 0x7f8280158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:30.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.861+0000 7f827f400640 1 --2- 172.21.15.5:0/2401052450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82800ca240 0x7f82800cac00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f826c009910 tx=0x7f826c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8b6d0b251de8e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:30.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.861+0000 7f827ea00640 1 -- 172.21.15.5:0/2401052450 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c032440 con 0x7f82800ca240 2024-08-17T02:23:30.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.861+0000 7f827ea00640 1 -- 172.21.15.5:0/2401052450 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c0325a0 con 0x7f82800ca240 2024-08-17T02:23:30.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.861+0000 7f827ea00640 1 -- 172.21.15.5:0/2401052450 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c032940 con 0x7f82800ca240 2024-08-17T02:23:30.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.861+0000 7f8285a00640 1 -- 172.21.15.5:0/2401052450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82800ca240 msgr2=0x7f82800cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:30.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.861+0000 7f8285a00640 1 --2- 172.21.15.5:0/2401052450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82800ca240 0x7f82800cac00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f826c009910 tx=0x7f826c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:30.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.861+0000 7f8285a00640 1 -- 172.21.15.5:0/2401052450 shutdown_connections 2024-08-17T02:23:30.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.861+0000 7f8285a00640 1 --2- 172.21.15.5:0/2401052450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82800ca240 0x7f82800cac00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:30.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.861+0000 7f8285a00640 1 --2- 172.21.15.5:0/2401052450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82801589a0 0x7f8280158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:30.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.861+0000 7f8285a00640 1 -- 172.21.15.5:0/2401052450 >> 172.21.15.5:0/2401052450 conn(0x7f828006e590 msgr2=0x7f828006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:30.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.862+0000 7f8285a00640 1 -- 172.21.15.5:0/2401052450 shutdown_connections 2024-08-17T02:23:30.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.862+0000 7f8285a00640 1 -- 172.21.15.5:0/2401052450 wait complete. 2024-08-17T02:23:30.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.863+0000 7f8285a00640 1 Processor -- start 2024-08-17T02:23:30.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.863+0000 7f8285a00640 1 -- start start 2024-08-17T02:23:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.864+0000 7f8285a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82800ca240 0x7f82800c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.864+0000 7f8285a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82800cde30 0x7f82800cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.864+0000 7f8285a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82801589a0 0x7f82800c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.864+0000 7f8285a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82800b39b0 con 0x7f82800cde30 2024-08-17T02:23:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.864+0000 7f8285a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82800b2da0 con 0x7f82800ca240 2024-08-17T02:23:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.864+0000 7f8285a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82800b3080 con 0x7f82801589a0 2024-08-17T02:23:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.864+0000 7f827f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82800cde30 0x7f82800cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.864+0000 7f827fe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82800ca240 0x7f82800c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.864+0000 7f827f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82800cde30 0x7f82800cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58534/0 (socket says 172.21.15.5:58534) 2024-08-17T02:23:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.864+0000 7f827f400640 1 -- 172.21.15.5:0/3882180051 learned_addr learned my addr 172.21.15.5:0/3882180051 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.864+0000 7f8285000640 1 --2- 172.21.15.5:0/3882180051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82801589a0 0x7f82800c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.865+0000 7f827f400640 1 -- 172.21.15.5:0/3882180051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82801589a0 msgr2=0x7f82800c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.865+0000 7f827f400640 1 --2- 172.21.15.5:0/3882180051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82801589a0 0x7f82800c73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.865+0000 7f827f400640 1 -- 172.21.15.5:0/3882180051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82800ca240 msgr2=0x7f82800c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.865+0000 7f827f400640 1 --2- 172.21.15.5:0/3882180051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82800ca240 0x7f82800c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.865+0000 7f827f400640 1 -- 172.21.15.5:0/3882180051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c009450 con 0x7f82800cde30 2024-08-17T02:23:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.865+0000 7f827fe00640 1 --2- 172.21.15.5:0/3882180051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82800ca240 0x7f82800c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.865+0000 7f827f400640 1 --2- 172.21.15.5:0/3882180051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82800cde30 0x7f82800cf590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f826c009970 tx=0x7f826c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.866+0000 7f8277400640 1 -- 172.21.15.5:0/3882180051 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c032920 con 0x7f82800cde30 2024-08-17T02:23:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.866+0000 7f8277400640 1 -- 172.21.15.5:0/3882180051 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c031e00 con 0x7f82800cde30 2024-08-17T02:23:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.866+0000 7f8277400640 1 -- 172.21.15.5:0/3882180051 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c03e680 con 0x7f82800cde30 2024-08-17T02:23:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.866+0000 7f8285a00640 1 -- 172.21.15.5:0/3882180051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82800b3360 con 0x7f82800cde30 2024-08-17T02:23:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.866+0000 7f8285a00640 1 -- 172.21.15.5:0/3882180051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82800b29c0 con 0x7f82800cde30 2024-08-17T02:23:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.867+0000 7f8285a00640 1 -- 172.21.15.5:0/3882180051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8280070720 con 0x7f82800cde30 2024-08-17T02:23:30.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.868+0000 7f8277400640 1 -- 172.21.15.5:0/3882180051 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f826c03c400 con 0x7f82800cde30 2024-08-17T02:23:30.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.869+0000 7f8277400640 1 --2- 172.21.15.5:0/3882180051 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f82600650c0 0x7f8260067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:30.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.869+0000 7f8277400640 1 -- 172.21.15.5:0/3882180051 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f826c0a23f0 con 0x7f82800cde30 2024-08-17T02:23:30.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.869+0000 7f827fe00640 1 --2- 172.21.15.5:0/3882180051 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f82600650c0 0x7f8260067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:30.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.870+0000 7f827fe00640 1 --2- 172.21.15.5:0/3882180051 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f82600650c0 0x7f8260067570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8270010370 tx=0x7f8270008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:30.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:30.873+0000 7f8277400640 1 -- 172.21.15.5:0/3882180051 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f826c0709b0 con 0x7f82800cde30 2024-08-17T02:23:31.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.100+0000 7f8285a00640 1 -- 172.21.15.5:0/3882180051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8280156e70 con 0x7f82800cde30 2024-08-17T02:23:31.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.101+0000 7f8277400640 1 -- 172.21.15.5:0/3882180051 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3515 (secure 0 0 0) 0x7f826c043dd0 con 0x7f82800cde30 2024-08-17T02:23:31.103 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:31.103 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/2870814974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2870814974},{"type":"v1","addr":"172.21.15.87:6834","nonce":2870814974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/508600504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":508600504},{"type":"v1","addr":"172.21.15.5:6835","nonce":508600504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3215918333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3215918333},{"type":"v1","addr":"172.21.15.5:6837","nonce":3215918333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3443816405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3443816405},{"type":"v1","addr":"172.21.15.87:6835","nonce":3443816405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-08-17T02:23:31.103 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 3 2024-08-17T02:23:31.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.103+0000 7f8285a00640 1 -- 172.21.15.5:0/3882180051 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f82600650c0 msgr2=0x7f8260067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.103+0000 7f8285a00640 1 --2- 172.21.15.5:0/3882180051 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f82600650c0 0x7f8260067570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8270010370 tx=0x7f8270008040 comp rx=0 tx=0).stop 2024-08-17T02:23:31.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.103+0000 7f8285a00640 1 -- 172.21.15.5:0/3882180051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82800cde30 msgr2=0x7f82800cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.103+0000 7f8285a00640 1 --2- 172.21.15.5:0/3882180051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82800cde30 0x7f82800cf590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f826c009970 tx=0x7f826c032000 comp rx=0 tx=0).stop 2024-08-17T02:23:31.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.104+0000 7f8285a00640 1 -- 172.21.15.5:0/3882180051 shutdown_connections 2024-08-17T02:23:31.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.104+0000 7f8285a00640 1 --2- 172.21.15.5:0/3882180051 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f82600650c0 0x7f8260067570 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.104+0000 7f8285a00640 1 --2- 172.21.15.5:0/3882180051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82801589a0 0x7f82800c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.104+0000 7f8285a00640 1 --2- 172.21.15.5:0/3882180051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82800cde30 0x7f82800cf590 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.104+0000 7f8285a00640 1 --2- 172.21.15.5:0/3882180051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82800ca240 0x7f82800c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.104+0000 7f8285a00640 1 -- 172.21.15.5:0/3882180051 >> 172.21.15.5:0/3882180051 conn(0x7f828006e590 msgr2=0x7f82800cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:31.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.104+0000 7f8285a00640 1 -- 172.21.15.5:0/3882180051 shutdown_connections 2024-08-17T02:23:31.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.104+0000 7f8285a00640 1 -- 172.21.15.5:0/3882180051 wait complete. 2024-08-17T02:23:31.123 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:31.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.276+0000 7f8dd0600640 1 Processor -- start 2024-08-17T02:23:31.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.276+0000 7f8dd0600640 1 -- start start 2024-08-17T02:23:31.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.277+0000 7f8dd0600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8dc80aee60 0x7f8dc80caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:31.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.277+0000 7f8dd0600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc80afd20 con 0x7f8dc8158b90 2024-08-17T02:23:31.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.278+0000 7f8dd0600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc80affe0 con 0x7f8dc80aea20 2024-08-17T02:23:31.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.278+0000 7f8dd0600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc80b02c0 con 0x7f8dc80aee60 2024-08-17T02:23:31.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.278+0000 7f8dcdc00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8dc8158b90 0x7f8dc80b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56380/0 (socket says 172.21.15.5:56380) 2024-08-17T02:23:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.278+0000 7f8dcdc00640 1 -- 172.21.15.5:0/4203938210 learned_addr learned my addr 172.21.15.5:0/4203938210 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.278+0000 7f8dce600640 1 --2- 172.21.15.5:0/4203938210 >> v2:172.21.15.5:3300/0 conn(0x7f8dc80aee60 0x7f8dc80caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.278+0000 7f8dc7e00640 1 -- 172.21.15.5:0/4203938210 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923091319 0 0) 0x7f8dc80afd20 con 0x7f8dc8158b90 2024-08-17T02:23:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.278+0000 7f8dce600640 1 -- 172.21.15.5:0/4203938210 >> v1:172.21.15.87:6789/0 conn(0x7f8dc80aea20 legacy=0x7f8dc80ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.278+0000 7f8dce600640 1 -- 172.21.15.5:0/4203938210 >> v1:172.21.15.5:6789/0 conn(0x7f8dc8158b90 legacy=0x7f8dc80b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.278+0000 7f8dce600640 1 -- 172.21.15.5:0/4203938210 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc80ca3c0 con 0x7f8dc80aee60 2024-08-17T02:23:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.279+0000 7f8dce600640 1 --2- 172.21.15.5:0/4203938210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dc80aee60 0x7f8dc80caff0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0009de0 tx=0x7f8dc0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18aab1d77a5909bf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.280+0000 7f8dc7e00640 1 -- 172.21.15.5:0/4203938210 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0007550 con 0x7f8dc80aee60 2024-08-17T02:23:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.280+0000 7f8dc7e00640 1 -- 172.21.15.5:0/4203938210 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc002d050 con 0x7f8dc80aee60 2024-08-17T02:23:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.280+0000 7f8dc7e00640 1 -- 172.21.15.5:0/4203938210 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc00078e0 con 0x7f8dc80aee60 2024-08-17T02:23:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.280+0000 7f8dd0600640 1 -- 172.21.15.5:0/4203938210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dc80aee60 msgr2=0x7f8dc80caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.280+0000 7f8dd0600640 1 --2- 172.21.15.5:0/4203938210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dc80aee60 0x7f8dc80caff0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0009de0 tx=0x7f8dc0009780 comp rx=0 tx=0).stop 2024-08-17T02:23:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.280+0000 7f8dd0600640 1 -- 172.21.15.5:0/4203938210 shutdown_connections 2024-08-17T02:23:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.280+0000 7f8dd0600640 1 --2- 172.21.15.5:0/4203938210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dc80aee60 0x7f8dc80caff0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.280+0000 7f8dd0600640 1 -- 172.21.15.5:0/4203938210 >> 172.21.15.5:0/4203938210 conn(0x7f8dc806e590 msgr2=0x7f8dc806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.280+0000 7f8dd0600640 1 -- 172.21.15.5:0/4203938210 shutdown_connections 2024-08-17T02:23:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.280+0000 7f8dd0600640 1 -- 172.21.15.5:0/4203938210 wait complete. 2024-08-17T02:23:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.282+0000 7f8dd0600640 1 Processor -- start 2024-08-17T02:23:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.282+0000 7f8dd0600640 1 -- start start 2024-08-17T02:23:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.283+0000 7f8dd0600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc80aea20 0x7f8dc8158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.283+0000 7f8dd0600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dc80aee60 0x7f8dc80c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.283+0000 7f8dd0600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8dc8158b90 0x7f8dc81690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.283+0000 7f8dd0600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc816d410 con 0x7f8dc80aee60 2024-08-17T02:23:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.283+0000 7f8dd0600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc8159540 con 0x7f8dc80aea20 2024-08-17T02:23:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.283+0000 7f8dd0600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc8159820 con 0x7f8dc8158b90 2024-08-17T02:23:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.283+0000 7f8dcd200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dc80aee60 0x7f8dc80c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.283+0000 7f8dcd200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dc80aee60 0x7f8dc80c90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58554/0 (socket says 172.21.15.5:58554) 2024-08-17T02:23:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.283+0000 7f8dcd200640 1 -- 172.21.15.5:0/1425476126 learned_addr learned my addr 172.21.15.5:0/1425476126 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.283+0000 7f8dcdc00640 1 --2- 172.21.15.5:0/1425476126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc80aea20 0x7f8dc8158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.283+0000 7f8dce600640 1 --2- 172.21.15.5:0/1425476126 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8dc8158b90 0x7f8dc81690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.283+0000 7f8dcd200640 1 -- 172.21.15.5:0/1425476126 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8dc8158b90 msgr2=0x7f8dc81690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.283+0000 7f8dcd200640 1 --2- 172.21.15.5:0/1425476126 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8dc8158b90 0x7f8dc81690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.283+0000 7f8dcd200640 1 -- 172.21.15.5:0/1425476126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc80aea20 msgr2=0x7f8dc8158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.283+0000 7f8dcd200640 1 --2- 172.21.15.5:0/1425476126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc80aea20 0x7f8dc8158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.283+0000 7f8dcd200640 1 -- 172.21.15.5:0/1425476126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc0009a20 con 0x7f8dc80aee60 2024-08-17T02:23:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.284+0000 7f8dcd200640 1 --2- 172.21.15.5:0/1425476126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dc80aee60 0x7f8dc80c90c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8db400c810 tx=0x7f8db4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.284+0000 7f8dc4c00640 1 -- 172.21.15.5:0/1425476126 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db400a6d0 con 0x7f8dc80aee60 2024-08-17T02:23:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.284+0000 7f8dc4c00640 1 -- 172.21.15.5:0/1425476126 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db400a850 con 0x7f8dc80aee60 2024-08-17T02:23:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.284+0000 7f8dd0600640 1 -- 172.21.15.5:0/1425476126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc8159b00 con 0x7f8dc80aee60 2024-08-17T02:23:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.284+0000 7f8dc4c00640 1 -- 172.21.15.5:0/1425476126 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db400ac10 con 0x7f8dc80aee60 2024-08-17T02:23:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.284+0000 7f8dd0600640 1 -- 172.21.15.5:0/1425476126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc815a0c0 con 0x7f8dc80aee60 2024-08-17T02:23:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.285+0000 7f8dd0600640 1 -- 172.21.15.5:0/1425476126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc8063fb0 con 0x7f8dc80aee60 2024-08-17T02:23:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.286+0000 7f8dc4c00640 1 -- 172.21.15.5:0/1425476126 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f8db4012630 con 0x7f8dc80aee60 2024-08-17T02:23:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.287+0000 7f8dc4c00640 1 --2- 172.21.15.5:0/1425476126 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8da80650c0 0x7f8da8067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.287+0000 7f8dc4c00640 1 -- 172.21.15.5:0/1425476126 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8db4081c20 con 0x7f8dc80aee60 2024-08-17T02:23:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.287+0000 7f8dcdc00640 1 --2- 172.21.15.5:0/1425476126 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8da80650c0 0x7f8da8067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.288+0000 7f8dcdc00640 1 --2- 172.21.15.5:0/1425476126 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8da80650c0 0x7f8da8067570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0011e0 tx=0x7f8dbc007ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.295+0000 7f8dc4c00640 1 -- 172.21.15.5:0/1425476126 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8db4050120 con 0x7f8dc80aee60 2024-08-17T02:23:31.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.478+0000 7f8dd0600640 1 -- 172.21.15.5:0/1425476126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8dc80c9ec0 con 0x7f8dc80aee60 2024-08-17T02:23:31.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.479+0000 7f8dc4c00640 1 -- 172.21.15.5:0/1425476126 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12044 (secure 0 0 0) 0x7f8db4053740 con 0x7f8dc80aee60 2024-08-17T02:23:31.481 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:31.481 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:30.528315+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:31.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.481+0000 7f8dd0600640 1 -- 172.21.15.5:0/1425476126 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8da80650c0 msgr2=0x7f8da8067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.481+0000 7f8dd0600640 1 --2- 172.21.15.5:0/1425476126 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8da80650c0 0x7f8da8067570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0011e0 tx=0x7f8dbc007ca0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.481+0000 7f8dd0600640 1 -- 172.21.15.5:0/1425476126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dc80aee60 msgr2=0x7f8dc80c90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.481+0000 7f8dd0600640 1 --2- 172.21.15.5:0/1425476126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dc80aee60 0x7f8dc80c90c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8db400c810 tx=0x7f8db4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.482+0000 7f8dd0600640 1 -- 172.21.15.5:0/1425476126 shutdown_connections 2024-08-17T02:23:31.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.482+0000 7f8dd0600640 1 --2- 172.21.15.5:0/1425476126 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8da80650c0 0x7f8da8067570 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.482+0000 7f8dd0600640 1 --2- 172.21.15.5:0/1425476126 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8dc8158b90 0x7f8dc81690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.482+0000 7f8dd0600640 1 --2- 172.21.15.5:0/1425476126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dc80aee60 0x7f8dc80c90c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.482+0000 7f8dd0600640 1 --2- 172.21.15.5:0/1425476126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc80aea20 0x7f8dc8158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.482+0000 7f8dd0600640 1 -- 172.21.15.5:0/1425476126 >> 172.21.15.5:0/1425476126 conn(0x7f8dc806e590 msgr2=0x7f8dc80b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:31.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.482+0000 7f8dd0600640 1 -- 172.21.15.5:0/1425476126 shutdown_connections 2024-08-17T02:23:31.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.482+0000 7f8dd0600640 1 -- 172.21.15.5:0/1425476126 wait complete. 2024-08-17T02:23:31.498 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:28.773677+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:23:31.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:23:31.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.657+0000 7f07d7400640 1 Processor -- start 2024-08-17T02:23:31.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.657+0000 7f07d7400640 1 -- start start 2024-08-17T02:23:31.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.658+0000 7f07d7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07d0156730 0x7f07d00ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:31.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.658+0000 7f07d7400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07d00ccdb0 0x7f07d00caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:31.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.658+0000 7f07d7400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d00ce6a0 con 0x7f07d0156b00 2024-08-17T02:23:31.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.658+0000 7f07d7400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d00cddb0 con 0x7f07d0156730 2024-08-17T02:23:31.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.658+0000 7f07d7400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d015a2c0 con 0x7f07d00ccdb0 2024-08-17T02:23:31.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.658+0000 7f07d4a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07d0156730 0x7f07d00ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:31.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.658+0000 7f07d4a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07d0156730 0x7f07d00ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58556/0 (socket says 172.21.15.5:58556) 2024-08-17T02:23:31.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.658+0000 7f07d4a00640 1 -- 172.21.15.5:0/1053098187 learned_addr learned my addr 172.21.15.5:0/1053098187 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:31.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.658+0000 7f07cfe00640 1 --1- 172.21.15.5:0/1053098187 >> v1:172.21.15.5:6789/0 conn(0x7f07d0156b00 0x7f07d00cc6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56382/0 (socket says 172.21.15.5:56382) 2024-08-17T02:23:31.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.658+0000 7f07d5400640 1 --2- 172.21.15.5:0/1053098187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07d00ccdb0 0x7f07d00caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:31.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.659+0000 7f07d4a00640 1 -- 172.21.15.5:0/1053098187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07d00ccdb0 msgr2=0x7f07d00caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:31.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.659+0000 7f07d4a00640 1 --2- 172.21.15.5:0/1053098187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07d00ccdb0 0x7f07d00caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.659+0000 7f07d4a00640 1 -- 172.21.15.5:0/1053098187 >> v1:172.21.15.5:6789/0 conn(0x7f07d0156b00 legacy=0x7f07d00cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.659+0000 7f07d4a00640 1 -- 172.21.15.5:0/1053098187 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d00cfb40 con 0x7f07d0156730 2024-08-17T02:23:31.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.660+0000 7f07d4a00640 1 --2- 172.21.15.5:0/1053098187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07d0156730 0x7f07d00ca5b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f07c4009910 tx=0x7f07c40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c19efbe853a44f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:31.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.660+0000 7f07cf400640 1 -- 172.21.15.5:0/1053098187 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c402add0 con 0x7f07d0156730 2024-08-17T02:23:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.660+0000 7f07cf400640 1 -- 172.21.15.5:0/1053098187 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c4032440 con 0x7f07d0156730 2024-08-17T02:23:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.660+0000 7f07cf400640 1 -- 172.21.15.5:0/1053098187 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c4032820 con 0x7f07d0156730 2024-08-17T02:23:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.660+0000 7f07d7400640 1 -- 172.21.15.5:0/1053098187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07d0156730 msgr2=0x7f07d00ca5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.660+0000 7f07d7400640 1 --2- 172.21.15.5:0/1053098187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07d0156730 0x7f07d00ca5b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f07c4009910 tx=0x7f07c40091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.660+0000 7f07d7400640 1 -- 172.21.15.5:0/1053098187 shutdown_connections 2024-08-17T02:23:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.660+0000 7f07d7400640 1 --2- 172.21.15.5:0/1053098187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07d00ccdb0 0x7f07d00caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.660+0000 7f07d7400640 1 --2- 172.21.15.5:0/1053098187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07d0156730 0x7f07d00ca5b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.660+0000 7f07d7400640 1 -- 172.21.15.5:0/1053098187 >> 172.21.15.5:0/1053098187 conn(0x7f07d006e590 msgr2=0x7f07d006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.661+0000 7f07d7400640 1 -- 172.21.15.5:0/1053098187 shutdown_connections 2024-08-17T02:23:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.661+0000 7f07d7400640 1 -- 172.21.15.5:0/1053098187 wait complete. 2024-08-17T02:23:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.662+0000 7f07d7400640 1 Processor -- start 2024-08-17T02:23:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.662+0000 7f07d7400640 1 -- start start 2024-08-17T02:23:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.663+0000 7f07d7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07d00ccdb0 0x7f07d00c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.663+0000 7f07d7400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07d0156730 0x7f07d00ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.663+0000 7f07d7400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07d0156b00 0x7f07d016a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.663+0000 7f07d7400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00b4480 con 0x7f07d00ccdb0 2024-08-17T02:23:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.663+0000 7f07d7400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00c88a0 con 0x7f07d0156730 2024-08-17T02:23:31.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.663+0000 7f07d7400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00b2b00 con 0x7f07d0156b00 2024-08-17T02:23:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.663+0000 7f07d4a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07d00ccdb0 0x7f07d00c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.663+0000 7f07d4a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07d00ccdb0 0x7f07d00c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58558/0 (socket says 172.21.15.5:58558) 2024-08-17T02:23:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.663+0000 7f07d4a00640 1 -- 172.21.15.5:0/1351171892 learned_addr learned my addr 172.21.15.5:0/1351171892 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.663+0000 7f07cfe00640 1 --2- 172.21.15.5:0/1351171892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07d0156730 0x7f07d00ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.663+0000 7f07d5400640 1 --2- 172.21.15.5:0/1351171892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07d0156b00 0x7f07d016a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.663+0000 7f07d4a00640 1 -- 172.21.15.5:0/1351171892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07d0156b00 msgr2=0x7f07d016a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.663+0000 7f07d4a00640 1 --2- 172.21.15.5:0/1351171892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07d0156b00 0x7f07d016a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.663+0000 7f07d4a00640 1 -- 172.21.15.5:0/1351171892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07d0156730 msgr2=0x7f07d00ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.663+0000 7f07d4a00640 1 --2- 172.21.15.5:0/1351171892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07d0156730 0x7f07d00ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.663+0000 7f07d4a00640 1 -- 172.21.15.5:0/1351171892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c4009450 con 0x7f07d00ccdb0 2024-08-17T02:23:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.664+0000 7f07d4a00640 1 --2- 172.21.15.5:0/1351171892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07d00ccdb0 0x7f07d00c8360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f07c4009970 tx=0x7f07c4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:31.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.664+0000 7f07c3e00640 1 -- 172.21.15.5:0/1351171892 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c4031bb0 con 0x7f07d00ccdb0 2024-08-17T02:23:31.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.664+0000 7f07c3e00640 1 -- 172.21.15.5:0/1351171892 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c4031d30 con 0x7f07d00ccdb0 2024-08-17T02:23:31.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.664+0000 7f07c3e00640 1 -- 172.21.15.5:0/1351171892 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c4031ea0 con 0x7f07d00ccdb0 2024-08-17T02:23:31.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.664+0000 7f07d7400640 1 -- 172.21.15.5:0/1351171892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d0169860 con 0x7f07d00ccdb0 2024-08-17T02:23:31.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.664+0000 7f07d7400640 1 -- 172.21.15.5:0/1351171892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d0169e20 con 0x7f07d00ccdb0 2024-08-17T02:23:31.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.665+0000 7f07d7400640 1 -- 172.21.15.5:0/1351171892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d0063fb0 con 0x7f07d00ccdb0 2024-08-17T02:23:31.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.666+0000 7f07c3e00640 1 -- 172.21.15.5:0/1351171892 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f07c4039040 con 0x7f07d00ccdb0 2024-08-17T02:23:31.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.667+0000 7f07c3e00640 1 --2- 172.21.15.5:0/1351171892 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f07b00650c0 0x7f07b0067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:31.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.667+0000 7f07c3e00640 1 -- 172.21.15.5:0/1351171892 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f07c40a1e70 con 0x7f07d00ccdb0 2024-08-17T02:23:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.667+0000 7f07cfe00640 1 --2- 172.21.15.5:0/1351171892 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f07b00650c0 0x7f07b0067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.668+0000 7f07cfe00640 1 --2- 172.21.15.5:0/1351171892 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f07b00650c0 0x7f07b0067570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f07d00c9b80 tx=0x7f07bc007e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:31.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.671+0000 7f07c3e00640 1 -- 172.21.15.5:0/1351171892 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f07c4070370 con 0x7f07d00ccdb0 2024-08-17T02:23:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.855+0000 7f07d7400640 1 -- 172.21.15.5:0/1351171892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07d016a1c0 con 0x7f07d00ccdb0 2024-08-17T02:23:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.856+0000 7f07c3e00640 1 -- 172.21.15.5:0/1351171892 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07c4037020 con 0x7f07d00ccdb0 2024-08-17T02:23:31.858 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:23:31.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.858+0000 7f07d7400640 1 -- 172.21.15.5:0/1351171892 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f07b00650c0 msgr2=0x7f07b0067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.858+0000 7f07d7400640 1 --2- 172.21.15.5:0/1351171892 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f07b00650c0 0x7f07b0067570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f07d00c9b80 tx=0x7f07bc007e20 comp rx=0 tx=0).stop 2024-08-17T02:23:31.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.858+0000 7f07d7400640 1 -- 172.21.15.5:0/1351171892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07d00ccdb0 msgr2=0x7f07d00c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.858+0000 7f07d7400640 1 --2- 172.21.15.5:0/1351171892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07d00ccdb0 0x7f07d00c8360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f07c4009970 tx=0x7f07c4032000 comp rx=0 tx=0).stop 2024-08-17T02:23:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.858+0000 7f07d7400640 1 -- 172.21.15.5:0/1351171892 shutdown_connections 2024-08-17T02:23:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.858+0000 7f07d7400640 1 --2- 172.21.15.5:0/1351171892 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f07b00650c0 0x7f07b0067570 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.858+0000 7f07d7400640 1 --2- 172.21.15.5:0/1351171892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07d0156b00 0x7f07d016a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.858+0000 7f07d7400640 1 --2- 172.21.15.5:0/1351171892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07d0156730 0x7f07d00ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.858+0000 7f07d7400640 1 --2- 172.21.15.5:0/1351171892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07d00ccdb0 0x7f07d00c8360 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.858+0000 7f07d7400640 1 -- 172.21.15.5:0/1351171892 >> 172.21.15.5:0/1351171892 conn(0x7f07d006e590 msgr2=0x7f07d00c4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.858+0000 7f07d7400640 1 -- 172.21.15.5:0/1351171892 shutdown_connections 2024-08-17T02:23:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:31.858+0000 7f07d7400640 1 -- 172.21.15.5:0/1351171892 wait complete. 2024-08-17T02:23:31.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:23:32.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.026+0000 7fdda9000640 1 Processor -- start 2024-08-17T02:23:32.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.026+0000 7fdda9000640 1 -- start start 2024-08-17T02:23:32.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.027+0000 7fdda9000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdda406e060 0x7fdda406e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.027+0000 7fdda9000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda40aeeb0 con 0x7fdda40af340 2024-08-17T02:23:32.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.027+0000 7fdda9000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda406e9f0 con 0x7fdda4155040 2024-08-17T02:23:32.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.027+0000 7fdda9000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40aadd0 con 0x7fdda406e060 2024-08-17T02:23:32.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.027+0000 7fdda2800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdda40af340 0x7fdda40af780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56390/0 (socket says 172.21.15.5:56390) 2024-08-17T02:23:32.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.027+0000 7fdda2800640 1 -- 172.21.15.5:0/822220133 learned_addr learned my addr 172.21.15.5:0/822220133 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:32.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.027+0000 7fdd9be00640 1 --2- 172.21.15.5:0/822220133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdda406e060 0x7fdda406e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.028+0000 7fdda1400640 1 -- 172.21.15.5:0/822220133 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403114377 0 0) 0x7fdda406e9f0 con 0x7fdda4155040 2024-08-17T02:23:32.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.028+0000 7fdda1400640 1 -- 172.21.15.5:0/822220133 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd880034e0 con 0x7fdda4155040 2024-08-17T02:23:32.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.028+0000 7fdda1400640 1 -- 172.21.15.5:0/822220133 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999973688 0 0) 0x7fdda40aeeb0 con 0x7fdda40af340 2024-08-17T02:23:32.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.028+0000 7fdd9be00640 1 -- 172.21.15.5:0/822220133 >> v1:172.21.15.87:6789/0 conn(0x7fdda4155040 legacy=0x7fdda4158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.028+0000 7fdd9be00640 1 -- 172.21.15.5:0/822220133 >> v1:172.21.15.5:6789/0 conn(0x7fdda40af340 legacy=0x7fdda40af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.028+0000 7fdd9be00640 1 -- 172.21.15.5:0/822220133 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda41597f0 con 0x7fdda406e060 2024-08-17T02:23:32.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.029+0000 7fdd9be00640 1 --2- 172.21.15.5:0/822220133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdda406e060 0x7fdda406e4b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009880 tx=0x7fdd8c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62d959654b9433d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:32.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.029+0000 7fdda1400640 1 -- 172.21.15.5:0/822220133 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c02ad80 con 0x7fdda406e060 2024-08-17T02:23:32.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.029+0000 7fdda1400640 1 -- 172.21.15.5:0/822220133 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c032440 con 0x7fdda406e060 2024-08-17T02:23:32.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.029+0000 7fdda1400640 1 -- 172.21.15.5:0/822220133 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0327e0 con 0x7fdda406e060 2024-08-17T02:23:32.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.030+0000 7fdda9000640 1 -- 172.21.15.5:0/822220133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdda406e060 msgr2=0x7fdda406e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.030+0000 7fdda9000640 1 --2- 172.21.15.5:0/822220133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdda406e060 0x7fdda406e4b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009880 tx=0x7fdd8c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.030+0000 7fdda9000640 1 -- 172.21.15.5:0/822220133 shutdown_connections 2024-08-17T02:23:32.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.030+0000 7fdda9000640 1 --2- 172.21.15.5:0/822220133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdda406e060 0x7fdda406e4b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.030+0000 7fdda9000640 1 -- 172.21.15.5:0/822220133 >> 172.21.15.5:0/822220133 conn(0x7fdda4066e60 msgr2=0x7fdda4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:32.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.030+0000 7fdda9000640 1 -- 172.21.15.5:0/822220133 shutdown_connections 2024-08-17T02:23:32.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.030+0000 7fdda9000640 1 -- 172.21.15.5:0/822220133 wait complete. 2024-08-17T02:23:32.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.031+0000 7fdda9000640 1 Processor -- start 2024-08-17T02:23:32.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.031+0000 7fdda9000640 1 -- start start 2024-08-17T02:23:32.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.032+0000 7fdda9000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdda406e060 0x7fdda40ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.032+0000 7fdda9000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdda40af340 0x7fdda40aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.032+0000 7fdda9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda4155040 0x7fdda40c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.032+0000 7fdda9000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40ac580 con 0x7fdda4155040 2024-08-17T02:23:32.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.032+0000 7fdda9000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40ab970 con 0x7fdda406e060 2024-08-17T02:23:32.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.032+0000 7fdda9000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40abc50 con 0x7fdda40af340 2024-08-17T02:23:32.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.033+0000 7fdd9be00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdda40af340 0x7fdda40aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.033+0000 7fdda1e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdda406e060 0x7fdda40ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.033+0000 7fdd9be00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdda40af340 0x7fdda40aca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:46876/0 (socket says 172.21.15.5:46876) 2024-08-17T02:23:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.033+0000 7fdda2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda4155040 0x7fdda40c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.033+0000 7fdd9be00640 1 -- 172.21.15.5:0/2098255032 learned_addr learned my addr 172.21.15.5:0/2098255032 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.033+0000 7fdd9be00640 1 -- 172.21.15.5:0/2098255032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdda406e060 msgr2=0x7fdda40ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.033+0000 7fdd9be00640 1 --2- 172.21.15.5:0/2098255032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdda406e060 0x7fdda40ab120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.033+0000 7fdd9be00640 1 -- 172.21.15.5:0/2098255032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda4155040 msgr2=0x7fdda40c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.033+0000 7fdd9be00640 1 --2- 172.21.15.5:0/2098255032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda4155040 0x7fdda40c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.033+0000 7fdd9be00640 1 -- 172.21.15.5:0/2098255032 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c009390 con 0x7fdda40af340 2024-08-17T02:23:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.033+0000 7fdd9be00640 1 --2- 172.21.15.5:0/2098255032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdda40af340 0x7fdda40aca10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0097d0 tx=0x7fdd8c032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.033+0000 7fdd99600640 1 -- 172.21.15.5:0/2098255032 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c031a60 con 0x7fdda40af340 2024-08-17T02:23:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.034+0000 7fdd99600640 1 -- 172.21.15.5:0/2098255032 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c031bc0 con 0x7fdda40af340 2024-08-17T02:23:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.034+0000 7fdd99600640 1 -- 172.21.15.5:0/2098255032 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c03d420 con 0x7fdda40af340 2024-08-17T02:23:32.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.034+0000 7fdda9000640 1 -- 172.21.15.5:0/2098255032 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda40abf30 con 0x7fdda40af340 2024-08-17T02:23:32.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.034+0000 7fdda9000640 1 -- 172.21.15.5:0/2098255032 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda40ab660 con 0x7fdda40af340 2024-08-17T02:23:32.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.035+0000 7fdda9000640 1 -- 172.21.15.5:0/2098255032 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda40ac6f0 con 0x7fdda40af340 2024-08-17T02:23:32.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.035+0000 7fdd99600640 1 -- 172.21.15.5:0/2098255032 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7fdd8c039040 con 0x7fdda40af340 2024-08-17T02:23:32.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.036+0000 7fdd99600640 1 --2- 172.21.15.5:0/2098255032 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdd800650c0 0x7fdd80067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.036+0000 7fdd99600640 1 -- 172.21.15.5:0/2098255032 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fdd8c0a1b90 con 0x7fdda40af340 2024-08-17T02:23:32.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.036+0000 7fdda1e00640 1 --2- 172.21.15.5:0/2098255032 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdd800650c0 0x7fdd80067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.037+0000 7fdda1e00640 1 --2- 172.21.15.5:0/2098255032 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdd800650c0 0x7fdd80067570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdd94007fd0 tx=0x7fdd94007d50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:32.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.042+0000 7fdd99600640 1 -- 172.21.15.5:0/2098255032 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdd8c070150 con 0x7fdda40af340 2024-08-17T02:23:32.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.230+0000 7fdda9000640 1 -- 172.21.15.5:0/2098255032 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdda4063fb0 con 0x7fdda40af340 2024-08-17T02:23:32.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.231+0000 7fdd99600640 1 -- 172.21.15.5:0/2098255032 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7fdd8c073770 con 0x7fdda40af340 2024-08-17T02:23:32.232 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:32.232 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-17T02:23:32.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:23:32.232 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-17T02:23:32.232 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-17T02:23:32.233 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:23:32.233 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-17T02:23:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.233+0000 7fdda9000640 1 -- 172.21.15.5:0/2098255032 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdd800650c0 msgr2=0x7fdd80067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.233+0000 7fdda9000640 1 --2- 172.21.15.5:0/2098255032 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdd800650c0 0x7fdd80067570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdd94007fd0 tx=0x7fdd94007d50 comp rx=0 tx=0).stop 2024-08-17T02:23:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.233+0000 7fdda9000640 1 -- 172.21.15.5:0/2098255032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdda40af340 msgr2=0x7fdda40aca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.233+0000 7fdda9000640 1 --2- 172.21.15.5:0/2098255032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdda40af340 0x7fdda40aca10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0097d0 tx=0x7fdd8c032000 comp rx=0 tx=0).stop 2024-08-17T02:23:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.233+0000 7fdda9000640 1 -- 172.21.15.5:0/2098255032 shutdown_connections 2024-08-17T02:23:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.233+0000 7fdda9000640 1 --2- 172.21.15.5:0/2098255032 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdd800650c0 0x7fdd80067570 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.233+0000 7fdda9000640 1 --2- 172.21.15.5:0/2098255032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdda40af340 0x7fdda40aca10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.233+0000 7fdda9000640 1 --2- 172.21.15.5:0/2098255032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda4155040 0x7fdda40c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.233+0000 7fdda9000640 1 --2- 172.21.15.5:0/2098255032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdda406e060 0x7fdda40ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.233+0000 7fdda9000640 1 -- 172.21.15.5:0/2098255032 >> 172.21.15.5:0/2098255032 conn(0x7fdda4066e60 msgr2=0x7fdda406b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.233+0000 7fdda9000640 1 -- 172.21.15.5:0/2098255032 shutdown_connections 2024-08-17T02:23:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.233+0000 7fdda9000640 1 -- 172.21.15.5:0/2098255032 wait complete. 2024-08-17T02:23:32.250 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:23:32.250 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:23:32.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.403+0000 7f0678e00640 1 Processor -- start 2024-08-17T02:23:32.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.403+0000 7f0678e00640 1 -- start start 2024-08-17T02:23:32.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.405+0000 7f0678e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0674156860 0x7f06740add50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.405+0000 7f0678e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f06740b10e0 0x7f0674157120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.405+0000 7f0678e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06740ca760 con 0x7f0674156c30 2024-08-17T02:23:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.405+0000 7f0678e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06740c9070 con 0x7f0674156860 2024-08-17T02:23:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.405+0000 7f0678e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06740ae290 con 0x7f06740b10e0 2024-08-17T02:23:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.405+0000 7f0673400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0674156860 0x7f06740add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.405+0000 7f0673400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0674156860 0x7f06740add50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58594/0 (socket says 172.21.15.5:58594) 2024-08-17T02:23:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.405+0000 7f0673400640 1 -- 172.21.15.5:0/2903245240 learned_addr learned my addr 172.21.15.5:0/2903245240 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.405+0000 7f066be00640 1 --1- 172.21.15.5:0/2903245240 >> v1:172.21.15.5:6789/0 conn(0x7f0674156c30 0x7f06740b09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56404/0 (socket says 172.21.15.5:56404) 2024-08-17T02:23:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.405+0000 7f0673e00640 1 --2- 172.21.15.5:0/2903245240 >> v2:172.21.15.87:3300/0 conn(0x7f06740b10e0 0x7f0674157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.405+0000 7f0673400640 1 -- 172.21.15.5:0/2903245240 >> v2:172.21.15.87:3300/0 conn(0x7f06740b10e0 msgr2=0x7f0674157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.405+0000 7f0673400640 1 --2- 172.21.15.5:0/2903245240 >> v2:172.21.15.87:3300/0 conn(0x7f06740b10e0 0x7f0674157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.405+0000 7f0673400640 1 -- 172.21.15.5:0/2903245240 >> v1:172.21.15.5:6789/0 conn(0x7f0674156c30 legacy=0x7f06740b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.405+0000 7f0673400640 1 -- 172.21.15.5:0/2903245240 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06740caa00 con 0x7f0674156860 2024-08-17T02:23:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.405+0000 7f0672a00640 1 -- 172.21.15.5:0/2903245240 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886413833 0 0) 0x7f06740ca760 con 0x7f0674156c30 2024-08-17T02:23:32.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.406+0000 7f0673400640 1 --2- 172.21.15.5:0/2903245240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0674156860 0x7f06740add50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f067406ba90 tx=0x7f06640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4c57a3caebb50a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:32.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.407+0000 7f0672a00640 1 -- 172.21.15.5:0/2903245240 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066402ae80 con 0x7f0674156860 2024-08-17T02:23:32.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.407+0000 7f0672a00640 1 -- 172.21.15.5:0/2903245240 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0664032440 con 0x7f0674156860 2024-08-17T02:23:32.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.407+0000 7f0672a00640 1 -- 172.21.15.5:0/2903245240 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06640327c0 con 0x7f0674156860 2024-08-17T02:23:32.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.407+0000 7f0678e00640 1 -- 172.21.15.5:0/2903245240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0674156860 msgr2=0x7f06740add50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.407+0000 7f0678e00640 1 --2- 172.21.15.5:0/2903245240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0674156860 0x7f06740add50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f067406ba90 tx=0x7f06640091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.407+0000 7f0678e00640 1 -- 172.21.15.5:0/2903245240 shutdown_connections 2024-08-17T02:23:32.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.407+0000 7f0678e00640 1 --2- 172.21.15.5:0/2903245240 >> v2:172.21.15.87:3300/0 conn(0x7f06740b10e0 0x7f0674157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.407+0000 7f0678e00640 1 --2- 172.21.15.5:0/2903245240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0674156860 0x7f06740add50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.407+0000 7f0678e00640 1 -- 172.21.15.5:0/2903245240 >> 172.21.15.5:0/2903245240 conn(0x7f06740cb750 msgr2=0x7f06740cbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:32.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.407+0000 7f0678e00640 1 -- 172.21.15.5:0/2903245240 shutdown_connections 2024-08-17T02:23:32.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.408+0000 7f0678e00640 1 -- 172.21.15.5:0/2903245240 wait complete. 2024-08-17T02:23:32.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.409+0000 7f0678e00640 1 Processor -- start 2024-08-17T02:23:32.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.409+0000 7f0678e00640 1 -- start start 2024-08-17T02:23:32.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.410+0000 7f0678e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06740b10e0 0x7f067414a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.410+0000 7f0678e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0674156860 0x7f06740c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.410+0000 7f0678e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0674156c30 0x7f06741506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.410+0000 7f0678e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06740c6180 con 0x7f0674156860 2024-08-17T02:23:32.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.410+0000 7f0678e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067414a6f0 con 0x7f06740b10e0 2024-08-17T02:23:32.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.410+0000 7f0678e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06740c5330 con 0x7f0674156c30 2024-08-17T02:23:32.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.410+0000 7f066be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0674156860 0x7f06740c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.410+0000 7f066be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0674156860 0x7f06740c4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58602/0 (socket says 172.21.15.5:58602) 2024-08-17T02:23:32.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.410+0000 7f066be00640 1 -- 172.21.15.5:0/1486400813 learned_addr learned my addr 172.21.15.5:0/1486400813 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:32.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.410+0000 7f0673400640 1 --2- 172.21.15.5:0/1486400813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06740b10e0 0x7f067414a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.410+0000 7f0673e00640 1 --2- 172.21.15.5:0/1486400813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0674156c30 0x7f06741506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.410+0000 7f066be00640 1 -- 172.21.15.5:0/1486400813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0674156c30 msgr2=0x7f06741506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.410+0000 7f066be00640 1 --2- 172.21.15.5:0/1486400813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0674156c30 0x7f06741506a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.410+0000 7f066be00640 1 -- 172.21.15.5:0/1486400813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06740b10e0 msgr2=0x7f067414a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:32.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.410+0000 7f066be00640 1 --2- 172.21.15.5:0/1486400813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06740b10e0 0x7f067414a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:32.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.410+0000 7f066be00640 1 -- 172.21.15.5:0/1486400813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0664009450 con 0x7f0674156860 2024-08-17T02:23:32.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.411+0000 7f066be00640 1 --2- 172.21.15.5:0/1486400813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0674156860 0x7f06740c4a50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f065c00c5b0 tx=0x7f065c007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:32.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.411+0000 7f066aa00640 1 -- 172.21.15.5:0/1486400813 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c007300 con 0x7f0674156860 2024-08-17T02:23:32.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.411+0000 7f066aa00640 1 -- 172.21.15.5:0/1486400813 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065c0074a0 con 0x7f0674156860 2024-08-17T02:23:32.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.411+0000 7f0678e00640 1 -- 172.21.15.5:0/1486400813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06740c5610 con 0x7f0674156860 2024-08-17T02:23:32.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.411+0000 7f066aa00640 1 -- 172.21.15.5:0/1486400813 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c0049f0 con 0x7f0674156860 2024-08-17T02:23:32.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.411+0000 7f0678e00640 1 -- 172.21.15.5:0/1486400813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06740c5bd0 con 0x7f0674156860 2024-08-17T02:23:32.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.412+0000 7f0678e00640 1 -- 172.21.15.5:0/1486400813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0674063e70 con 0x7f0674156860 2024-08-17T02:23:32.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.413+0000 7f066aa00640 1 -- 172.21.15.5:0/1486400813 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f065c01c3b0 con 0x7f0674156860 2024-08-17T02:23:32.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.414+0000 7f066aa00640 1 --2- 172.21.15.5:0/1486400813 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f06500650c0 0x7f0650067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:32.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.414+0000 7f066aa00640 1 -- 172.21.15.5:0/1486400813 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f065c081b50 con 0x7f0674156860 2024-08-17T02:23:32.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.414+0000 7f0673400640 1 --2- 172.21.15.5:0/1486400813 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f06500650c0 0x7f0650067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:32.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.415+0000 7f0673400640 1 --2- 172.21.15.5:0/1486400813 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f06500650c0 0x7f0650067570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0664034000 tx=0x7f0664032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:32.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.418+0000 7f066aa00640 1 -- 172.21.15.5:0/1486400813 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f065c0500d0 con 0x7f0674156860 2024-08-17T02:23:32.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:32.601+0000 7f0678e00640 1 -- 172.21.15.5:0/1486400813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f06740c62c0 con 0x7f0674156860 2024-08-17T02:23:33.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.556+0000 7f066aa00640 1 -- 172.21.15.5:0/1486400813 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f065c0504a0 con 0x7f0674156860 2024-08-17T02:23:33.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.557+0000 7f066aa00640 1 -- 172.21.15.5:0/1486400813 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f065c0500d0 con 0x7f0674156860 2024-08-17T02:23:33.559 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-17T02:23:33.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.564+0000 7f0678e00640 1 -- 172.21.15.5:0/1486400813 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f06500650c0 msgr2=0x7f0650067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:33.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.564+0000 7f0678e00640 1 --2- 172.21.15.5:0/1486400813 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f06500650c0 0x7f0650067570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0664034000 tx=0x7f0664032000 comp rx=0 tx=0).stop 2024-08-17T02:23:33.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.564+0000 7f0678e00640 1 -- 172.21.15.5:0/1486400813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0674156860 msgr2=0x7f06740c4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:33.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.564+0000 7f0678e00640 1 --2- 172.21.15.5:0/1486400813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0674156860 0x7f06740c4a50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f065c00c5b0 tx=0x7f065c007f20 comp rx=0 tx=0).stop 2024-08-17T02:23:33.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.564+0000 7f0678e00640 1 -- 172.21.15.5:0/1486400813 shutdown_connections 2024-08-17T02:23:33.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.564+0000 7f0678e00640 1 --2- 172.21.15.5:0/1486400813 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f06500650c0 0x7f0650067570 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:33.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.564+0000 7f0678e00640 1 --2- 172.21.15.5:0/1486400813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0674156c30 0x7f06741506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:33.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.564+0000 7f0678e00640 1 --2- 172.21.15.5:0/1486400813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0674156860 0x7f06740c4a50 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f065c00c5b0 tx=0x7f065c007f20 comp rx=0 tx=0).stop 2024-08-17T02:23:33.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.564+0000 7f0678e00640 1 --2- 172.21.15.5:0/1486400813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06740b10e0 0x7f067414a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:33.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.564+0000 7f0678e00640 1 -- 172.21.15.5:0/1486400813 >> 172.21.15.5:0/1486400813 conn(0x7f06740cb750 msgr2=0x7f0674157400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:33.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.564+0000 7f0678e00640 1 -- 172.21.15.5:0/1486400813 shutdown_connections 2024-08-17T02:23:33.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.564+0000 7f0678e00640 1 -- 172.21.15.5:0/1486400813 wait complete. 2024-08-17T02:23:33.585 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:23:33.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.745+0000 7f8280400640 1 Processor -- start 2024-08-17T02:23:33.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.745+0000 7f8280400640 1 -- start start 2024-08-17T02:23:33.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.746+0000 7f8280400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f82780ca050 0x7f8278156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:33.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.746+0000 7f8280400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82780add30 0x7f827815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:33.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.746+0000 7f8280400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827815b5e0 con 0x7f82780ad960 2024-08-17T02:23:33.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.746+0000 7f8280400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82780cb160 con 0x7f82780add30 2024-08-17T02:23:33.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.746+0000 7f8280400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82780b0d10 con 0x7f82780ca050 2024-08-17T02:23:33.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.747+0000 7f827da00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f82780ad960 0x7f8278156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56420/0 (socket says 172.21.15.5:56420) 2024-08-17T02:23:33.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.747+0000 7f827da00640 1 -- 172.21.15.5:0/1482297113 learned_addr learned my addr 172.21.15.5:0/1482297113 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:33.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.747+0000 7f827e400640 1 --2- 172.21.15.5:0/1482297113 >> v2:172.21.15.5:3300/0 conn(0x7f82780add30 0x7f827815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:33.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.747+0000 7f827d000640 1 --2- 172.21.15.5:0/1482297113 >> v2:172.21.15.87:3300/0 conn(0x7f82780ca050 0x7f8278156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:33.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.747+0000 7f8277e00640 1 -- 172.21.15.5:0/1482297113 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 528120717 0 0) 0x7f826c001110 con 0x7f82780ad960 2024-08-17T02:23:33.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.747+0000 7f8277e00640 1 -- 172.21.15.5:0/1482297113 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82600034e0 con 0x7f82780ad960 2024-08-17T02:23:33.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.747+0000 7f827e400640 1 -- 172.21.15.5:0/1482297113 >> v2:172.21.15.87:3300/0 conn(0x7f82780ca050 msgr2=0x7f8278156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:33.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.747+0000 7f827e400640 1 --2- 172.21.15.5:0/1482297113 >> v2:172.21.15.87:3300/0 conn(0x7f82780ca050 0x7f8278156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:33.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.747+0000 7f827e400640 1 -- 172.21.15.5:0/1482297113 >> v1:172.21.15.5:6789/0 conn(0x7f82780ad960 legacy=0x7f8278156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:33.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.747+0000 7f827e400640 1 -- 172.21.15.5:0/1482297113 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780ca550 con 0x7f82780add30 2024-08-17T02:23:33.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.748+0000 7f827e400640 1 --2- 172.21.15.5:0/1482297113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82780add30 0x7f827815b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8278063600 tx=0x7f8270009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d691ad9311f1d213 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:33.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.748+0000 7f8277e00640 1 -- 172.21.15.5:0/1482297113 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270007550 con 0x7f82780add30 2024-08-17T02:23:33.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.748+0000 7f8277e00640 1 -- 172.21.15.5:0/1482297113 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827002d050 con 0x7f82780add30 2024-08-17T02:23:33.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.748+0000 7f8277e00640 1 -- 172.21.15.5:0/1482297113 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270007900 con 0x7f82780add30 2024-08-17T02:23:33.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.749+0000 7f8280400640 1 -- 172.21.15.5:0/1482297113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82780add30 msgr2=0x7f827815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:33.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.749+0000 7f8280400640 1 --2- 172.21.15.5:0/1482297113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82780add30 0x7f827815b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8278063600 tx=0x7f8270009780 comp rx=0 tx=0).stop 2024-08-17T02:23:33.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.749+0000 7f8280400640 1 -- 172.21.15.5:0/1482297113 shutdown_connections 2024-08-17T02:23:33.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.749+0000 7f8280400640 1 --2- 172.21.15.5:0/1482297113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82780add30 0x7f827815b0a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:33.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.749+0000 7f8280400640 1 --2- 172.21.15.5:0/1482297113 >> v2:172.21.15.87:3300/0 conn(0x7f82780ca050 0x7f8278156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:33.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.749+0000 7f8280400640 1 -- 172.21.15.5:0/1482297113 >> 172.21.15.5:0/1482297113 conn(0x7f8278066e60 msgr2=0x7f8278067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:33.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.749+0000 7f8280400640 1 -- 172.21.15.5:0/1482297113 shutdown_connections 2024-08-17T02:23:33.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.749+0000 7f8280400640 1 -- 172.21.15.5:0/1482297113 wait complete. 2024-08-17T02:23:33.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.750+0000 7f8280400640 1 Processor -- start 2024-08-17T02:23:33.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.751+0000 7f8280400640 1 -- start start 2024-08-17T02:23:33.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.751+0000 7f8280400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82780ad960 0x7f82780a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:33.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.751+0000 7f8280400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82780add30 0x7f82781523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:33.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.751+0000 7f8280400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82780ca050 0x7f82781591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.751+0000 7f8280400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8278168b70 con 0x7f82780ca050 2024-08-17T02:23:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.752+0000 7f8280400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82780aa220 con 0x7f82780add30 2024-08-17T02:23:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.752+0000 7f8280400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82780ab1f0 con 0x7f82780ad960 2024-08-17T02:23:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.752+0000 7f827e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82780ca050 0x7f82781591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.752+0000 7f827e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82780ca050 0x7f82781591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58622/0 (socket says 172.21.15.5:58622) 2024-08-17T02:23:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.752+0000 7f827e400640 1 -- 172.21.15.5:0/265215623 learned_addr learned my addr 172.21.15.5:0/265215623 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.752+0000 7f827da00640 1 --2- 172.21.15.5:0/265215623 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82780ad960 0x7f82780a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.752+0000 7f827d000640 1 --2- 172.21.15.5:0/265215623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82780add30 0x7f82781523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.752+0000 7f827e400640 1 -- 172.21.15.5:0/265215623 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82780ad960 msgr2=0x7f82780a92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.752+0000 7f827e400640 1 --2- 172.21.15.5:0/265215623 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82780ad960 0x7f82780a92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.752+0000 7f827e400640 1 -- 172.21.15.5:0/265215623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82780add30 msgr2=0x7f82781523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:33.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.752+0000 7f827e400640 1 --2- 172.21.15.5:0/265215623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82780add30 0x7f82781523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:33.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.752+0000 7f827e400640 1 -- 172.21.15.5:0/265215623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8270009a20 con 0x7f82780ca050 2024-08-17T02:23:33.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.753+0000 7f827e400640 1 --2- 172.21.15.5:0/265215623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82780ca050 0x7f82781591f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f82700097c0 tx=0x7f8270037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:33.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.753+0000 7f8274c00640 1 -- 172.21.15.5:0/265215623 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270042070 con 0x7f82780ca050 2024-08-17T02:23:33.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.753+0000 7f8274c00640 1 -- 172.21.15.5:0/265215623 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8270031ac0 con 0x7f82780ca050 2024-08-17T02:23:33.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.753+0000 7f8274c00640 1 -- 172.21.15.5:0/265215623 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270031e80 con 0x7f82780ca050 2024-08-17T02:23:33.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.753+0000 7f8280400640 1 -- 172.21.15.5:0/265215623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82780a9980 con 0x7f82780ca050 2024-08-17T02:23:33.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.753+0000 7f8280400640 1 -- 172.21.15.5:0/265215623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82780a9f40 con 0x7f82780ca050 2024-08-17T02:23:33.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.754+0000 7f8280400640 1 -- 172.21.15.5:0/265215623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8278063fb0 con 0x7f82780ca050 2024-08-17T02:23:33.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.755+0000 7f8274c00640 1 -- 172.21.15.5:0/265215623 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8270003040 con 0x7f82780ca050 2024-08-17T02:23:33.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.756+0000 7f8274c00640 1 --2- 172.21.15.5:0/265215623 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8258065150 0x7f8258067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:33.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.756+0000 7f8274c00640 1 -- 172.21.15.5:0/265215623 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f82700a3580 con 0x7f82780ca050 2024-08-17T02:23:33.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.756+0000 7f827da00640 1 --2- 172.21.15.5:0/265215623 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8258065150 0x7f8258067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.756+0000 7f827da00640 1 --2- 172.21.15.5:0/265215623 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8258065150 0x7f8258067600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f826c001270 tx=0x7f826c000bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:33.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.760+0000 7f8274c00640 1 -- 172.21.15.5:0/265215623 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8270071830 con 0x7f82780ca050 2024-08-17T02:23:33.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:33.942+0000 7f8280400640 1 -- 172.21.15.5:0/265215623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f827806db60 con 0x7f82780ca050 2024-08-17T02:23:34.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.556+0000 7f8274c00640 1 -- 172.21.15.5:0/265215623 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8270074e50 con 0x7f82780ca050 2024-08-17T02:23:34.557 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-17T02:23:34.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.563+0000 7f8280400640 1 -- 172.21.15.5:0/265215623 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8258065150 msgr2=0x7f8258067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:34.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.563+0000 7f8280400640 1 --2- 172.21.15.5:0/265215623 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8258065150 0x7f8258067600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f826c001270 tx=0x7f826c000bc0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.563+0000 7f8280400640 1 -- 172.21.15.5:0/265215623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82780ca050 msgr2=0x7f82781591f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:34.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.563+0000 7f8280400640 1 --2- 172.21.15.5:0/265215623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82780ca050 0x7f82781591f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f82700097c0 tx=0x7f8270037000 comp rx=0 tx=0).stop 2024-08-17T02:23:34.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.564+0000 7f8280400640 1 -- 172.21.15.5:0/265215623 shutdown_connections 2024-08-17T02:23:34.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.564+0000 7f8280400640 1 --2- 172.21.15.5:0/265215623 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8258065150 0x7f8258067600 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.564+0000 7f8280400640 1 --2- 172.21.15.5:0/265215623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82780ca050 0x7f82781591f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.564+0000 7f8280400640 1 --2- 172.21.15.5:0/265215623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82780add30 0x7f82781523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.564+0000 7f8280400640 1 --2- 172.21.15.5:0/265215623 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82780ad960 0x7f82780a92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.564+0000 7f8280400640 1 -- 172.21.15.5:0/265215623 >> 172.21.15.5:0/265215623 conn(0x7f8278066e60 msgr2=0x7f82780cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:34.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.565+0000 7f8280400640 1 -- 172.21.15.5:0/265215623 shutdown_connections 2024-08-17T02:23:34.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.565+0000 7f8280400640 1 -- 172.21.15.5:0/265215623 wait complete. 2024-08-17T02:23:34.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:23:34.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.751+0000 7f37e1000640 1 Processor -- start 2024-08-17T02:23:34.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.751+0000 7f37e1000640 1 -- start start 2024-08-17T02:23:34.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.752+0000 7f37e1000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37dc158a20 0x7f37dc0a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:34.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.752+0000 7f37e1000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f37dc06dee0 0x7f37dc0afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:34.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.752+0000 7f37e1000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37dc0aed90 con 0x7f37dc0ae860 2024-08-17T02:23:34.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.752+0000 7f37e1000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37dc0af070 con 0x7f37dc06dee0 2024-08-17T02:23:34.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.752+0000 7f37e1000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0af350 con 0x7f37dc158a20 2024-08-17T02:23:34.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.753+0000 7f37d3e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f37dc0ae860 0x7f37dc06d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56428/0 (socket says 172.21.15.5:56428) 2024-08-17T02:23:34.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.753+0000 7f37d3e00640 1 -- 172.21.15.5:0/116124715 learned_addr learned my addr 172.21.15.5:0/116124715 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:34.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.753+0000 7f37da800640 1 --2- 172.21.15.5:0/116124715 >> v2:172.21.15.87:3300/0 conn(0x7f37dc06dee0 0x7f37dc0afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:34.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.753+0000 7f37d9e00640 1 --2- 172.21.15.5:0/116124715 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37dc158a20 0x7f37dc0a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.753+0000 7f37d9400640 1 -- 172.21.15.5:0/116124715 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294581172 0 0) 0x7f37dc0aed90 con 0x7f37dc0ae860 2024-08-17T02:23:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.753+0000 7f37d9400640 1 -- 172.21.15.5:0/116124715 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37c00034e0 con 0x7f37dc0ae860 2024-08-17T02:23:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.753+0000 7f37da800640 1 -- 172.21.15.5:0/116124715 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37dc158a20 msgr2=0x7f37dc0a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.753+0000 7f37da800640 1 --2- 172.21.15.5:0/116124715 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37dc158a20 0x7f37dc0a89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.753+0000 7f37da800640 1 -- 172.21.15.5:0/116124715 >> v1:172.21.15.5:6789/0 conn(0x7f37dc0ae860 legacy=0x7f37dc06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.753+0000 7f37da800640 1 -- 172.21.15.5:0/116124715 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc0af630 con 0x7f37dc06dee0 2024-08-17T02:23:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.755+0000 7f37da800640 1 --2- 172.21.15.5:0/116124715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37dc06dee0 0x7f37dc0afe30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009e60 tx=0x7f37d4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28385f9cf939a6f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.755+0000 7f37d9400640 1 -- 172.21.15.5:0/116124715 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4007550 con 0x7f37dc06dee0 2024-08-17T02:23:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.755+0000 7f37d9400640 1 -- 172.21.15.5:0/116124715 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d402d050 con 0x7f37dc06dee0 2024-08-17T02:23:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.755+0000 7f37d9400640 1 -- 172.21.15.5:0/116124715 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4007920 con 0x7f37dc06dee0 2024-08-17T02:23:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.755+0000 7f37e1000640 1 -- 172.21.15.5:0/116124715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37dc06dee0 msgr2=0x7f37dc0afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.755+0000 7f37e1000640 1 --2- 172.21.15.5:0/116124715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37dc06dee0 0x7f37dc0afe30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009e60 tx=0x7f37d4009780 comp rx=0 tx=0).stop 2024-08-17T02:23:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.755+0000 7f37e1000640 1 -- 172.21.15.5:0/116124715 shutdown_connections 2024-08-17T02:23:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.755+0000 7f37e1000640 1 --2- 172.21.15.5:0/116124715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37dc06dee0 0x7f37dc0afe30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.755+0000 7f37e1000640 1 --2- 172.21.15.5:0/116124715 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37dc158a20 0x7f37dc0a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.755+0000 7f37e1000640 1 -- 172.21.15.5:0/116124715 >> 172.21.15.5:0/116124715 conn(0x7f37dc066e60 msgr2=0x7f37dc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.756+0000 7f37e1000640 1 -- 172.21.15.5:0/116124715 shutdown_connections 2024-08-17T02:23:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.756+0000 7f37e1000640 1 -- 172.21.15.5:0/116124715 wait complete. 2024-08-17T02:23:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.757+0000 7f37e1000640 1 Processor -- start 2024-08-17T02:23:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.757+0000 7f37e1000640 1 -- start start 2024-08-17T02:23:34.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.758+0000 7f37e1000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37dc06dee0 0x7f37dc169d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:34.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.758+0000 7f37e1000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37dc0ae860 0x7f37dc0ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:34.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.758+0000 7f37e1000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37dc158a20 0x7f37dc14afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:34.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.758+0000 7f37e1000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc16a470 con 0x7f37dc06dee0 2024-08-17T02:23:34.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.758+0000 7f37e1000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc16a710 con 0x7f37dc0ae860 2024-08-17T02:23:34.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.758+0000 7f37e1000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc16a9f0 con 0x7f37dc158a20 2024-08-17T02:23:34.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.758+0000 7f37d9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37dc06dee0 0x7f37dc169d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:34.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.758+0000 7f37d9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37dc06dee0 0x7f37dc169d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58634/0 (socket says 172.21.15.5:58634) 2024-08-17T02:23:34.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.758+0000 7f37d9e00640 1 -- 172.21.15.5:0/1915412637 learned_addr learned my addr 172.21.15.5:0/1915412637 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:34.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.758+0000 7f37d3e00640 1 --2- 172.21.15.5:0/1915412637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37dc0ae860 0x7f37dc0ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:34.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.758+0000 7f37da800640 1 --2- 172.21.15.5:0/1915412637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37dc158a20 0x7f37dc14afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:34.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.759+0000 7f37d9e00640 1 -- 172.21.15.5:0/1915412637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37dc158a20 msgr2=0x7f37dc14afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:34.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.759+0000 7f37d9e00640 1 --2- 172.21.15.5:0/1915412637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37dc158a20 0x7f37dc14afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.759+0000 7f37d9e00640 1 -- 172.21.15.5:0/1915412637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37dc0ae860 msgr2=0x7f37dc0ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:34.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.759+0000 7f37d9e00640 1 --2- 172.21.15.5:0/1915412637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37dc0ae860 0x7f37dc0ad990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:34.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.759+0000 7f37d9e00640 1 -- 172.21.15.5:0/1915412637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d4009a20 con 0x7f37dc06dee0 2024-08-17T02:23:34.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.759+0000 7f37d3e00640 1 --2- 172.21.15.5:0/1915412637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37dc0ae860 0x7f37dc0ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:34.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.759+0000 7f37d9e00640 1 --2- 172.21.15.5:0/1915412637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37dc06dee0 0x7f37dc169d30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00e900 tx=0x7f37cc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:34.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.759+0000 7f37d1600640 1 -- 172.21.15.5:0/1915412637 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc00c8e0 con 0x7f37dc06dee0 2024-08-17T02:23:34.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.759+0000 7f37d1600640 1 -- 172.21.15.5:0/1915412637 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37cc00ca40 con 0x7f37dc06dee0 2024-08-17T02:23:34.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.759+0000 7f37d1600640 1 -- 172.21.15.5:0/1915412637 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc00cde0 con 0x7f37dc06dee0 2024-08-17T02:23:34.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.759+0000 7f37e1000640 1 -- 172.21.15.5:0/1915412637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37dc16acd0 con 0x7f37dc06dee0 2024-08-17T02:23:34.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.759+0000 7f37e1000640 1 -- 172.21.15.5:0/1915412637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37dc0aded0 con 0x7f37dc06dee0 2024-08-17T02:23:34.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.760+0000 7f37e1000640 1 -- 172.21.15.5:0/1915412637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37dc063fb0 con 0x7f37dc06dee0 2024-08-17T02:23:34.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.762+0000 7f37d1600640 1 -- 172.21.15.5:0/1915412637 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f37cc013680 con 0x7f37dc06dee0 2024-08-17T02:23:34.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.762+0000 7f37d1600640 1 --2- 172.21.15.5:0/1915412637 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f37b8065150 0x7f37b8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:34.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.762+0000 7f37d1600640 1 -- 172.21.15.5:0/1915412637 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f37cc082640 con 0x7f37dc06dee0 2024-08-17T02:23:34.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.763+0000 7f37d3e00640 1 --2- 172.21.15.5:0/1915412637 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f37b8065150 0x7f37b8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:34.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.763+0000 7f37d3e00640 1 --2- 172.21.15.5:0/1915412637 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f37b8065150 0x7f37b8067600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f37dc14f130 tx=0x7f37c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:34.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.767+0000 7f37d1600640 1 -- 172.21.15.5:0/1915412637 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f37cc050780 con 0x7f37dc06dee0 2024-08-17T02:23:34.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:34.985+0000 7f37e1000640 1 -- 172.21.15.5:0/1915412637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f37dc06e950 con 0x7f37dc06dee0 2024-08-17T02:23:35.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.580+0000 7f37d1600640 1 -- 172.21.15.5:0/1915412637 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f37cc053da0 con 0x7f37dc06dee0 2024-08-17T02:23:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:23:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.587+0000 7f37e1000640 1 -- 172.21.15.5:0/1915412637 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f37b8065150 msgr2=0x7f37b8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.587+0000 7f37e1000640 1 --2- 172.21.15.5:0/1915412637 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f37b8065150 0x7f37b8067600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f37dc14f130 tx=0x7f37c4009040 comp rx=0 tx=0).stop 2024-08-17T02:23:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.587+0000 7f37e1000640 1 -- 172.21.15.5:0/1915412637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37dc06dee0 msgr2=0x7f37dc169d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.587+0000 7f37e1000640 1 --2- 172.21.15.5:0/1915412637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37dc06dee0 0x7f37dc169d30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00e900 tx=0x7f37cc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.587+0000 7f37e1000640 1 -- 172.21.15.5:0/1915412637 shutdown_connections 2024-08-17T02:23:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.587+0000 7f37e1000640 1 --2- 172.21.15.5:0/1915412637 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f37b8065150 0x7f37b8067600 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.588+0000 7f37e1000640 1 --2- 172.21.15.5:0/1915412637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37dc158a20 0x7f37dc14afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.588+0000 7f37e1000640 1 --2- 172.21.15.5:0/1915412637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37dc0ae860 0x7f37dc0ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.588+0000 7f37e1000640 1 --2- 172.21.15.5:0/1915412637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37dc06dee0 0x7f37dc169d30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.588+0000 7f37e1000640 1 -- 172.21.15.5:0/1915412637 >> 172.21.15.5:0/1915412637 conn(0x7f37dc066e60 msgr2=0x7f37dc1541d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:35.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.589+0000 7f37e1000640 1 -- 172.21.15.5:0/1915412637 shutdown_connections 2024-08-17T02:23:35.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.589+0000 7f37e1000640 1 -- 172.21.15.5:0/1915412637 wait complete. 2024-08-17T02:23:35.618 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:35.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.772+0000 7fe539800640 1 Processor -- start 2024-08-17T02:23:35.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.772+0000 7fe539800640 1 -- start start 2024-08-17T02:23:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.773+0000 7fe539800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe534158d50 0x7fe5340ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.774+0000 7fe539800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe534159120 0x7fe5340ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.774+0000 7fe539800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5340a96c0 con 0x7fe5340ac9e0 2024-08-17T02:23:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.774+0000 7fe539800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5340acf00 con 0x7fe534158d50 2024-08-17T02:23:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.774+0000 7fe539800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5340af7d0 con 0x7fe534159120 2024-08-17T02:23:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.774+0000 7fe532a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe534158d50 0x7fe5340ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.774+0000 7fe532a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe534158d50 0x7fe5340ac4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58644/0 (socket says 172.21.15.5:58644) 2024-08-17T02:23:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.774+0000 7fe532a00640 1 -- 172.21.15.5:0/1334665642 learned_addr learned my addr 172.21.15.5:0/1334665642 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.774+0000 7fe52be00640 1 --2- 172.21.15.5:0/1334665642 >> v2:172.21.15.87:3300/0 conn(0x7fe534159120 0x7fe5340ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.774+0000 7fe532a00640 1 -- 172.21.15.5:0/1334665642 >> v2:172.21.15.87:3300/0 conn(0x7fe534159120 msgr2=0x7fe5340ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:35.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.774+0000 7fe532a00640 1 --2- 172.21.15.5:0/1334665642 >> v2:172.21.15.87:3300/0 conn(0x7fe534159120 0x7fe5340ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.774+0000 7fe532a00640 1 -- 172.21.15.5:0/1334665642 >> v1:172.21.15.87:6789/0 conn(0x7fe5340ac9e0 legacy=0x7fe534066e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.774+0000 7fe532a00640 1 -- 172.21.15.5:0/1334665642 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5340a98f0 con 0x7fe534158d50 2024-08-17T02:23:35.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.775+0000 7fe532a00640 1 --2- 172.21.15.5:0/1334665642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe534158d50 0x7fe5340ac4a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe5340cdab0 tx=0x7fe5240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363609535265278b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:35.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.776+0000 7fe532000640 1 -- 172.21.15.5:0/1334665642 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52402adf0 con 0x7fe534158d50 2024-08-17T02:23:35.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.776+0000 7fe532000640 1 -- 172.21.15.5:0/1334665642 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe524032440 con 0x7fe534158d50 2024-08-17T02:23:35.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.776+0000 7fe532000640 1 -- 172.21.15.5:0/1334665642 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524032820 con 0x7fe534158d50 2024-08-17T02:23:35.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.776+0000 7fe539800640 1 -- 172.21.15.5:0/1334665642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe534158d50 msgr2=0x7fe5340ac4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.776+0000 7fe539800640 1 --2- 172.21.15.5:0/1334665642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe534158d50 0x7fe5340ac4a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe5340cdab0 tx=0x7fe5240091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.776+0000 7fe539800640 1 -- 172.21.15.5:0/1334665642 shutdown_connections 2024-08-17T02:23:35.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.776+0000 7fe539800640 1 --2- 172.21.15.5:0/1334665642 >> v2:172.21.15.87:3300/0 conn(0x7fe534159120 0x7fe5340ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.776+0000 7fe539800640 1 --2- 172.21.15.5:0/1334665642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe534158d50 0x7fe5340ac4a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.776+0000 7fe539800640 1 -- 172.21.15.5:0/1334665642 >> 172.21.15.5:0/1334665642 conn(0x7fe534095a70 msgr2=0x7fe534095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:35.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.776+0000 7fe539800640 1 -- 172.21.15.5:0/1334665642 shutdown_connections 2024-08-17T02:23:35.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.776+0000 7fe539800640 1 -- 172.21.15.5:0/1334665642 wait complete. 2024-08-17T02:23:35.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.778+0000 7fe539800640 1 Processor -- start 2024-08-17T02:23:35.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.778+0000 7fe539800640 1 -- start start 2024-08-17T02:23:35.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.779+0000 7fe539800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5340ac9e0 0x7fe53416d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.779+0000 7fe539800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe534158d50 0x7fe5340cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.779+0000 7fe539800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe534159120 0x7fe534153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.779+0000 7fe539800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53416cdc0 con 0x7fe5340ac9e0 2024-08-17T02:23:35.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.779+0000 7fe539800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340cbb10 con 0x7fe534158d50 2024-08-17T02:23:35.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.779+0000 7fe539800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53415acd0 con 0x7fe534159120 2024-08-17T02:23:35.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.779+0000 7fe532a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5340ac9e0 0x7fe53416d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.779+0000 7fe532a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5340ac9e0 0x7fe53416d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58646/0 (socket says 172.21.15.5:58646) 2024-08-17T02:23:35.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.779+0000 7fe532a00640 1 -- 172.21.15.5:0/2007554115 learned_addr learned my addr 172.21.15.5:0/2007554115 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:35.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.779+0000 7fe532a00640 1 -- 172.21.15.5:0/2007554115 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe534159120 msgr2=0x7fe534153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.779+0000 7fe532a00640 1 --2- 172.21.15.5:0/2007554115 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe534159120 0x7fe534153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.779+0000 7fe532a00640 1 -- 172.21.15.5:0/2007554115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe534158d50 msgr2=0x7fe5340cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.779+0000 7fe532a00640 1 --2- 172.21.15.5:0/2007554115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe534158d50 0x7fe5340cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.779+0000 7fe532a00640 1 -- 172.21.15.5:0/2007554115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe524009450 con 0x7fe5340ac9e0 2024-08-17T02:23:35.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.780+0000 7fe532a00640 1 --2- 172.21.15.5:0/2007554115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5340ac9e0 0x7fe53416d250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe524009210 tx=0x7fe524032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:35.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.780+0000 7fe52a000640 1 -- 172.21.15.5:0/2007554115 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524031a60 con 0x7fe5340ac9e0 2024-08-17T02:23:35.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.780+0000 7fe52a000640 1 -- 172.21.15.5:0/2007554115 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe524031be0 con 0x7fe5340ac9e0 2024-08-17T02:23:35.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.780+0000 7fe539800640 1 -- 172.21.15.5:0/2007554115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe534096df0 con 0x7fe5340ac9e0 2024-08-17T02:23:35.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.780+0000 7fe52a000640 1 -- 172.21.15.5:0/2007554115 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52403d420 con 0x7fe5340ac9e0 2024-08-17T02:23:35.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.780+0000 7fe539800640 1 -- 172.21.15.5:0/2007554115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53416ca50 con 0x7fe5340ac9e0 2024-08-17T02:23:35.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.781+0000 7fe539800640 1 -- 172.21.15.5:0/2007554115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe534063fb0 con 0x7fe5340ac9e0 2024-08-17T02:23:35.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.782+0000 7fe52a000640 1 -- 172.21.15.5:0/2007554115 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe524039040 con 0x7fe5340ac9e0 2024-08-17T02:23:35.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.783+0000 7fe52a000640 1 --2- 172.21.15.5:0/2007554115 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe510065150 0x7fe510067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:35.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.783+0000 7fe52a000640 1 -- 172.21.15.5:0/2007554115 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe5240a24c0 con 0x7fe5340ac9e0 2024-08-17T02:23:35.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.783+0000 7fe52be00640 1 --2- 172.21.15.5:0/2007554115 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe510065150 0x7fe510067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:35.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.784+0000 7fe52be00640 1 --2- 172.21.15.5:0/2007554115 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe510065150 0x7fe510067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe5341566a0 tx=0x7fe51c0090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:35.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.787+0000 7fe52a000640 1 -- 172.21.15.5:0/2007554115 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe5240705a0 con 0x7fe5340ac9e0 2024-08-17T02:23:35.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.970+0000 7fe539800640 1 -- 172.21.15.5:0/2007554115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5340b28f0 con 0x7fe5340ac9e0 2024-08-17T02:23:35.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.971+0000 7fe52a000640 1 -- 172.21.15.5:0/2007554115 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15267 (secure 0 0 0) 0x7fe524073bc0 con 0x7fe5340ac9e0 2024-08-17T02:23:35.972 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:35.972 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:34.987105+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:32.642845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:33.982937+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:35.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.973+0000 7fe539800640 1 -- 172.21.15.5:0/2007554115 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe510065150 msgr2=0x7fe510067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.973+0000 7fe539800640 1 --2- 172.21.15.5:0/2007554115 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe510065150 0x7fe510067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe5341566a0 tx=0x7fe51c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.973+0000 7fe539800640 1 -- 172.21.15.5:0/2007554115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5340ac9e0 msgr2=0x7fe53416d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:35.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.973+0000 7fe539800640 1 --2- 172.21.15.5:0/2007554115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5340ac9e0 0x7fe53416d250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe524009210 tx=0x7fe524032000 comp rx=0 tx=0).stop 2024-08-17T02:23:35.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.973+0000 7fe539800640 1 -- 172.21.15.5:0/2007554115 shutdown_connections 2024-08-17T02:23:35.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.973+0000 7fe539800640 1 --2- 172.21.15.5:0/2007554115 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe510065150 0x7fe510067600 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.973+0000 7fe539800640 1 --2- 172.21.15.5:0/2007554115 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe534159120 0x7fe534153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.973+0000 7fe539800640 1 --2- 172.21.15.5:0/2007554115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe534158d50 0x7fe5340cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.973+0000 7fe539800640 1 --2- 172.21.15.5:0/2007554115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5340ac9e0 0x7fe53416d250 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:35.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.973+0000 7fe539800640 1 -- 172.21.15.5:0/2007554115 >> 172.21.15.5:0/2007554115 conn(0x7fe534095a70 msgr2=0x7fe53406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:35.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.973+0000 7fe539800640 1 -- 172.21.15.5:0/2007554115 shutdown_connections 2024-08-17T02:23:35.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:35.973+0000 7fe539800640 1 -- 172.21.15.5:0/2007554115 wait complete. 2024-08-17T02:23:35.989 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:36.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.140+0000 7fb605c00640 1 Processor -- start 2024-08-17T02:23:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.141+0000 7fb605c00640 1 -- start start 2024-08-17T02:23:36.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.142+0000 7fb605c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb60015a490 0x7fb6000ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.142+0000 7fb605c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6000b1920 0x7fb6000b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.142+0000 7fb605c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60015b6b0 con 0x7fb600158c60 2024-08-17T02:23:36.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.142+0000 7fb605c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6000b0540 con 0x7fb60015a490 2024-08-17T02:23:36.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.142+0000 7fb605c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60015a8b0 con 0x7fb6000b1920 2024-08-17T02:23:36.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.142+0000 7fb5ffe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb600158c60 0x7fb600159030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56430/0 (socket says 172.21.15.5:56430) 2024-08-17T02:23:36.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.142+0000 7fb5ffe00640 1 -- 172.21.15.5:0/3058760847 learned_addr learned my addr 172.21.15.5:0/3058760847 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:36.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.142+0000 7fb5f7e00640 1 --2- 172.21.15.5:0/3058760847 >> v2:172.21.15.87:3300/0 conn(0x7fb60015a490 0x7fb6000ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.142+0000 7fb605200640 1 --2- 172.21.15.5:0/3058760847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6000b1920 0x7fb6000b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.142+0000 7fb5ff400640 1 -- 172.21.15.5:0/3058760847 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96843109 0 0) 0x7fb60015b6b0 con 0x7fb600158c60 2024-08-17T02:23:36.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.143+0000 7fb5ff400640 1 -- 172.21.15.5:0/3058760847 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5e40034e0 con 0x7fb600158c60 2024-08-17T02:23:36.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.143+0000 7fb5ff400640 1 -- 172.21.15.5:0/3058760847 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3238256256 0 0) 0x7fb5e40034e0 con 0x7fb600158c60 2024-08-17T02:23:36.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.143+0000 7fb5ff400640 1 -- 172.21.15.5:0/3058760847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6000b1920 msgr2=0x7fb6000b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:36.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.143+0000 7fb5ff400640 1 --2- 172.21.15.5:0/3058760847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6000b1920 0x7fb6000b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.143+0000 7fb5ff400640 1 -- 172.21.15.5:0/3058760847 >> v2:172.21.15.87:3300/0 conn(0x7fb60015a490 msgr2=0x7fb6000ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:36.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.143+0000 7fb5ff400640 1 --2- 172.21.15.5:0/3058760847 >> v2:172.21.15.87:3300/0 conn(0x7fb60015a490 0x7fb6000ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.143+0000 7fb5ff400640 1 -- 172.21.15.5:0/3058760847 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60015aac0 con 0x7fb600158c60 2024-08-17T02:23:36.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.143+0000 7fb5ff400640 1 -- 172.21.15.5:0/3058760847 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2658686246 0 0) 0x7fb5f0001470 con 0x7fb600158c60 2024-08-17T02:23:36.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.143+0000 7fb5ff400640 1 -- 172.21.15.5:0/3058760847 >> v1:172.21.15.5:6789/0 conn(0x7fb600158c60 legacy=0x7fb600159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.143+0000 7fb5ff400640 1 --2- 172.21.15.5:0/3058760847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5e4003ac0 0x7fb5e4003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.143+0000 7fb5ff400640 1 --2- 172.21.15.5:0/3058760847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6000b1920 0x7fb5e4004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.143+0000 7fb5ff400640 1 --2- 172.21.15.5:0/3058760847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5e4004cc0 0x7fb5e4005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.143+0000 7fb5ff400640 1 -- 172.21.15.5:0/3058760847 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6000b0540 con 0x7fb5e4004cc0 2024-08-17T02:23:36.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.143+0000 7fb5ff400640 1 -- 172.21.15.5:0/3058760847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60015a8b0 con 0x7fb5e4003ac0 2024-08-17T02:23:36.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.143+0000 7fb5ff400640 1 -- 172.21.15.5:0/3058760847 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e400bb00 con 0x7fb6000b1920 2024-08-17T02:23:36.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.143+0000 7fb5ffe00640 1 --2- 172.21.15.5:0/3058760847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5e4003ac0 0x7fb5e4003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.143+0000 7fb605200640 1 --2- 172.21.15.5:0/3058760847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5e4004cc0 0x7fb5e4005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.143+0000 7fb5f7e00640 1 --2- 172.21.15.5:0/3058760847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6000b1920 0x7fb5e4004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.144+0000 7fb5ffe00640 1 -- 172.21.15.5:0/3058760847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6000b1920 msgr2=0x7fb5e4004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:36.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.144+0000 7fb5ffe00640 1 --2- 172.21.15.5:0/3058760847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6000b1920 0x7fb5e4004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.144+0000 7fb5ffe00640 1 -- 172.21.15.5:0/3058760847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5e4004cc0 msgr2=0x7fb5e4005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:36.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.144+0000 7fb5ffe00640 1 --2- 172.21.15.5:0/3058760847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5e4004cc0 0x7fb5e4005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.144+0000 7fb5ffe00640 1 -- 172.21.15.5:0/3058760847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e40034e0 con 0x7fb5e4003ac0 2024-08-17T02:23:36.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.144+0000 7fb605200640 1 --2- 172.21.15.5:0/3058760847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5e4004cc0 0x7fb5e4005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:36.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.145+0000 7fb5ffe00640 1 --2- 172.21.15.5:0/3058760847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5e4003ac0 0x7fb5e4003ed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000c240 tx=0x7fb5f0001dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6c3fd413f42d429 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:36.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.145+0000 7fb5ff400640 1 -- 172.21.15.5:0/3058760847 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0005890 con 0x7fb5e4003ac0 2024-08-17T02:23:36.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.145+0000 7fb5ff400640 1 -- 172.21.15.5:0/3058760847 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f0005a10 con 0x7fb5e4003ac0 2024-08-17T02:23:36.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.145+0000 7fb5ff400640 1 -- 172.21.15.5:0/3058760847 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0005e10 con 0x7fb5e4003ac0 2024-08-17T02:23:36.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.145+0000 7fb605c00640 1 -- 172.21.15.5:0/3058760847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5e4003ac0 msgr2=0x7fb5e4003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.145+0000 7fb605c00640 1 --2- 172.21.15.5:0/3058760847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5e4003ac0 0x7fb5e4003ed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000c240 tx=0x7fb5f0001dc0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.145+0000 7fb605200640 1 -- 172.21.15.5:0/3058760847 reap_dead start 2024-08-17T02:23:36.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.146+0000 7fb605c00640 1 -- 172.21.15.5:0/3058760847 shutdown_connections 2024-08-17T02:23:36.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.146+0000 7fb605c00640 1 -- 172.21.15.5:0/3058760847 >> 172.21.15.5:0/3058760847 conn(0x7fb60006e590 msgr2=0x7fb60006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:36.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.146+0000 7fb605c00640 1 -- 172.21.15.5:0/3058760847 shutdown_connections 2024-08-17T02:23:36.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.146+0000 7fb605c00640 1 -- 172.21.15.5:0/3058760847 wait complete. 2024-08-17T02:23:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.147+0000 7fb605c00640 1 Processor -- start 2024-08-17T02:23:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.147+0000 7fb605c00640 1 -- start start 2024-08-17T02:23:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.148+0000 7fb605c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5e4003ac0 0x7fb600152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.148+0000 7fb605c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6000c5ec0 0x7fb6000c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.148+0000 7fb605c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6000c6330 0x7fb6000c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.148+0000 7fb605c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb600168c90 con 0x7fb6000c5ec0 2024-08-17T02:23:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.148+0000 7fb605c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb600168f70 con 0x7fb5e4003ac0 2024-08-17T02:23:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.148+0000 7fb605c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb600169250 con 0x7fb6000c6330 2024-08-17T02:23:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.148+0000 7fb5f7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6000c5ec0 0x7fb6000c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.148+0000 7fb5f7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6000c5ec0 0x7fb6000c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58666/0 (socket says 172.21.15.5:58666) 2024-08-17T02:23:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.148+0000 7fb5f7e00640 1 -- 172.21.15.5:0/4084418323 learned_addr learned my addr 172.21.15.5:0/4084418323 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.148+0000 7fb5ffe00640 1 --2- 172.21.15.5:0/4084418323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5e4003ac0 0x7fb600152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.148+0000 7fb605200640 1 --2- 172.21.15.5:0/4084418323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6000c6330 0x7fb6000c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.149+0000 7fb5f7e00640 1 -- 172.21.15.5:0/4084418323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6000c6330 msgr2=0x7fb6000c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.149+0000 7fb5f7e00640 1 --2- 172.21.15.5:0/4084418323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6000c6330 0x7fb6000c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.149+0000 7fb5f7e00640 1 -- 172.21.15.5:0/4084418323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5e4003ac0 msgr2=0x7fb600152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.149+0000 7fb5f7e00640 1 --2- 172.21.15.5:0/4084418323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5e4003ac0 0x7fb600152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.149+0000 7fb5f7e00640 1 -- 172.21.15.5:0/4084418323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb600169530 con 0x7fb6000c5ec0 2024-08-17T02:23:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.149+0000 7fb5ffe00640 1 --2- 172.21.15.5:0/4084418323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5e4003ac0 0x7fb600152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.149+0000 7fb605200640 1 --2- 172.21.15.5:0/4084418323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6000c6330 0x7fb6000c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.149+0000 7fb5f7e00640 1 --2- 172.21.15.5:0/4084418323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6000c5ec0 0x7fb6000c7b90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8011b40 tx=0x7fb5e80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.149+0000 7fb5f7400640 1 -- 172.21.15.5:0/4084418323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e800fb00 con 0x7fb6000c5ec0 2024-08-17T02:23:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.149+0000 7fb5f7400640 1 -- 172.21.15.5:0/4084418323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e800fc60 con 0x7fb6000c5ec0 2024-08-17T02:23:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.149+0000 7fb5f7400640 1 -- 172.21.15.5:0/4084418323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8014440 con 0x7fb6000c5ec0 2024-08-17T02:23:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.149+0000 7fb605c00640 1 -- 172.21.15.5:0/4084418323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb600169a10 con 0x7fb6000c5ec0 2024-08-17T02:23:36.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.149+0000 7fb605c00640 1 -- 172.21.15.5:0/4084418323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6001689e0 con 0x7fb6000c5ec0 2024-08-17T02:23:36.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.150+0000 7fb605c00640 1 -- 172.21.15.5:0/4084418323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb600070720 con 0x7fb6000c5ec0 2024-08-17T02:23:36.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.151+0000 7fb5f7400640 1 -- 172.21.15.5:0/4084418323 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb5e80147f0 con 0x7fb6000c5ec0 2024-08-17T02:23:36.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.152+0000 7fb5f7400640 1 --2- 172.21.15.5:0/4084418323 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb5dc065150 0x7fb5dc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.153+0000 7fb5f7400640 1 -- 172.21.15.5:0/4084418323 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb5e8018030 con 0x7fb6000c5ec0 2024-08-17T02:23:36.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.153+0000 7fb5ffe00640 1 --2- 172.21.15.5:0/4084418323 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb5dc065150 0x7fb5dc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.153+0000 7fb5ffe00640 1 --2- 172.21.15.5:0/4084418323 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb5dc065150 0x7fb5dc067600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0032000 tx=0x7fb5f0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:36.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.157+0000 7fb5f7400640 1 -- 172.21.15.5:0/4084418323 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb5e8050f90 con 0x7fb6000c5ec0 2024-08-17T02:23:36.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.343+0000 7fb605c00640 1 -- 172.21.15.5:0/4084418323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6000c4760 con 0x7fb6000c5ec0 2024-08-17T02:23:36.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.344+0000 7fb5f7400640 1 -- 172.21.15.5:0/4084418323 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15267 (secure 0 0 0) 0x7fb5e8022020 con 0x7fb6000c5ec0 2024-08-17T02:23:36.345 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:36.345 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:34.987105+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:32.642845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:33.982937+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:36.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.346+0000 7fb605c00640 1 -- 172.21.15.5:0/4084418323 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb5dc065150 msgr2=0x7fb5dc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.346+0000 7fb605c00640 1 --2- 172.21.15.5:0/4084418323 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb5dc065150 0x7fb5dc067600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0032000 tx=0x7fb5f0030000 comp rx=0 tx=0).stop 2024-08-17T02:23:36.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.346+0000 7fb605c00640 1 -- 172.21.15.5:0/4084418323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6000c5ec0 msgr2=0x7fb6000c7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.346+0000 7fb605c00640 1 --2- 172.21.15.5:0/4084418323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6000c5ec0 0x7fb6000c7b90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8011b40 tx=0x7fb5e80090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.347+0000 7fb605c00640 1 -- 172.21.15.5:0/4084418323 shutdown_connections 2024-08-17T02:23:36.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.347+0000 7fb605c00640 1 --2- 172.21.15.5:0/4084418323 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb5dc065150 0x7fb5dc067600 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.347+0000 7fb605c00640 1 --2- 172.21.15.5:0/4084418323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6000c6330 0x7fb6000c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.347+0000 7fb605c00640 1 --2- 172.21.15.5:0/4084418323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6000c5ec0 0x7fb6000c7b90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.347+0000 7fb605c00640 1 --2- 172.21.15.5:0/4084418323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5e4003ac0 0x7fb600152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.347+0000 7fb605c00640 1 -- 172.21.15.5:0/4084418323 >> 172.21.15.5:0/4084418323 conn(0x7fb60006e590 msgr2=0x7fb6000b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:36.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.347+0000 7fb605c00640 1 -- 172.21.15.5:0/4084418323 shutdown_connections 2024-08-17T02:23:36.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.347+0000 7fb605c00640 1 -- 172.21.15.5:0/4084418323 wait complete. 2024-08-17T02:23:36.363 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:23:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.516+0000 7f81dda00640 1 Processor -- start 2024-08-17T02:23:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.517+0000 7f81dda00640 1 -- start start 2024-08-17T02:23:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.518+0000 7f81dda00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f81d81590b0 0x7f81d80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.518+0000 7f81dda00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f81d80acf10 0x7f81d8159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.518+0000 7f81dda00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d815a4e0 con 0x7f81d80afca0 2024-08-17T02:23:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.518+0000 7f81dda00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d80b0980 con 0x7f81d80acf10 2024-08-17T02:23:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.518+0000 7f81dda00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d80c92b0 con 0x7f81d81590b0 2024-08-17T02:23:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.518+0000 7f81d7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f81d80acf10 0x7f81d8159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.518+0000 7f81d7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f81d80acf10 0x7f81d8159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58668/0 (socket says 172.21.15.5:58668) 2024-08-17T02:23:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.518+0000 7f81d7400640 1 -- 172.21.15.5:0/2658019632 learned_addr learned my addr 172.21.15.5:0/2658019632 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.518+0000 7f81d6a00640 1 --1- 172.21.15.5:0/2658019632 >> v1:172.21.15.5:6789/0 conn(0x7f81d80afca0 0x7f81d81589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56436/0 (socket says 172.21.15.5:56436) 2024-08-17T02:23:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.518+0000 7f81ce000640 1 --2- 172.21.15.5:0/2658019632 >> v2:172.21.15.87:3300/0 conn(0x7f81d81590b0 0x7f81d80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.519+0000 7f81d7400640 1 -- 172.21.15.5:0/2658019632 >> v2:172.21.15.87:3300/0 conn(0x7f81d81590b0 msgr2=0x7f81d80b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.519+0000 7f81d7400640 1 --2- 172.21.15.5:0/2658019632 >> v2:172.21.15.87:3300/0 conn(0x7f81d81590b0 0x7f81d80b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.519+0000 7f81d7400640 1 -- 172.21.15.5:0/2658019632 >> v1:172.21.15.5:6789/0 conn(0x7f81d80afca0 legacy=0x7f81d81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.519+0000 7f81d7400640 1 -- 172.21.15.5:0/2658019632 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d80ad480 con 0x7f81d80acf10 2024-08-17T02:23:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.519+0000 7f81d6000640 1 -- 172.21.15.5:0/2658019632 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153560697 0 0) 0x7f81c8001110 con 0x7f81d80afca0 2024-08-17T02:23:36.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.520+0000 7f81d7400640 1 --2- 172.21.15.5:0/2658019632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d80acf10 0x7f81d8159fa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f81d80c83b0 tx=0x7f81d000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93ed57bd36b471d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:36.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.520+0000 7f81d6000640 1 -- 172.21.15.5:0/2658019632 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d000b2e0 con 0x7f81d80acf10 2024-08-17T02:23:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.520+0000 7f81d6000640 1 -- 172.21.15.5:0/2658019632 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d000b440 con 0x7f81d80acf10 2024-08-17T02:23:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.520+0000 7f81d6000640 1 -- 172.21.15.5:0/2658019632 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0009840 con 0x7f81d80acf10 2024-08-17T02:23:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.520+0000 7f81dda00640 1 -- 172.21.15.5:0/2658019632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d80acf10 msgr2=0x7f81d8159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.520+0000 7f81dda00640 1 --2- 172.21.15.5:0/2658019632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d80acf10 0x7f81d8159fa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f81d80c83b0 tx=0x7f81d000ba50 comp rx=0 tx=0).stop 2024-08-17T02:23:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.521+0000 7f81dda00640 1 -- 172.21.15.5:0/2658019632 shutdown_connections 2024-08-17T02:23:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.521+0000 7f81dda00640 1 --2- 172.21.15.5:0/2658019632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d80acf10 0x7f81d8159fa0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.521+0000 7f81dda00640 1 --2- 172.21.15.5:0/2658019632 >> v2:172.21.15.87:3300/0 conn(0x7f81d81590b0 0x7f81d80b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.521+0000 7f81dda00640 1 -- 172.21.15.5:0/2658019632 >> 172.21.15.5:0/2658019632 conn(0x7f81d8066e60 msgr2=0x7f81d8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.521+0000 7f81dda00640 1 -- 172.21.15.5:0/2658019632 shutdown_connections 2024-08-17T02:23:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.521+0000 7f81dda00640 1 -- 172.21.15.5:0/2658019632 wait complete. 2024-08-17T02:23:36.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.522+0000 7f81dda00640 1 Processor -- start 2024-08-17T02:23:36.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.522+0000 7f81dda00640 1 -- start start 2024-08-17T02:23:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.523+0000 7f81dda00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80acf10 0x7f81d81565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.523+0000 7f81dda00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81d80afca0 0x7f81d8156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.523+0000 7f81dda00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d81590b0 0x7f81d81691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.523+0000 7f81dda00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80a4810 con 0x7f81d81590b0 2024-08-17T02:23:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.523+0000 7f81dda00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d8157190 con 0x7f81d80afca0 2024-08-17T02:23:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.523+0000 7f81dda00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d8157470 con 0x7f81d80acf10 2024-08-17T02:23:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.523+0000 7f81d7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d81590b0 0x7f81d81691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.523+0000 7f81d7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d81590b0 0x7f81d81691b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58674/0 (socket says 172.21.15.5:58674) 2024-08-17T02:23:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.523+0000 7f81d7400640 1 -- 172.21.15.5:0/4041629581 learned_addr learned my addr 172.21.15.5:0/4041629581 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.523+0000 7f81d6a00640 1 --2- 172.21.15.5:0/4041629581 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80acf10 0x7f81d81565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.523+0000 7f81ce000640 1 --2- 172.21.15.5:0/4041629581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81d80afca0 0x7f81d8156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.524+0000 7f81d7400640 1 -- 172.21.15.5:0/4041629581 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80acf10 msgr2=0x7f81d81565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.524+0000 7f81d7400640 1 --2- 172.21.15.5:0/4041629581 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80acf10 0x7f81d81565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.524+0000 7f81d7400640 1 -- 172.21.15.5:0/4041629581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81d80afca0 msgr2=0x7f81d8156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.524+0000 7f81d7400640 1 --2- 172.21.15.5:0/4041629581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81d80afca0 0x7f81d8156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.524+0000 7f81d7400640 1 -- 172.21.15.5:0/4041629581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d000bcf0 con 0x7f81d81590b0 2024-08-17T02:23:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.524+0000 7f81d7400640 1 --2- 172.21.15.5:0/4041629581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d81590b0 0x7f81d81691b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f81d000d1d0 tx=0x7f81d0039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.524+0000 7f81cea00640 1 -- 172.21.15.5:0/4041629581 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0009380 con 0x7f81d81590b0 2024-08-17T02:23:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.524+0000 7f81cea00640 1 -- 172.21.15.5:0/4041629581 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d003f070 con 0x7f81d81590b0 2024-08-17T02:23:36.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.524+0000 7f81cea00640 1 -- 172.21.15.5:0/4041629581 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0044480 con 0x7f81d81590b0 2024-08-17T02:23:36.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.524+0000 7f81dda00640 1 -- 172.21.15.5:0/4041629581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d8157750 con 0x7f81d81590b0 2024-08-17T02:23:36.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.524+0000 7f81dda00640 1 -- 172.21.15.5:0/4041629581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d8157d10 con 0x7f81d81590b0 2024-08-17T02:23:36.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.525+0000 7f81dda00640 1 -- 172.21.15.5:0/4041629581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d806b750 con 0x7f81d81590b0 2024-08-17T02:23:36.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.526+0000 7f81cea00640 1 -- 172.21.15.5:0/4041629581 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f81d0041030 con 0x7f81d81590b0 2024-08-17T02:23:36.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.527+0000 7f81cea00640 1 --2- 172.21.15.5:0/4041629581 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f81b4065180 0x7f81b4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:36.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.527+0000 7f81cea00640 1 -- 172.21.15.5:0/4041629581 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f81d00a3cd0 con 0x7f81d81590b0 2024-08-17T02:23:36.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.527+0000 7f81d6a00640 1 --2- 172.21.15.5:0/4041629581 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f81b4065180 0x7f81b4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:36.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.528+0000 7f81d6a00640 1 --2- 172.21.15.5:0/4041629581 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f81b4065180 0x7f81b4067630 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f81c8007fd0 tx=0x7f81c8007b00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:36.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.531+0000 7f81cea00640 1 -- 172.21.15.5:0/4041629581 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f81d806b750 con 0x7f81d81590b0 2024-08-17T02:23:36.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:36.754+0000 7f81dda00640 1 -- 172.21.15.5:0/4041629581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f81d806b750 con 0x7f81d81590b0 2024-08-17T02:23:37.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.595+0000 7f81cea00640 1 -- 172.21.15.5:0/4041629581 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f81d806b750 con 0x7f81d81590b0 2024-08-17T02:23:37.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.598+0000 7f81dda00640 1 -- 172.21.15.5:0/4041629581 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f81b4065180 msgr2=0x7f81b4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:37.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.598+0000 7f81dda00640 1 --2- 172.21.15.5:0/4041629581 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f81b4065180 0x7f81b4067630 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f81c8007fd0 tx=0x7f81c8007b00 comp rx=0 tx=0).stop 2024-08-17T02:23:37.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.598+0000 7f81dda00640 1 -- 172.21.15.5:0/4041629581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d81590b0 msgr2=0x7f81d81691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:37.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.598+0000 7f81dda00640 1 --2- 172.21.15.5:0/4041629581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d81590b0 0x7f81d81691b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f81d000d1d0 tx=0x7f81d0039000 comp rx=0 tx=0).stop 2024-08-17T02:23:37.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.598+0000 7f81dda00640 1 -- 172.21.15.5:0/4041629581 shutdown_connections 2024-08-17T02:23:37.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.598+0000 7f81dda00640 1 --2- 172.21.15.5:0/4041629581 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f81b4065180 0x7f81b4067630 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.598+0000 7f81dda00640 1 --2- 172.21.15.5:0/4041629581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d81590b0 0x7f81d81691b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.598+0000 7f81dda00640 1 --2- 172.21.15.5:0/4041629581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81d80afca0 0x7f81d8156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.598+0000 7f81dda00640 1 --2- 172.21.15.5:0/4041629581 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80acf10 0x7f81d81565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.598+0000 7f81dda00640 1 -- 172.21.15.5:0/4041629581 >> 172.21.15.5:0/4041629581 conn(0x7f81d8066e60 msgr2=0x7f81d80cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:37.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.598+0000 7f81dda00640 1 -- 172.21.15.5:0/4041629581 shutdown_connections 2024-08-17T02:23:37.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.598+0000 7f81dda00640 1 -- 172.21.15.5:0/4041629581 wait complete. 2024-08-17T02:23:37.616 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:23:37.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.774+0000 7f89a9a00640 1 Processor -- start 2024-08-17T02:23:37.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.774+0000 7f89a9a00640 1 -- start start 2024-08-17T02:23:37.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.775+0000 7f89a9a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f89a40afca0 0x7f89a40b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:37.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.776+0000 7f89a9a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89a40acf10 0x7f89a4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:37.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.776+0000 7f89a9a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89a41589a0 0x7f89a4158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:37.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.776+0000 7f89a9a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a40b0980 con 0x7f89a41589a0 2024-08-17T02:23:37.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.776+0000 7f89a9a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a415a4e0 con 0x7f89a40afca0 2024-08-17T02:23:37.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.776+0000 7f89a9a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a40c92b0 con 0x7f89a40acf10 2024-08-17T02:23:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.776+0000 7f89a3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89a41589a0 0x7f89a4158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.776+0000 7f89a3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89a41589a0 0x7f89a4158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58690/0 (socket says 172.21.15.5:58690) 2024-08-17T02:23:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.776+0000 7f89a3400640 1 -- 172.21.15.5:0/3912557356 learned_addr learned my addr 172.21.15.5:0/3912557356 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.776+0000 7f89a2a00640 1 --2- 172.21.15.5:0/3912557356 >> v2:172.21.15.87:3300/0 conn(0x7f89a40afca0 0x7f89a40b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.776+0000 7f899be00640 1 --2- 172.21.15.5:0/3912557356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89a40acf10 0x7f89a4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.776+0000 7f89a3400640 1 -- 172.21.15.5:0/3912557356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89a40acf10 msgr2=0x7f89a4159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.776+0000 7f89a3400640 1 --2- 172.21.15.5:0/3912557356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89a40acf10 0x7f89a4159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.776+0000 7f89a3400640 1 -- 172.21.15.5:0/3912557356 >> v2:172.21.15.87:3300/0 conn(0x7f89a40afca0 msgr2=0x7f89a40b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.776+0000 7f89a3400640 1 --2- 172.21.15.5:0/3912557356 >> v2:172.21.15.87:3300/0 conn(0x7f89a40afca0 0x7f89a40b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.776+0000 7f89a3400640 1 -- 172.21.15.5:0/3912557356 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a4159360 con 0x7f89a41589a0 2024-08-17T02:23:37.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.777+0000 7f89a3400640 1 --2- 172.21.15.5:0/3912557356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a41589a0 0x7f89a4158e20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f899c009f20 tx=0x7f899c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ddb462a768573a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:37.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.777+0000 7f89a2000640 1 -- 172.21.15.5:0/3912557356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c031400 con 0x7f89a41589a0 2024-08-17T02:23:37.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.778+0000 7f89a2000640 1 -- 172.21.15.5:0/3912557356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899c02d050 con 0x7f89a41589a0 2024-08-17T02:23:37.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.778+0000 7f89a2000640 1 -- 172.21.15.5:0/3912557356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c0317d0 con 0x7f89a41589a0 2024-08-17T02:23:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.778+0000 7f89a9a00640 1 -- 172.21.15.5:0/3912557356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a41589a0 msgr2=0x7f89a4158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.778+0000 7f89a9a00640 1 --2- 172.21.15.5:0/3912557356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a41589a0 0x7f89a4158e20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f899c009f20 tx=0x7f899c009840 comp rx=0 tx=0).stop 2024-08-17T02:23:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.778+0000 7f89a9a00640 1 -- 172.21.15.5:0/3912557356 shutdown_connections 2024-08-17T02:23:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.778+0000 7f89a9a00640 1 --2- 172.21.15.5:0/3912557356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a41589a0 0x7f89a4158e20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.778+0000 7f89a9a00640 1 --2- 172.21.15.5:0/3912557356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89a40acf10 0x7f89a4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.778+0000 7f89a9a00640 1 --2- 172.21.15.5:0/3912557356 >> v2:172.21.15.87:3300/0 conn(0x7f89a40afca0 0x7f89a40b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.778+0000 7f89a9a00640 1 -- 172.21.15.5:0/3912557356 >> 172.21.15.5:0/3912557356 conn(0x7f89a4066e60 msgr2=0x7f89a4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.778+0000 7f89a9a00640 1 -- 172.21.15.5:0/3912557356 shutdown_connections 2024-08-17T02:23:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.778+0000 7f89a9a00640 1 -- 172.21.15.5:0/3912557356 wait complete. 2024-08-17T02:23:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.780+0000 7f89a9a00640 1 Processor -- start 2024-08-17T02:23:37.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.780+0000 7f89a9a00640 1 -- start start 2024-08-17T02:23:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.780+0000 7f89a9a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a40acf10 0x7f89a4157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.780+0000 7f89a9a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a40afca0 0x7f89a40c11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.780+0000 7f89a9a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89a41589a0 0x7f89a41650a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.780+0000 7f89a9a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a41584a0 con 0x7f89a40acf10 2024-08-17T02:23:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.780+0000 7f89a9a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a4157ad0 con 0x7f89a40afca0 2024-08-17T02:23:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.780+0000 7f89a9a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a414f280 con 0x7f89a41589a0 2024-08-17T02:23:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.781+0000 7f89a2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a40acf10 0x7f89a4157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.781+0000 7f89a2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a40acf10 0x7f89a4157f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58706/0 (socket says 172.21.15.5:58706) 2024-08-17T02:23:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.781+0000 7f89a2a00640 1 -- 172.21.15.5:0/2690469493 learned_addr learned my addr 172.21.15.5:0/2690469493 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.781+0000 7f899be00640 1 --2- 172.21.15.5:0/2690469493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a40afca0 0x7f89a40c11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:37.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.781+0000 7f89a3400640 1 --2- 172.21.15.5:0/2690469493 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89a41589a0 0x7f89a41650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:37.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.781+0000 7f89a2a00640 1 -- 172.21.15.5:0/2690469493 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89a41589a0 msgr2=0x7f89a41650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:37.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.781+0000 7f89a2a00640 1 --2- 172.21.15.5:0/2690469493 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89a41589a0 0x7f89a41650a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.781+0000 7f89a2a00640 1 -- 172.21.15.5:0/2690469493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a40afca0 msgr2=0x7f89a40c11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:37.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.781+0000 7f89a2a00640 1 --2- 172.21.15.5:0/2690469493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a40afca0 0x7f89a40c11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:37.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.781+0000 7f89a2a00640 1 -- 172.21.15.5:0/2690469493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c009ae0 con 0x7f89a40acf10 2024-08-17T02:23:37.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.781+0000 7f89a2a00640 1 --2- 172.21.15.5:0/2690469493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a40acf10 0x7f89a4157f60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f899400d890 tx=0x7f8994008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:37.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.782+0000 7f899a000640 1 -- 172.21.15.5:0/2690469493 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899400de20 con 0x7f89a40acf10 2024-08-17T02:23:37.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.782+0000 7f899a000640 1 -- 172.21.15.5:0/2690469493 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899400b8d0 con 0x7f89a40acf10 2024-08-17T02:23:37.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.782+0000 7f899a000640 1 -- 172.21.15.5:0/2690469493 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899400bc70 con 0x7f89a40acf10 2024-08-17T02:23:37.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.782+0000 7f89a9a00640 1 -- 172.21.15.5:0/2690469493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a4156ec0 con 0x7f89a40acf10 2024-08-17T02:23:37.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.782+0000 7f89a9a00640 1 -- 172.21.15.5:0/2690469493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a4157480 con 0x7f89a40acf10 2024-08-17T02:23:37.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.783+0000 7f89a9a00640 1 -- 172.21.15.5:0/2690469493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a40c8820 con 0x7f89a40acf10 2024-08-17T02:23:37.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.784+0000 7f899a000640 1 -- 172.21.15.5:0/2690469493 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8994014640 con 0x7f89a40acf10 2024-08-17T02:23:37.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.784+0000 7f899a000640 1 --2- 172.21.15.5:0/2690469493 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8980065180 0x7f8980067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.785+0000 7f899a000640 1 -- 172.21.15.5:0/2690469493 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f89940829c0 con 0x7f89a40acf10 2024-08-17T02:23:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.785+0000 7f899be00640 1 --2- 172.21.15.5:0/2690469493 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8980065180 0x7f8980067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.785+0000 7f899be00640 1 --2- 172.21.15.5:0/2690469493 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8980065180 0x7f8980067630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f89a4155160 tx=0x7f898c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:37.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:37.789+0000 7f899a000640 1 -- 172.21.15.5:0/2690469493 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f89a40c8820 con 0x7f89a40acf10 2024-08-17T02:23:38.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.009+0000 7f89a9a00640 1 -- 172.21.15.5:0/2690469493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f89a40c8820 con 0x7f89a40acf10 2024-08-17T02:23:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.596+0000 7f899a000640 1 -- 172.21.15.5:0/2690469493 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f89a40c8820 con 0x7f89a40acf10 2024-08-17T02:23:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.599+0000 7f89a9a00640 1 -- 172.21.15.5:0/2690469493 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8980065180 msgr2=0x7f8980067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.599+0000 7f89a9a00640 1 --2- 172.21.15.5:0/2690469493 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8980065180 0x7f8980067630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f89a4155160 tx=0x7f898c008040 comp rx=0 tx=0).stop 2024-08-17T02:23:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.599+0000 7f89a9a00640 1 -- 172.21.15.5:0/2690469493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a40acf10 msgr2=0x7f89a4157f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.599+0000 7f89a9a00640 1 --2- 172.21.15.5:0/2690469493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a40acf10 0x7f89a4157f60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f899400d890 tx=0x7f8994008040 comp rx=0 tx=0).stop 2024-08-17T02:23:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.599+0000 7f89a9a00640 1 -- 172.21.15.5:0/2690469493 shutdown_connections 2024-08-17T02:23:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.599+0000 7f89a9a00640 1 --2- 172.21.15.5:0/2690469493 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8980065180 0x7f8980067630 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.599+0000 7f89a9a00640 1 --2- 172.21.15.5:0/2690469493 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89a41589a0 0x7f89a41650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.599+0000 7f89a9a00640 1 --2- 172.21.15.5:0/2690469493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a40afca0 0x7f89a40c11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.599+0000 7f89a9a00640 1 --2- 172.21.15.5:0/2690469493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a40acf10 0x7f89a4157f60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.599+0000 7f89a9a00640 1 -- 172.21.15.5:0/2690469493 >> 172.21.15.5:0/2690469493 conn(0x7f89a4066e60 msgr2=0x7f89a40ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.599+0000 7f89a9a00640 1 -- 172.21.15.5:0/2690469493 shutdown_connections 2024-08-17T02:23:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.599+0000 7f89a9a00640 1 -- 172.21.15.5:0/2690469493 wait complete. 2024-08-17T02:23:38.616 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:23:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.771+0000 7f4f68800640 1 Processor -- start 2024-08-17T02:23:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.771+0000 7f4f68800640 1 -- start start 2024-08-17T02:23:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.772+0000 7f4f68800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4f600ad960 0x7f4f6015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.773+0000 7f4f68800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f600add30 0x7f4f60156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.773+0000 7f4f68800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6015b5e0 con 0x7f4f600ca050 2024-08-17T02:23:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.773+0000 7f4f68800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f600cb160 con 0x7f4f600add30 2024-08-17T02:23:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.773+0000 7f4f68800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f600b0d10 con 0x7f4f600ad960 2024-08-17T02:23:38.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.773+0000 7f4f66800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f600add30 0x7f4f60156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.773+0000 7f4f66800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f600add30 0x7f4f60156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58708/0 (socket says 172.21.15.5:58708) 2024-08-17T02:23:38.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.773+0000 7f4f66800640 1 -- 172.21.15.5:0/932331378 learned_addr learned my addr 172.21.15.5:0/932331378 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:38.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.773+0000 7f4f65e00640 1 --2- 172.21.15.5:0/932331378 >> v2:172.21.15.87:3300/0 conn(0x7f4f600ad960 0x7f4f6015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.773+0000 7f4f66800640 1 -- 172.21.15.5:0/932331378 >> v2:172.21.15.87:3300/0 conn(0x7f4f600ad960 msgr2=0x7f4f6015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:38.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.773+0000 7f4f66800640 1 --2- 172.21.15.5:0/932331378 >> v2:172.21.15.87:3300/0 conn(0x7f4f600ad960 0x7f4f6015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.773+0000 7f4f66800640 1 -- 172.21.15.5:0/932331378 >> v1:172.21.15.87:6789/0 conn(0x7f4f600ca050 legacy=0x7f4f60156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.773+0000 7f4f66800640 1 -- 172.21.15.5:0/932331378 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f600ca550 con 0x7f4f600add30 2024-08-17T02:23:38.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.774+0000 7f4f66800640 1 --2- 172.21.15.5:0/932331378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f600add30 0x7f4f60156b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4f600cc910 tx=0x7f4f5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3943dfb0c916fa34 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.775+0000 7f4f64a00640 1 -- 172.21.15.5:0/932331378 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c032470 con 0x7f4f600add30 2024-08-17T02:23:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.775+0000 7f4f64a00640 1 -- 172.21.15.5:0/932331378 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c0325d0 con 0x7f4f600add30 2024-08-17T02:23:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.775+0000 7f4f64a00640 1 -- 172.21.15.5:0/932331378 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c0329b0 con 0x7f4f600add30 2024-08-17T02:23:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.775+0000 7f4f68800640 1 -- 172.21.15.5:0/932331378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f600add30 msgr2=0x7f4f60156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.775+0000 7f4f68800640 1 --2- 172.21.15.5:0/932331378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f600add30 0x7f4f60156b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4f600cc910 tx=0x7f4f5c009840 comp rx=0 tx=0).stop 2024-08-17T02:23:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.775+0000 7f4f68800640 1 -- 172.21.15.5:0/932331378 shutdown_connections 2024-08-17T02:23:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.775+0000 7f4f68800640 1 --2- 172.21.15.5:0/932331378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f600add30 0x7f4f60156b30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.775+0000 7f4f68800640 1 --2- 172.21.15.5:0/932331378 >> v2:172.21.15.87:3300/0 conn(0x7f4f600ad960 0x7f4f6015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.775+0000 7f4f68800640 1 -- 172.21.15.5:0/932331378 >> 172.21.15.5:0/932331378 conn(0x7f4f60066e60 msgr2=0x7f4f60067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.775+0000 7f4f68800640 1 -- 172.21.15.5:0/932331378 shutdown_connections 2024-08-17T02:23:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.775+0000 7f4f68800640 1 -- 172.21.15.5:0/932331378 wait complete. 2024-08-17T02:23:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.777+0000 7f4f68800640 1 Processor -- start 2024-08-17T02:23:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.777+0000 7f4f68800640 1 -- start start 2024-08-17T02:23:38.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.778+0000 7f4f68800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f600ad960 0x7f4f60169a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.778+0000 7f4f68800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4f600add30 0x7f4f60152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.778+0000 7f4f68800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f600ca050 0x7f4f600ac730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.778+0000 7f4f68800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f60169f50 con 0x7f4f600ca050 2024-08-17T02:23:38.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.778+0000 7f4f68800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6014c9f0 con 0x7f4f600ad960 2024-08-17T02:23:38.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.778+0000 7f4f68800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600ab580 con 0x7f4f600add30 2024-08-17T02:23:38.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.778+0000 7f4f66800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f600ca050 0x7f4f600ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.778+0000 7f4f65e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f600ad960 0x7f4f60169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.778+0000 7f4f65e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f600ad960 0x7f4f60169a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:38396/0 (socket says 172.21.15.5:38396) 2024-08-17T02:23:38.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.778+0000 7f4f66800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f600ca050 0x7f4f600ac730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58714/0 (socket says 172.21.15.5:58714) 2024-08-17T02:23:38.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.778+0000 7f4f65e00640 1 -- 172.21.15.5:0/4197408768 learned_addr learned my addr 172.21.15.5:0/4197408768 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:38.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.778+0000 7f4f65400640 1 --2- 172.21.15.5:0/4197408768 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4f600add30 0x7f4f60152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.779+0000 7f4f66800640 1 -- 172.21.15.5:0/4197408768 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4f600add30 msgr2=0x7f4f60152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.779+0000 7f4f66800640 1 --2- 172.21.15.5:0/4197408768 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4f600add30 0x7f4f60152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.779+0000 7f4f66800640 1 -- 172.21.15.5:0/4197408768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f600ad960 msgr2=0x7f4f60169a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.779+0000 7f4f66800640 1 --2- 172.21.15.5:0/4197408768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f600ad960 0x7f4f60169a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.779+0000 7f4f66800640 1 -- 172.21.15.5:0/4197408768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c009ae0 con 0x7f4f600ca050 2024-08-17T02:23:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.779+0000 7f4f65e00640 1 --2- 172.21.15.5:0/4197408768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f600ad960 0x7f4f60169a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.779+0000 7f4f66800640 1 --2- 172.21.15.5:0/4197408768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f600ca050 0x7f4f600ac730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c031000 tx=0x7f4f5c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.779+0000 7f4f59600640 1 -- 172.21.15.5:0/4197408768 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c032470 con 0x7f4f600ca050 2024-08-17T02:23:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.779+0000 7f4f59600640 1 -- 172.21.15.5:0/4197408768 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c008e70 con 0x7f4f600ca050 2024-08-17T02:23:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.779+0000 7f4f59600640 1 -- 172.21.15.5:0/4197408768 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c03c620 con 0x7f4f600ca050 2024-08-17T02:23:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.779+0000 7f4f68800640 1 -- 172.21.15.5:0/4197408768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6016cae0 con 0x7f4f600ca050 2024-08-17T02:23:38.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.779+0000 7f4f68800640 1 -- 172.21.15.5:0/4197408768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6016d0a0 con 0x7f4f600ca050 2024-08-17T02:23:38.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.780+0000 7f4f68800640 1 -- 172.21.15.5:0/4197408768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f600ab730 con 0x7f4f600ca050 2024-08-17T02:23:38.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.781+0000 7f4f59600640 1 -- 172.21.15.5:0/4197408768 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4f5c039050 con 0x7f4f600ca050 2024-08-17T02:23:38.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.782+0000 7f4f59600640 1 --2- 172.21.15.5:0/4197408768 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4f44065150 0x7f4f44067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:38.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.782+0000 7f4f59600640 1 -- 172.21.15.5:0/4197408768 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f5c0a3860 con 0x7f4f600ca050 2024-08-17T02:23:38.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.782+0000 7f4f65e00640 1 --2- 172.21.15.5:0/4197408768 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4f44065150 0x7f4f44067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:38.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.783+0000 7f4f65e00640 1 --2- 172.21.15.5:0/4197408768 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4f44065150 0x7f4f44067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f540114c0 tx=0x7f4f540090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:38.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:38.786+0000 7f4f59600640 1 -- 172.21.15.5:0/4197408768 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4f5c071930 con 0x7f4f600ca050 2024-08-17T02:23:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.008+0000 7f4f68800640 1 -- 172.21.15.5:0/4197408768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f60063fb0 con 0x7f4f600ca050 2024-08-17T02:23:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.009+0000 7f4f59600640 1 -- 172.21.15.5:0/4197408768 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4582 (secure 0 0 0) 0x7f4f5c074f50 con 0x7f4f600ca050 2024-08-17T02:23:39.010 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:39.010 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/2870814974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2870814974},{"type":"v1","addr":"172.21.15.87:6834","nonce":2870814974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/508600504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":508600504},{"type":"v1","addr":"172.21.15.5:6835","nonce":508600504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3215918333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3215918333},{"type":"v1","addr":"172.21.15.5:6837","nonce":3215918333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:34.987476+0000","modified":"2024-08-17T02:23:38.593683+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/3443816405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3443816405},{"type":"v1","addr":"172.21.15.87:6835","nonce":3443816405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:23:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-08-17T02:23:39.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.011+0000 7f4f68800640 1 -- 172.21.15.5:0/4197408768 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4f44065150 msgr2=0x7f4f44067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:39.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.011+0000 7f4f68800640 1 --2- 172.21.15.5:0/4197408768 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4f44065150 0x7f4f44067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f540114c0 tx=0x7f4f540090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.011+0000 7f4f68800640 1 -- 172.21.15.5:0/4197408768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f600ca050 msgr2=0x7f4f600ac730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:39.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.011+0000 7f4f68800640 1 --2- 172.21.15.5:0/4197408768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f600ca050 0x7f4f600ac730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c031000 tx=0x7f4f5c037000 comp rx=0 tx=0).stop 2024-08-17T02:23:39.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.011+0000 7f4f68800640 1 -- 172.21.15.5:0/4197408768 shutdown_connections 2024-08-17T02:23:39.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.011+0000 7f4f68800640 1 --2- 172.21.15.5:0/4197408768 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4f44065150 0x7f4f44067600 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.011+0000 7f4f68800640 1 --2- 172.21.15.5:0/4197408768 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4f600add30 0x7f4f60152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.011+0000 7f4f68800640 1 --2- 172.21.15.5:0/4197408768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f600ca050 0x7f4f600ac730 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.011+0000 7f4f68800640 1 --2- 172.21.15.5:0/4197408768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f600ad960 0x7f4f60169a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.011+0000 7f4f68800640 1 -- 172.21.15.5:0/4197408768 >> 172.21.15.5:0/4197408768 conn(0x7f4f60066e60 msgr2=0x7f4f6006e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:39.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.011+0000 7f4f68800640 1 -- 172.21.15.5:0/4197408768 shutdown_connections 2024-08-17T02:23:39.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.011+0000 7f4f68800640 1 -- 172.21.15.5:0/4197408768 wait complete. 2024-08-17T02:23:39.027 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:39.040 INFO:tasks.ceph.mds.b.smithi087.stderr:2024-08-17T02:23:39.039+0000 7f82bba00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:23:39.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:23:39.085 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:23:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.179+0000 7fe52be00640 1 Processor -- start 2024-08-17T02:23:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.179+0000 7fe52be00640 1 -- start start 2024-08-17T02:23:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.180+0000 7fe52be00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe52c15a490 0x7fe52c0ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.180+0000 7fe52be00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe52c0b1920 0x7fe52c0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.180+0000 7fe52be00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe52c15a880 con 0x7fe52c158c60 2024-08-17T02:23:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.180+0000 7fe52be00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52c0b0540 con 0x7fe52c0b1920 2024-08-17T02:23:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.180+0000 7fe52be00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c15b6b0 con 0x7fe52c15a490 2024-08-17T02:23:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.180+0000 7fe52aa00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe52c158c60 0x7fe52c159030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56440/0 (socket says 172.21.15.5:56440) 2024-08-17T02:23:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.180+0000 7fe52aa00640 1 -- 172.21.15.5:0/2911632125 learned_addr learned my addr 172.21.15.5:0/2911632125 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:39.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe523e00640 1 --2- 172.21.15.5:0/2911632125 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe52c15a490 0x7fe52c0ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:39.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52b400640 1 --2- 172.21.15.5:0/2911632125 >> v2:172.21.15.87:3300/0 conn(0x7fe52c0b1920 0x7fe52c0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:39.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52a000640 1 -- 172.21.15.5:0/2911632125 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650382956 0 0) 0x7fe51c001110 con 0x7fe52c158c60 2024-08-17T02:23:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52a000640 1 -- 172.21.15.5:0/2911632125 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5100034e0 con 0x7fe52c158c60 2024-08-17T02:23:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52a000640 1 -- 172.21.15.5:0/2911632125 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2691769292 0 0) 0x7fe5100034e0 con 0x7fe52c158c60 2024-08-17T02:23:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52a000640 1 -- 172.21.15.5:0/2911632125 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe52c15a490 msgr2=0x7fe52c0ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52a000640 1 --2- 172.21.15.5:0/2911632125 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe52c15a490 0x7fe52c0ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52a000640 1 -- 172.21.15.5:0/2911632125 >> v2:172.21.15.87:3300/0 conn(0x7fe52c0b1920 msgr2=0x7fe52c0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52a000640 1 --2- 172.21.15.5:0/2911632125 >> v2:172.21.15.87:3300/0 conn(0x7fe52c0b1920 0x7fe52c0b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52a000640 1 -- 172.21.15.5:0/2911632125 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c15aac0 con 0x7fe52c158c60 2024-08-17T02:23:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52a000640 1 -- 172.21.15.5:0/2911632125 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2658686246 0 0) 0x7fe51c001600 con 0x7fe52c158c60 2024-08-17T02:23:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52a000640 1 -- 172.21.15.5:0/2911632125 >> v1:172.21.15.5:6789/0 conn(0x7fe52c158c60 legacy=0x7fe52c159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52a000640 1 --2- 172.21.15.5:0/2911632125 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe52c15a490 0x7fe510003a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52a000640 1 --2- 172.21.15.5:0/2911632125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe510003fc0 0x7fe510004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52a000640 1 --2- 172.21.15.5:0/2911632125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe510004cc0 0x7fe510005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:39.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52a000640 1 -- 172.21.15.5:0/2911632125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0b0540 con 0x7fe510004cc0 2024-08-17T02:23:39.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52a000640 1 -- 172.21.15.5:0/2911632125 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c15b6b0 con 0x7fe510003fc0 2024-08-17T02:23:39.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52a000640 1 -- 172.21.15.5:0/2911632125 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe51000ba80 con 0x7fe52c15a490 2024-08-17T02:23:39.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52b400640 1 --2- 172.21.15.5:0/2911632125 >> v2:172.21.15.87:3300/0 conn(0x7fe52c0b1920 0x7fe52c0b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:39.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52aa00640 1 --2- 172.21.15.5:0/2911632125 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe52c15a490 0x7fe510003a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:39.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe52b400640 1 --2- 172.21.15.5:0/2911632125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe510004cc0 0x7fe510005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:39.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.181+0000 7fe523e00640 1 --2- 172.21.15.5:0/2911632125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe510003fc0 0x7fe510004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:39.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.182+0000 7fe52b400640 1 -- 172.21.15.5:0/2911632125 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe52c15a490 msgr2=0x7fe510003a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:39.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.182+0000 7fe52b400640 1 --2- 172.21.15.5:0/2911632125 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe52c15a490 0x7fe510003a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.182+0000 7fe52b400640 1 -- 172.21.15.5:0/2911632125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe510003fc0 msgr2=0x7fe510004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:39.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.182+0000 7fe52b400640 1 --2- 172.21.15.5:0/2911632125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe510003fc0 0x7fe510004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.182+0000 7fe52b400640 1 -- 172.21.15.5:0/2911632125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5100034e0 con 0x7fe510004cc0 2024-08-17T02:23:39.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.182+0000 7fe52aa00640 1 --2- 172.21.15.5:0/2911632125 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe52c15a490 0x7fe510003a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:39.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.183+0000 7fe52b400640 1 --2- 172.21.15.5:0/2911632125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe510004cc0 0x7fe510005130 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe5240094d0 tx=0x7fe52400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2730116aeccf756d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:39.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.183+0000 7fe52a000640 1 -- 172.21.15.5:0/2911632125 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52402e440 con 0x7fe510004cc0 2024-08-17T02:23:39.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.183+0000 7fe52a000640 1 -- 172.21.15.5:0/2911632125 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52400f040 con 0x7fe510004cc0 2024-08-17T02:23:39.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.183+0000 7fe52a000640 1 -- 172.21.15.5:0/2911632125 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52402e7b0 con 0x7fe510004cc0 2024-08-17T02:23:39.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.184+0000 7fe52be00640 1 -- 172.21.15.5:0/2911632125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe510004cc0 msgr2=0x7fe510005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.184+0000 7fe52be00640 1 --2- 172.21.15.5:0/2911632125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe510004cc0 0x7fe510005130 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe5240094d0 tx=0x7fe52400b040 comp rx=0 tx=0).stop 2024-08-17T02:23:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.184+0000 7fe52b400640 1 -- 172.21.15.5:0/2911632125 reap_dead start 2024-08-17T02:23:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.184+0000 7fe52be00640 1 -- 172.21.15.5:0/2911632125 shutdown_connections 2024-08-17T02:23:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.184+0000 7fe52be00640 1 -- 172.21.15.5:0/2911632125 >> 172.21.15.5:0/2911632125 conn(0x7fe52c06e590 msgr2=0x7fe52c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.184+0000 7fe52be00640 1 -- 172.21.15.5:0/2911632125 shutdown_connections 2024-08-17T02:23:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.184+0000 7fe52be00640 1 -- 172.21.15.5:0/2911632125 wait complete. 2024-08-17T02:23:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.185+0000 7fe52be00640 1 Processor -- start 2024-08-17T02:23:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.185+0000 7fe52be00640 1 -- start start 2024-08-17T02:23:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.186+0000 7fe52be00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe510004cc0 0x7fe52c0c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.186+0000 7fe52be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe52c0c3610 0x7fe52c0c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.186+0000 7fe52be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe52c1574a0 0x7fe52c157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.186+0000 7fe52be00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0c5440 con 0x7fe52c0c3610 2024-08-17T02:23:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.186+0000 7fe52be00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0c4c50 con 0x7fe52c1574a0 2024-08-17T02:23:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.186+0000 7fe52be00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c157e50 con 0x7fe510004cc0 2024-08-17T02:23:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.186+0000 7fe523e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe52c0c3610 0x7fe52c0c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.186+0000 7fe523e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe52c0c3610 0x7fe52c0c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58742/0 (socket says 172.21.15.5:58742) 2024-08-17T02:23:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.186+0000 7fe523e00640 1 -- 172.21.15.5:0/2303171862 learned_addr learned my addr 172.21.15.5:0/2303171862 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.186+0000 7fe52aa00640 1 --2- 172.21.15.5:0/2303171862 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe510004cc0 0x7fe52c0c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.187+0000 7fe52b400640 1 --2- 172.21.15.5:0/2303171862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe52c1574a0 0x7fe52c157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.187+0000 7fe523e00640 1 -- 172.21.15.5:0/2303171862 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe510004cc0 msgr2=0x7fe52c0c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.187+0000 7fe523e00640 1 --2- 172.21.15.5:0/2303171862 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe510004cc0 0x7fe52c0c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.187+0000 7fe523e00640 1 -- 172.21.15.5:0/2303171862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe52c1574a0 msgr2=0x7fe52c157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.187+0000 7fe523e00640 1 --2- 172.21.15.5:0/2303171862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe52c1574a0 0x7fe52c157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.187+0000 7fe523e00640 1 -- 172.21.15.5:0/2303171862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c0c9210 con 0x7fe52c0c3610 2024-08-17T02:23:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.187+0000 7fe52aa00640 1 --2- 172.21.15.5:0/2303171862 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe510004cc0 0x7fe52c0c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.187+0000 7fe523e00640 1 --2- 172.21.15.5:0/2303171862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe52c0c3610 0x7fe52c0c8cd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe514011a90 tx=0x7fe5140090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.187+0000 7fe522000640 1 -- 172.21.15.5:0/2303171862 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51400fb00 con 0x7fe52c0c3610 2024-08-17T02:23:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.187+0000 7fe522000640 1 -- 172.21.15.5:0/2303171862 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51400fc60 con 0x7fe52c0c3610 2024-08-17T02:23:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.187+0000 7fe52be00640 1 -- 172.21.15.5:0/2303171862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52c0c3b80 con 0x7fe52c0c3610 2024-08-17T02:23:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.187+0000 7fe522000640 1 -- 172.21.15.5:0/2303171862 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe514014440 con 0x7fe52c0c3610 2024-08-17T02:23:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.188+0000 7fe52be00640 1 -- 172.21.15.5:0/2303171862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52c0c4140 con 0x7fe52c0c3610 2024-08-17T02:23:39.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.189+0000 7fe52be00640 1 -- 172.21.15.5:0/2303171862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52c070720 con 0x7fe52c0c3610 2024-08-17T02:23:39.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.189+0000 7fe522000640 1 -- 172.21.15.5:0/2303171862 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe514014870 con 0x7fe52c0c3610 2024-08-17T02:23:39.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.190+0000 7fe522000640 1 --2- 172.21.15.5:0/2303171862 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe508065150 0x7fe508067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:39.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.190+0000 7fe522000640 1 -- 172.21.15.5:0/2303171862 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe514018030 con 0x7fe52c0c3610 2024-08-17T02:23:39.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.191+0000 7fe52aa00640 1 --2- 172.21.15.5:0/2303171862 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe508065150 0x7fe508067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:39.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.191+0000 7fe52aa00640 1 --2- 172.21.15.5:0/2303171862 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe508065150 0x7fe508067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe51c001770 tx=0x7fe51c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:39.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.194+0000 7fe522000640 1 -- 172.21.15.5:0/2303171862 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe514050f70 con 0x7fe52c0c3610 2024-08-17T02:23:39.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.375+0000 7fe52be00640 1 -- 172.21.15.5:0/2303171862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe52c0cbd40 con 0x7fe52c0c3610 2024-08-17T02:23:39.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.376+0000 7fe522000640 1 -- 172.21.15.5:0/2303171862 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fe514022090 con 0x7fe52c0c3610 2024-08-17T02:23:39.377 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:39.377 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:36.575545+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:32.642845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:33.982937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:39.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.378+0000 7fe52be00640 1 -- 172.21.15.5:0/2303171862 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe508065150 msgr2=0x7fe508067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:39.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.378+0000 7fe52be00640 1 --2- 172.21.15.5:0/2303171862 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe508065150 0x7fe508067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe51c001770 tx=0x7fe51c009040 comp rx=0 tx=0).stop 2024-08-17T02:23:39.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.378+0000 7fe52be00640 1 -- 172.21.15.5:0/2303171862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe52c0c3610 msgr2=0x7fe52c0c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:39.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.378+0000 7fe52be00640 1 --2- 172.21.15.5:0/2303171862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe52c0c3610 0x7fe52c0c8cd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe514011a90 tx=0x7fe5140090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.378+0000 7fe52be00640 1 -- 172.21.15.5:0/2303171862 shutdown_connections 2024-08-17T02:23:39.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.378+0000 7fe52be00640 1 --2- 172.21.15.5:0/2303171862 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe508065150 0x7fe508067600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.378+0000 7fe52be00640 1 --2- 172.21.15.5:0/2303171862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe52c1574a0 0x7fe52c157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.378+0000 7fe52be00640 1 --2- 172.21.15.5:0/2303171862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe52c0c3610 0x7fe52c0c8cd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.378+0000 7fe52be00640 1 --2- 172.21.15.5:0/2303171862 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe510004cc0 0x7fe52c0c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.378+0000 7fe52be00640 1 -- 172.21.15.5:0/2303171862 >> 172.21.15.5:0/2303171862 conn(0x7fe52c06e590 msgr2=0x7fe52c0b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:39.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.378+0000 7fe52be00640 1 -- 172.21.15.5:0/2303171862 shutdown_connections 2024-08-17T02:23:39.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.378+0000 7fe52be00640 1 -- 172.21.15.5:0/2303171862 wait complete. 2024-08-17T02:23:39.393 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:23:39.394 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:23:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.583+0000 7fba84a00640 1 Processor -- start 2024-08-17T02:23:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.583+0000 7fba84a00640 1 -- start start 2024-08-17T02:23:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.584+0000 7fba84a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba801590b0 0x7fba800b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.584+0000 7fba84a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fba800acf10 0x7fba80159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.584+0000 7fba84a00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8015a4e0 con 0x7fba800afca0 2024-08-17T02:23:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.584+0000 7fba84a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba800b0980 con 0x7fba800acf10 2024-08-17T02:23:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.584+0000 7fba84a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba800c92b0 con 0x7fba801590b0 2024-08-17T02:23:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.585+0000 7fba7e800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fba800acf10 0x7fba80159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.585+0000 7fba77e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba801590b0 0x7fba800b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:39.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.585+0000 7fba7e800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fba800acf10 0x7fba80159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58752/0 (socket says 172.21.15.5:58752) 2024-08-17T02:23:39.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.585+0000 7fba7e800640 1 -- 172.21.15.5:0/2679316764 learned_addr learned my addr 172.21.15.5:0/2679316764 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:39.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.585+0000 7fba7de00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fba800afca0 0x7fba801589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:48926/0 (socket says 172.21.15.5:48926) 2024-08-17T02:23:39.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.585+0000 7fba7e800640 1 -- 172.21.15.5:0/2679316764 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba801590b0 msgr2=0x7fba800b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:39.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.585+0000 7fba7e800640 1 --2- 172.21.15.5:0/2679316764 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba801590b0 0x7fba800b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.585+0000 7fba7e800640 1 -- 172.21.15.5:0/2679316764 >> v1:172.21.15.87:6789/0 conn(0x7fba800afca0 legacy=0x7fba801589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:39.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.585+0000 7fba7d400640 1 -- 172.21.15.5:0/2679316764 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097622786 0 0) 0x7fba70001110 con 0x7fba800afca0 2024-08-17T02:23:39.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.585+0000 7fba7e800640 1 -- 172.21.15.5:0/2679316764 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba800ad480 con 0x7fba800acf10 2024-08-17T02:23:39.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.586+0000 7fba7e800640 1 --2- 172.21.15.5:0/2679316764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba800acf10 0x7fba80159fa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fba78009f20 tx=0x7fba78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64829c4ce3be02f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:39.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.586+0000 7fba7d400640 1 -- 172.21.15.5:0/2679316764 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78031400 con 0x7fba800acf10 2024-08-17T02:23:39.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.586+0000 7fba7d400640 1 -- 172.21.15.5:0/2679316764 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7802d050 con 0x7fba800acf10 2024-08-17T02:23:39.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.586+0000 7fba7d400640 1 -- 172.21.15.5:0/2679316764 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78031790 con 0x7fba800acf10 2024-08-17T02:23:39.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.587+0000 7fba84a00640 1 -- 172.21.15.5:0/2679316764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba800acf10 msgr2=0x7fba80159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:39.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.587+0000 7fba84a00640 1 --2- 172.21.15.5:0/2679316764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba800acf10 0x7fba80159fa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fba78009f20 tx=0x7fba78009840 comp rx=0 tx=0).stop 2024-08-17T02:23:39.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.587+0000 7fba84a00640 1 -- 172.21.15.5:0/2679316764 shutdown_connections 2024-08-17T02:23:39.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.587+0000 7fba84a00640 1 --2- 172.21.15.5:0/2679316764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba800acf10 0x7fba80159fa0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.587+0000 7fba84a00640 1 --2- 172.21.15.5:0/2679316764 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba801590b0 0x7fba800b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.587+0000 7fba84a00640 1 -- 172.21.15.5:0/2679316764 >> 172.21.15.5:0/2679316764 conn(0x7fba80066e60 msgr2=0x7fba80067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:39.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.587+0000 7fba84a00640 1 -- 172.21.15.5:0/2679316764 shutdown_connections 2024-08-17T02:23:39.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.587+0000 7fba84a00640 1 -- 172.21.15.5:0/2679316764 wait complete. 2024-08-17T02:23:39.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.588+0000 7fba84a00640 1 Processor -- start 2024-08-17T02:23:39.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.589+0000 7fba84a00640 1 -- start start 2024-08-17T02:23:39.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.589+0000 7fba84a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba800acf10 0x7fba801522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:39.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.589+0000 7fba84a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba800afca0 0x7fba800c3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:39.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.589+0000 7fba84a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba801590b0 0x7fba800c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:39.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.589+0000 7fba84a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba800c4730 con 0x7fba801590b0 2024-08-17T02:23:39.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.589+0000 7fba84a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba800c1e20 con 0x7fba800acf10 2024-08-17T02:23:39.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.589+0000 7fba84a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba800c4170 con 0x7fba800afca0 2024-08-17T02:23:39.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.590+0000 7fba7e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba801590b0 0x7fba800c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.590+0000 7fba7de00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba800acf10 0x7fba801522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.590+0000 7fba7e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba801590b0 0x7fba800c22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58766/0 (socket says 172.21.15.5:58766) 2024-08-17T02:23:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.590+0000 7fba7e800640 1 -- 172.21.15.5:0/887158265 learned_addr learned my addr 172.21.15.5:0/887158265 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.590+0000 7fba77e00640 1 --2- 172.21.15.5:0/887158265 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba800afca0 0x7fba800c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.590+0000 7fba7e800640 1 -- 172.21.15.5:0/887158265 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba800afca0 msgr2=0x7fba800c3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.590+0000 7fba7e800640 1 --2- 172.21.15.5:0/887158265 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba800afca0 0x7fba800c3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.590+0000 7fba7e800640 1 -- 172.21.15.5:0/887158265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba800acf10 msgr2=0x7fba801522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.590+0000 7fba7e800640 1 --2- 172.21.15.5:0/887158265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba800acf10 0x7fba801522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.590+0000 7fba7e800640 1 -- 172.21.15.5:0/887158265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba78009ae0 con 0x7fba801590b0 2024-08-17T02:23:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.590+0000 7fba7e800640 1 --2- 172.21.15.5:0/887158265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba801590b0 0x7fba800c22b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fba78009f20 tx=0x7fba78036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.591+0000 7fba75600640 1 -- 172.21.15.5:0/887158265 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78008770 con 0x7fba801590b0 2024-08-17T02:23:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.591+0000 7fba75600640 1 -- 172.21.15.5:0/887158265 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba780088d0 con 0x7fba801590b0 2024-08-17T02:23:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.591+0000 7fba75600640 1 -- 172.21.15.5:0/887158265 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78008c50 con 0x7fba801590b0 2024-08-17T02:23:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.591+0000 7fba84a00640 1 -- 172.21.15.5:0/887158265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba800c4450 con 0x7fba801590b0 2024-08-17T02:23:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.591+0000 7fba84a00640 1 -- 172.21.15.5:0/887158265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba80152810 con 0x7fba801590b0 2024-08-17T02:23:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.592+0000 7fba84a00640 1 -- 172.21.15.5:0/887158265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba800c1fb0 con 0x7fba801590b0 2024-08-17T02:23:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.592+0000 7fba75600640 1 -- 172.21.15.5:0/887158265 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fba78038050 con 0x7fba801590b0 2024-08-17T02:23:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.593+0000 7fba75600640 1 --2- 172.21.15.5:0/887158265 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fba5c065150 0x7fba5c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:39.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.593+0000 7fba75600640 1 -- 172.21.15.5:0/887158265 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba780a2cd0 con 0x7fba801590b0 2024-08-17T02:23:39.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.593+0000 7fba7de00640 1 --2- 172.21.15.5:0/887158265 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fba5c065150 0x7fba5c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:39.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.594+0000 7fba7de00640 1 --2- 172.21.15.5:0/887158265 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fba5c065150 0x7fba5c067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fba70007fd0 tx=0x7fba70007b00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:39.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.597+0000 7fba75600640 1 -- 172.21.15.5:0/887158265 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fba78070e60 con 0x7fba801590b0 2024-08-17T02:23:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.776+0000 7fba84a00640 1 -- 172.21.15.5:0/887158265 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba80063fb0 con 0x7fba5c065150 2024-08-17T02:23:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.785+0000 7fba75600640 1 -- 172.21.15.5:0/887158265 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264620 (secure 0 0 0) 0x7fba80063fb0 con 0x7fba5c065150 2024-08-17T02:23:39.788 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:39.790 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:23:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.789+0000 7fba84a00640 1 -- 172.21.15.5:0/887158265 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fba5c065150 msgr2=0x7fba5c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.789+0000 7fba84a00640 1 --2- 172.21.15.5:0/887158265 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fba5c065150 0x7fba5c067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fba70007fd0 tx=0x7fba70007b00 comp rx=0 tx=0).stop 2024-08-17T02:23:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.789+0000 7fba84a00640 1 -- 172.21.15.5:0/887158265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba801590b0 msgr2=0x7fba800c22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.789+0000 7fba84a00640 1 --2- 172.21.15.5:0/887158265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba801590b0 0x7fba800c22b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fba78009f20 tx=0x7fba78036000 comp rx=0 tx=0).stop 2024-08-17T02:23:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.789+0000 7fba84a00640 1 -- 172.21.15.5:0/887158265 shutdown_connections 2024-08-17T02:23:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.789+0000 7fba84a00640 1 --2- 172.21.15.5:0/887158265 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fba5c065150 0x7fba5c067600 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.789+0000 7fba84a00640 1 --2- 172.21.15.5:0/887158265 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba800afca0 0x7fba800c3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.789+0000 7fba84a00640 1 --2- 172.21.15.5:0/887158265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba801590b0 0x7fba800c22b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.789+0000 7fba84a00640 1 --2- 172.21.15.5:0/887158265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba800acf10 0x7fba801522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.789+0000 7fba84a00640 1 -- 172.21.15.5:0/887158265 >> 172.21.15.5:0/887158265 conn(0x7fba80066e60 msgr2=0x7fba800ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.789+0000 7fba84a00640 1 -- 172.21.15.5:0/887158265 shutdown_connections 2024-08-17T02:23:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.789+0000 7fba84a00640 1 -- 172.21.15.5:0/887158265 wait complete. 2024-08-17T02:23:39.805 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-08-17T02:23:38.720950+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398480,"kb_used_data":2972,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576240,"statfs":{"total":773094113280,"available":770638069760,"internally_reserved":0,"allocated":3043328,"data_stored":1807892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.170850"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596396+0000","last_change":"2024-08-17T02:23:35.589709+0000","last_active":"2024-08-17T02:23:35.596396+0000","last_peered":"2024-08-17T02:23:35.596396+0000","last_clean":"2024-08-17T02:23:35.596396+0000","last_became_active":"2024-08-17T02:23:35.589445+0000","last_became_peered":"2024-08-17T02:23:35.589445+0000","last_unstale":"2024-08-17T02:23:35.596396+0000","last_undegraded":"2024-08-17T02:23:35.596396+0000","last_fullsized":"2024-08-17T02:23:35.596396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:40.177968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.597886+0000","last_change":"2024-08-17T02:23:35.596541+0000","last_active":"2024-08-17T02:23:35.597886+0000","last_peered":"2024-08-17T02:23:35.597886+0000","last_clean":"2024-08-17T02:23:35.597886+0000","last_became_active":"2024-08-17T02:23:35.595984+0000","last_became_peered":"2024-08-17T02:23:35.595984+0000","last_unstale":"2024-08-17T02:23:35.597886+0000","last_undegraded":"2024-08-17T02:23:35.597886+0000","last_fullsized":"2024-08-17T02:23:35.597886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.592178+0000","last_change":"2024-08-17T02:23:35.589116+0000","last_active":"2024-08-17T02:23:35.592178+0000","last_peered":"2024-08-17T02:23:35.592178+0000","last_clean":"2024-08-17T02:23:35.592178+0000","last_became_active":"2024-08-17T02:23:35.588776+0000","last_became_peered":"2024-08-17T02:23:35.588776+0000","last_unstale":"2024-08-17T02:23:35.592178+0000","last_undegraded":"2024-08-17T02:23:35.592178+0000","last_fullsized":"2024-08-17T02:23:35.592178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604057+0000","last_change":"2024-08-17T02:23:35.597845+0000","last_active":"2024-08-17T02:23:35.604057+0000","last_peered":"2024-08-17T02:23:35.604057+0000","last_clean":"2024-08-17T02:23:35.604057+0000","last_became_active":"2024-08-17T02:23:35.593974+0000","last_became_peered":"2024-08-17T02:23:35.593974+0000","last_unstale":"2024-08-17T02:23:35.604057+0000","last_undegraded":"2024-08-17T02:23:35.604057+0000","last_fullsized":"2024-08-17T02:23:35.604057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:40.177968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596099+0000","last_change":"2024-08-17T02:23:35.592334+0000","last_active":"2024-08-17T02:23:35.596099+0000","last_peered":"2024-08-17T02:23:35.596099+0000","last_clean":"2024-08-17T02:23:35.596099+0000","last_became_active":"2024-08-17T02:23:35.591936+0000","last_became_peered":"2024-08-17T02:23:35.591936+0000","last_unstale":"2024-08-17T02:23:35.596099+0000","last_undegraded":"2024-08-17T02:23:35.596099+0000","last_fullsized":"2024-08-17T02:23:35.596099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:54:21.053209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605344+0000","last_change":"2024-08-17T02:23:35.601382+0000","last_active":"2024-08-17T02:23:35.605344+0000","last_peered":"2024-08-17T02:23:35.605344+0000","last_clean":"2024-08-17T02:23:35.605344+0000","last_became_active":"2024-08-17T02:23:35.600762+0000","last_became_peered":"2024-08-17T02:23:35.600762+0000","last_unstale":"2024-08-17T02:23:35.605344+0000","last_undegraded":"2024-08-17T02:23:35.605344+0000","last_fullsized":"2024-08-17T02:23:35.605344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:58.699491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.600889+0000","last_change":"2024-08-17T02:23:35.593406+0000","last_active":"2024-08-17T02:23:35.600889+0000","last_peered":"2024-08-17T02:23:35.600889+0000","last_clean":"2024-08-17T02:23:35.600889+0000","last_became_active":"2024-08-17T02:23:35.592939+0000","last_became_peered":"2024-08-17T02:23:35.592939+0000","last_unstale":"2024-08-17T02:23:35.600889+0000","last_undegraded":"2024-08-17T02:23:35.600889+0000","last_fullsized":"2024-08-17T02:23:35.600889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:58.163230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603257+0000","last_change":"2024-08-17T02:23:35.597151+0000","last_active":"2024-08-17T02:23:35.603257+0000","last_peered":"2024-08-17T02:23:35.603257+0000","last_clean":"2024-08-17T02:23:35.603257+0000","last_became_active":"2024-08-17T02:23:35.593461+0000","last_became_peered":"2024-08-17T02:23:35.593461+0000","last_unstale":"2024-08-17T02:23:35.603257+0000","last_undegraded":"2024-08-17T02:23:35.603257+0000","last_fullsized":"2024-08-17T02:23:35.603257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:04:25.119433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.601168+0000","last_change":"2024-08-17T02:23:35.598033+0000","last_active":"2024-08-17T02:23:35.601168+0000","last_peered":"2024-08-17T02:23:35.601168+0000","last_clean":"2024-08-17T02:23:35.601168+0000","last_became_active":"2024-08-17T02:23:35.595752+0000","last_became_peered":"2024-08-17T02:23:35.595752+0000","last_unstale":"2024-08-17T02:23:35.601168+0000","last_undegraded":"2024-08-17T02:23:35.601168+0000","last_fullsized":"2024-08-17T02:23:35.601168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:23:53.610539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.595948+0000","last_change":"2024-08-17T02:23:35.592023+0000","last_active":"2024-08-17T02:23:35.595948+0000","last_peered":"2024-08-17T02:23:35.595948+0000","last_clean":"2024-08-17T02:23:35.595948+0000","last_became_active":"2024-08-17T02:23:35.591200+0000","last_became_peered":"2024-08-17T02:23:35.591200+0000","last_unstale":"2024-08-17T02:23:35.595948+0000","last_undegraded":"2024-08-17T02:23:35.595948+0000","last_fullsized":"2024-08-17T02:23:35.595948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.600098+0000","last_change":"2024-08-17T02:23:35.596390+0000","last_active":"2024-08-17T02:23:35.600098+0000","last_peered":"2024-08-17T02:23:35.600098+0000","last_clean":"2024-08-17T02:23:35.600098+0000","last_became_active":"2024-08-17T02:23:35.596157+0000","last_became_peered":"2024-08-17T02:23:35.596157+0000","last_unstale":"2024-08-17T02:23:35.600098+0000","last_undegraded":"2024-08-17T02:23:35.600098+0000","last_fullsized":"2024-08-17T02:23:35.600098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.592637+0000","last_change":"2024-08-17T02:23:35.582359+0000","last_active":"2024-08-17T02:23:35.592637+0000","last_peered":"2024-08-17T02:23:35.592637+0000","last_clean":"2024-08-17T02:23:35.592637+0000","last_became_active":"2024-08-17T02:23:35.581946+0000","last_became_peered":"2024-08-17T02:23:35.581946+0000","last_unstale":"2024-08-17T02:23:35.592637+0000","last_undegraded":"2024-08-17T02:23:35.592637+0000","last_fullsized":"2024-08-17T02:23:35.592637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:27:42.753023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.590492+0000","last_change":"2024-08-17T02:23:35.587890+0000","last_active":"2024-08-17T02:23:35.590492+0000","last_peered":"2024-08-17T02:23:35.590492+0000","last_clean":"2024-08-17T02:23:35.590492+0000","last_became_active":"2024-08-17T02:23:35.585585+0000","last_became_peered":"2024-08-17T02:23:35.585585+0000","last_unstale":"2024-08-17T02:23:35.590492+0000","last_undegraded":"2024-08-17T02:23:35.590492+0000","last_fullsized":"2024-08-17T02:23:35.590492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603716+0000","last_change":"2024-08-17T02:23:35.596596+0000","last_active":"2024-08-17T02:23:35.603716+0000","last_peered":"2024-08-17T02:23:35.603716+0000","last_clean":"2024-08-17T02:23:35.603716+0000","last_became_active":"2024-08-17T02:23:35.596293+0000","last_became_peered":"2024-08-17T02:23:35.596293+0000","last_unstale":"2024-08-17T02:23:35.603716+0000","last_undegraded":"2024-08-17T02:23:35.603716+0000","last_fullsized":"2024-08-17T02:23:35.603716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:25:10.908502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.580252+0000","last_change":"2024-08-17T02:23:35.576127+0000","last_active":"2024-08-17T02:23:35.580252+0000","last_peered":"2024-08-17T02:23:35.580252+0000","last_clean":"2024-08-17T02:23:35.580252+0000","last_became_active":"2024-08-17T02:23:35.575812+0000","last_became_peered":"2024-08-17T02:23:35.575812+0000","last_unstale":"2024-08-17T02:23:35.580252+0000","last_undegraded":"2024-08-17T02:23:35.580252+0000","last_fullsized":"2024-08-17T02:23:35.580252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604727+0000","last_change":"2024-08-17T02:23:35.598920+0000","last_active":"2024-08-17T02:23:35.604727+0000","last_peered":"2024-08-17T02:23:35.604727+0000","last_clean":"2024-08-17T02:23:35.604727+0000","last_became_active":"2024-08-17T02:23:35.598446+0000","last_became_peered":"2024-08-17T02:23:35.598446+0000","last_unstale":"2024-08-17T02:23:35.604727+0000","last_undegraded":"2024-08-17T02:23:35.604727+0000","last_fullsized":"2024-08-17T02:23:35.604727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:44.471490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603819+0000","last_change":"2024-08-17T02:23:35.597673+0000","last_active":"2024-08-17T02:23:35.603819+0000","last_peered":"2024-08-17T02:23:35.603819+0000","last_clean":"2024-08-17T02:23:35.603819+0000","last_became_active":"2024-08-17T02:23:35.596284+0000","last_became_peered":"2024-08-17T02:23:35.596284+0000","last_unstale":"2024-08-17T02:23:35.603819+0000","last_undegraded":"2024-08-17T02:23:35.603819+0000","last_fullsized":"2024-08-17T02:23:35.603819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.586639+0000","last_change":"2024-08-17T02:23:35.581433+0000","last_active":"2024-08-17T02:23:35.586639+0000","last_peered":"2024-08-17T02:23:35.586639+0000","last_clean":"2024-08-17T02:23:35.586639+0000","last_became_active":"2024-08-17T02:23:35.581150+0000","last_became_peered":"2024-08-17T02:23:35.581150+0000","last_unstale":"2024-08-17T02:23:35.586639+0000","last_undegraded":"2024-08-17T02:23:35.586639+0000","last_fullsized":"2024-08-17T02:23:35.586639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:19:09.314565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596841+0000","last_change":"2024-08-17T02:23:35.590432+0000","last_active":"2024-08-17T02:23:35.596841+0000","last_peered":"2024-08-17T02:23:35.596841+0000","last_clean":"2024-08-17T02:23:35.596841+0000","last_became_active":"2024-08-17T02:23:35.590171+0000","last_became_peered":"2024-08-17T02:23:35.590171+0000","last_unstale":"2024-08-17T02:23:35.596841+0000","last_undegraded":"2024-08-17T02:23:35.596841+0000","last_fullsized":"2024-08-17T02:23:35.596841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:44.471490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.581293+0000","last_change":"2024-08-17T02:23:35.576756+0000","last_active":"2024-08-17T02:23:35.581293+0000","last_peered":"2024-08-17T02:23:35.581293+0000","last_clean":"2024-08-17T02:23:35.581293+0000","last_became_active":"2024-08-17T02:23:35.575447+0000","last_became_peered":"2024-08-17T02:23:35.575447+0000","last_unstale":"2024-08-17T02:23:35.581293+0000","last_undegraded":"2024-08-17T02:23:35.581293+0000","last_fullsized":"2024-08-17T02:23:35.581293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:53.414346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.598137+0000","last_change":"2024-08-17T02:23:35.592931+0000","last_active":"2024-08-17T02:23:35.598137+0000","last_peered":"2024-08-17T02:23:35.598137+0000","last_clean":"2024-08-17T02:23:35.598137+0000","last_became_active":"2024-08-17T02:23:35.592658+0000","last_became_peered":"2024-08-17T02:23:35.592658+0000","last_unstale":"2024-08-17T02:23:35.598137+0000","last_undegraded":"2024-08-17T02:23:35.598137+0000","last_fullsized":"2024-08-17T02:23:35.598137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:53.892837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604091+0000","last_change":"2024-08-17T02:23:35.597950+0000","last_active":"2024-08-17T02:23:35.604091+0000","last_peered":"2024-08-17T02:23:35.604091+0000","last_clean":"2024-08-17T02:23:35.604091+0000","last_became_active":"2024-08-17T02:23:35.597671+0000","last_became_peered":"2024-08-17T02:23:35.597671+0000","last_unstale":"2024-08-17T02:23:35.604091+0000","last_undegraded":"2024-08-17T02:23:35.604091+0000","last_fullsized":"2024-08-17T02:23:35.604091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:47.878023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603319+0000","last_change":"2024-08-17T02:23:35.598952+0000","last_active":"2024-08-17T02:23:35.603319+0000","last_peered":"2024-08-17T02:23:35.603319+0000","last_clean":"2024-08-17T02:23:35.603319+0000","last_became_active":"2024-08-17T02:23:35.598602+0000","last_became_peered":"2024-08-17T02:23:35.598602+0000","last_unstale":"2024-08-17T02:23:35.603319+0000","last_undegraded":"2024-08-17T02:23:35.603319+0000","last_fullsized":"2024-08-17T02:23:35.603319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:16.596695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604477+0000","last_change":"2024-08-17T02:23:35.594022+0000","last_active":"2024-08-17T02:23:35.604477+0000","last_peered":"2024-08-17T02:23:35.604477+0000","last_clean":"2024-08-17T02:23:35.604477+0000","last_became_active":"2024-08-17T02:23:35.593747+0000","last_became_peered":"2024-08-17T02:23:35.593747+0000","last_unstale":"2024-08-17T02:23:35.604477+0000","last_undegraded":"2024-08-17T02:23:35.604477+0000","last_fullsized":"2024-08-17T02:23:35.604477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:30.865202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605226+0000","last_change":"2024-08-17T02:23:35.601823+0000","last_active":"2024-08-17T02:23:35.605226+0000","last_peered":"2024-08-17T02:23:35.605226+0000","last_clean":"2024-08-17T02:23:35.605226+0000","last_became_active":"2024-08-17T02:23:35.594672+0000","last_became_peered":"2024-08-17T02:23:35.594672+0000","last_unstale":"2024-08-17T02:23:35.605226+0000","last_undegraded":"2024-08-17T02:23:35.605226+0000","last_fullsized":"2024-08-17T02:23:35.605226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:30.865202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596800+0000","last_change":"2024-08-17T02:23:35.594464+0000","last_active":"2024-08-17T02:23:35.596800+0000","last_peered":"2024-08-17T02:23:35.596800+0000","last_clean":"2024-08-17T02:23:35.596800+0000","last_became_active":"2024-08-17T02:23:35.594132+0000","last_became_peered":"2024-08-17T02:23:35.594132+0000","last_unstale":"2024-08-17T02:23:35.596800+0000","last_undegraded":"2024-08-17T02:23:35.596800+0000","last_fullsized":"2024-08-17T02:23:35.596800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:16.596695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.587445+0000","last_change":"2024-08-17T02:23:35.584046+0000","last_active":"2024-08-17T02:23:35.587445+0000","last_peered":"2024-08-17T02:23:35.587445+0000","last_clean":"2024-08-17T02:23:35.587445+0000","last_became_active":"2024-08-17T02:23:35.583501+0000","last_became_peered":"2024-08-17T02:23:35.583501+0000","last_unstale":"2024-08-17T02:23:35.587445+0000","last_undegraded":"2024-08-17T02:23:35.587445+0000","last_fullsized":"2024-08-17T02:23:35.587445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603996+0000","last_change":"2024-08-17T02:23:35.601673+0000","last_active":"2024-08-17T02:23:35.603996+0000","last_peered":"2024-08-17T02:23:35.603996+0000","last_clean":"2024-08-17T02:23:35.603996+0000","last_became_active":"2024-08-17T02:23:35.600053+0000","last_became_peered":"2024-08-17T02:23:35.600053+0000","last_unstale":"2024-08-17T02:23:35.603996+0000","last_undegraded":"2024-08-17T02:23:35.603996+0000","last_fullsized":"2024-08-17T02:23:35.603996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603669+0000","last_change":"2024-08-17T02:23:35.596895+0000","last_active":"2024-08-17T02:23:35.603669+0000","last_peered":"2024-08-17T02:23:35.603669+0000","last_clean":"2024-08-17T02:23:35.603669+0000","last_became_active":"2024-08-17T02:23:35.596357+0000","last_became_peered":"2024-08-17T02:23:35.596357+0000","last_unstale":"2024-08-17T02:23:35.603669+0000","last_undegraded":"2024-08-17T02:23:35.603669+0000","last_fullsized":"2024-08-17T02:23:35.603669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:16.596695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604107+0000","last_change":"2024-08-17T02:23:35.598186+0000","last_active":"2024-08-17T02:23:35.604107+0000","last_peered":"2024-08-17T02:23:35.604107+0000","last_clean":"2024-08-17T02:23:35.604107+0000","last_became_active":"2024-08-17T02:23:35.597916+0000","last_became_peered":"2024-08-17T02:23:35.597916+0000","last_unstale":"2024-08-17T02:23:35.604107+0000","last_undegraded":"2024-08-17T02:23:35.604107+0000","last_fullsized":"2024-08-17T02:23:35.604107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:58.163230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.595983+0000","last_change":"2024-08-17T02:23:35.592760+0000","last_active":"2024-08-17T02:23:35.595983+0000","last_peered":"2024-08-17T02:23:35.595983+0000","last_clean":"2024-08-17T02:23:35.595983+0000","last_became_active":"2024-08-17T02:23:35.592422+0000","last_became_peered":"2024-08-17T02:23:35.592422+0000","last_unstale":"2024-08-17T02:23:35.595983+0000","last_undegraded":"2024-08-17T02:23:35.595983+0000","last_fullsized":"2024-08-17T02:23:35.595983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:14.018866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604612+0000","last_change":"2024-08-17T02:23:35.597586+0000","last_active":"2024-08-17T02:23:35.604612+0000","last_peered":"2024-08-17T02:23:35.604612+0000","last_clean":"2024-08-17T02:23:35.604612+0000","last_became_active":"2024-08-17T02:23:35.597307+0000","last_became_peered":"2024-08-17T02:23:35.597307+0000","last_unstale":"2024-08-17T02:23:35.604612+0000","last_undegraded":"2024-08-17T02:23:35.604612+0000","last_fullsized":"2024-08-17T02:23:35.604612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596676+0000","last_change":"2024-08-17T02:23:35.590260+0000","last_active":"2024-08-17T02:23:35.596676+0000","last_peered":"2024-08-17T02:23:35.596676+0000","last_clean":"2024-08-17T02:23:35.596676+0000","last_became_active":"2024-08-17T02:23:35.585495+0000","last_became_peered":"2024-08-17T02:23:35.585495+0000","last_unstale":"2024-08-17T02:23:35.596676+0000","last_undegraded":"2024-08-17T02:23:35.596676+0000","last_fullsized":"2024-08-17T02:23:35.596676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:21.900954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.608774+0000","last_change":"2024-08-17T02:23:34.577323+0000","last_active":"2024-08-17T02:23:35.608774+0000","last_peered":"2024-08-17T02:23:35.608774+0000","last_clean":"2024-08-17T02:23:35.608774+0000","last_became_active":"2024-08-17T02:23:34.577034+0000","last_became_peered":"2024-08-17T02:23:34.577034+0000","last_unstale":"2024-08-17T02:23:35.608774+0000","last_undegraded":"2024-08-17T02:23:35.608774+0000","last_fullsized":"2024-08-17T02:23:35.608774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:29.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603650+0000","last_change":"2024-08-17T02:23:35.596697+0000","last_active":"2024-08-17T02:23:35.603650+0000","last_peered":"2024-08-17T02:23:35.603650+0000","last_clean":"2024-08-17T02:23:35.603650+0000","last_became_active":"2024-08-17T02:23:35.595923+0000","last_became_peered":"2024-08-17T02:23:35.595923+0000","last_unstale":"2024-08-17T02:23:35.603650+0000","last_undegraded":"2024-08-17T02:23:35.603650+0000","last_fullsized":"2024-08-17T02:23:35.603650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:08:23.329877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.613478+0000","last_change":"2024-08-17T02:23:34.572025+0000","last_active":"2024-08-17T02:23:35.613478+0000","last_peered":"2024-08-17T02:23:35.613478+0000","last_clean":"2024-08-17T02:23:35.613478+0000","last_became_active":"2024-08-17T02:23:34.571705+0000","last_became_peered":"2024-08-17T02:23:34.571705+0000","last_unstale":"2024-08-17T02:23:35.613478+0000","last_undegraded":"2024-08-17T02:23:35.613478+0000","last_fullsized":"2024-08-17T02:23:35.613478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.576708+0000","last_change":"2024-08-17T02:23:34.580257+0000","last_active":"2024-08-17T02:23:35.576708+0000","last_peered":"2024-08-17T02:23:35.576708+0000","last_clean":"2024-08-17T02:23:35.576708+0000","last_became_active":"2024-08-17T02:23:34.579936+0000","last_became_peered":"2024-08-17T02:23:34.579936+0000","last_unstale":"2024-08-17T02:23:35.576708+0000","last_undegraded":"2024-08-17T02:23:35.576708+0000","last_fullsized":"2024-08-17T02:23:35.576708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:05:52.667388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603279+0000","last_change":"2024-08-17T02:23:35.597773+0000","last_active":"2024-08-17T02:23:35.603279+0000","last_peered":"2024-08-17T02:23:35.603279+0000","last_clean":"2024-08-17T02:23:35.603279+0000","last_became_active":"2024-08-17T02:23:35.597536+0000","last_became_peered":"2024-08-17T02:23:35.597536+0000","last_unstale":"2024-08-17T02:23:35.603279+0000","last_undegraded":"2024-08-17T02:23:35.603279+0000","last_fullsized":"2024-08-17T02:23:35.603279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:25:10.908502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583113+0000","last_change":"2024-08-17T02:23:34.577723+0000","last_active":"2024-08-17T02:23:35.583113+0000","last_peered":"2024-08-17T02:23:35.583113+0000","last_clean":"2024-08-17T02:23:35.583113+0000","last_became_active":"2024-08-17T02:23:34.577455+0000","last_became_peered":"2024-08-17T02:23:34.577455+0000","last_unstale":"2024-08-17T02:23:35.583113+0000","last_undegraded":"2024-08-17T02:23:35.583113+0000","last_fullsized":"2024-08-17T02:23:35.583113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:29.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.595349+0000","last_change":"2024-08-17T02:23:35.593879+0000","last_active":"2024-08-17T02:23:35.595349+0000","last_peered":"2024-08-17T02:23:35.595349+0000","last_clean":"2024-08-17T02:23:35.595349+0000","last_became_active":"2024-08-17T02:23:35.593445+0000","last_became_peered":"2024-08-17T02:23:35.593445+0000","last_unstale":"2024-08-17T02:23:35.595349+0000","last_undegraded":"2024-08-17T02:23:35.595349+0000","last_fullsized":"2024-08-17T02:23:35.595349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:53.892837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.571971+0000","last_change":"2024-08-17T02:23:34.579703+0000","last_active":"2024-08-17T02:23:35.571971+0000","last_peered":"2024-08-17T02:23:35.571971+0000","last_clean":"2024-08-17T02:23:35.571971+0000","last_became_active":"2024-08-17T02:23:34.579430+0000","last_became_peered":"2024-08-17T02:23:34.579430+0000","last_unstale":"2024-08-17T02:23:35.571971+0000","last_undegraded":"2024-08-17T02:23:35.571971+0000","last_fullsized":"2024-08-17T02:23:35.571971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:00.835021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603795+0000","last_change":"2024-08-17T02:23:35.596266+0000","last_active":"2024-08-17T02:23:35.603795+0000","last_peered":"2024-08-17T02:23:35.603795+0000","last_clean":"2024-08-17T02:23:35.603795+0000","last_became_active":"2024-08-17T02:23:35.593899+0000","last_became_peered":"2024-08-17T02:23:35.593899+0000","last_unstale":"2024-08-17T02:23:35.603795+0000","last_undegraded":"2024-08-17T02:23:35.603795+0000","last_fullsized":"2024-08-17T02:23:35.603795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:10.629891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.585770+0000","last_change":"2024-08-17T02:23:34.579638+0000","last_active":"2024-08-17T02:23:35.585770+0000","last_peered":"2024-08-17T02:23:35.585770+0000","last_clean":"2024-08-17T02:23:35.585770+0000","last_became_active":"2024-08-17T02:23:34.579374+0000","last_became_peered":"2024-08-17T02:23:34.579374+0000","last_unstale":"2024-08-17T02:23:35.585770+0000","last_undegraded":"2024-08-17T02:23:35.585770+0000","last_fullsized":"2024-08-17T02:23:35.585770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:28.453656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603912+0000","last_change":"2024-08-17T02:23:35.599779+0000","last_active":"2024-08-17T02:23:35.603912+0000","last_peered":"2024-08-17T02:23:35.603912+0000","last_clean":"2024-08-17T02:23:35.603912+0000","last_became_active":"2024-08-17T02:23:35.599431+0000","last_became_peered":"2024-08-17T02:23:35.599431+0000","last_unstale":"2024-08-17T02:23:35.603912+0000","last_undegraded":"2024-08-17T02:23:35.603912+0000","last_fullsized":"2024-08-17T02:23:35.603912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.610216+0000","last_change":"2024-08-17T02:23:34.587150+0000","last_active":"2024-08-17T02:23:35.610216+0000","last_peered":"2024-08-17T02:23:35.610216+0000","last_clean":"2024-08-17T02:23:35.610216+0000","last_became_active":"2024-08-17T02:23:34.586406+0000","last_became_peered":"2024-08-17T02:23:34.586406+0000","last_unstale":"2024-08-17T02:23:35.610216+0000","last_undegraded":"2024-08-17T02:23:35.610216+0000","last_fullsized":"2024-08-17T02:23:35.610216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:29:02.697073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.602428+0000","last_change":"2024-08-17T02:23:35.594894+0000","last_active":"2024-08-17T02:23:35.602428+0000","last_peered":"2024-08-17T02:23:35.602428+0000","last_clean":"2024-08-17T02:23:35.602428+0000","last_became_active":"2024-08-17T02:23:35.593967+0000","last_became_peered":"2024-08-17T02:23:35.593967+0000","last_unstale":"2024-08-17T02:23:35.602428+0000","last_undegraded":"2024-08-17T02:23:35.602428+0000","last_fullsized":"2024-08-17T02:23:35.602428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:13.277984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615851+0000","last_change":"2024-08-17T02:23:34.586772+0000","last_active":"2024-08-17T02:23:35.615851+0000","last_peered":"2024-08-17T02:23:35.615851+0000","last_clean":"2024-08-17T02:23:35.615851+0000","last_became_active":"2024-08-17T02:23:34.586079+0000","last_became_peered":"2024-08-17T02:23:34.586079+0000","last_unstale":"2024-08-17T02:23:35.615851+0000","last_undegraded":"2024-08-17T02:23:35.615851+0000","last_fullsized":"2024-08-17T02:23:35.615851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.606223+0000","last_change":"2024-08-17T02:23:35.603795+0000","last_active":"2024-08-17T02:23:35.606223+0000","last_peered":"2024-08-17T02:23:35.606223+0000","last_clean":"2024-08-17T02:23:35.606223+0000","last_became_active":"2024-08-17T02:23:35.603063+0000","last_became_peered":"2024-08-17T02:23:35.603063+0000","last_unstale":"2024-08-17T02:23:35.606223+0000","last_undegraded":"2024-08-17T02:23:35.606223+0000","last_fullsized":"2024-08-17T02:23:35.606223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:04:25.119433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.618735+0000","last_change":"2024-08-17T02:23:34.574467+0000","last_active":"2024-08-17T02:23:35.618735+0000","last_peered":"2024-08-17T02:23:35.618735+0000","last_clean":"2024-08-17T02:23:35.618735+0000","last_became_active":"2024-08-17T02:23:34.569946+0000","last_became_peered":"2024-08-17T02:23:34.569946+0000","last_unstale":"2024-08-17T02:23:35.618735+0000","last_undegraded":"2024-08-17T02:23:35.618735+0000","last_fullsized":"2024-08-17T02:23:35.618735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:20:34.979718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.598102+0000","last_change":"2024-08-17T02:23:35.592294+0000","last_active":"2024-08-17T02:23:35.598102+0000","last_peered":"2024-08-17T02:23:35.598102+0000","last_clean":"2024-08-17T02:23:35.598102+0000","last_became_active":"2024-08-17T02:23:35.591912+0000","last_became_peered":"2024-08-17T02:23:35.591912+0000","last_unstale":"2024-08-17T02:23:35.598102+0000","last_undegraded":"2024-08-17T02:23:35.598102+0000","last_fullsized":"2024-08-17T02:23:35.598102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:53.414346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583563+0000","last_change":"2024-08-17T02:23:34.587458+0000","last_active":"2024-08-17T02:23:35.583563+0000","last_peered":"2024-08-17T02:23:35.583563+0000","last_clean":"2024-08-17T02:23:35.583563+0000","last_became_active":"2024-08-17T02:23:34.587141+0000","last_became_peered":"2024-08-17T02:23:34.587141+0000","last_unstale":"2024-08-17T02:23:35.583563+0000","last_undegraded":"2024-08-17T02:23:35.583563+0000","last_fullsized":"2024-08-17T02:23:35.583563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605470+0000","last_change":"2024-08-17T02:23:35.601716+0000","last_active":"2024-08-17T02:23:35.605470+0000","last_peered":"2024-08-17T02:23:35.605470+0000","last_clean":"2024-08-17T02:23:35.605470+0000","last_became_active":"2024-08-17T02:23:35.600481+0000","last_became_peered":"2024-08-17T02:23:35.600481+0000","last_unstale":"2024-08-17T02:23:35.605470+0000","last_undegraded":"2024-08-17T02:23:35.605470+0000","last_fullsized":"2024-08-17T02:23:35.605470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:57:57.262402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.571127+0000","last_change":"2024-08-17T02:23:34.572877+0000","last_active":"2024-08-17T02:23:35.571127+0000","last_peered":"2024-08-17T02:23:35.571127+0000","last_clean":"2024-08-17T02:23:35.571127+0000","last_became_active":"2024-08-17T02:23:34.572606+0000","last_became_peered":"2024-08-17T02:23:34.572606+0000","last_unstale":"2024-08-17T02:23:35.571127+0000","last_undegraded":"2024-08-17T02:23:35.571127+0000","last_fullsized":"2024-08-17T02:23:35.571127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:28.453656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596192+0000","last_change":"2024-08-17T02:23:35.590217+0000","last_active":"2024-08-17T02:23:35.596192+0000","last_peered":"2024-08-17T02:23:35.596192+0000","last_clean":"2024-08-17T02:23:35.596192+0000","last_became_active":"2024-08-17T02:23:35.589427+0000","last_became_peered":"2024-08-17T02:23:35.589427+0000","last_unstale":"2024-08-17T02:23:35.596192+0000","last_undegraded":"2024-08-17T02:23:35.596192+0000","last_fullsized":"2024-08-17T02:23:35.596192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:53.892837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.612998+0000","last_change":"2024-08-17T02:23:34.580970+0000","last_active":"2024-08-17T02:23:35.612998+0000","last_peered":"2024-08-17T02:23:35.612998+0000","last_clean":"2024-08-17T02:23:35.612998+0000","last_became_active":"2024-08-17T02:23:34.580699+0000","last_became_peered":"2024-08-17T02:23:34.580699+0000","last_unstale":"2024-08-17T02:23:35.612998+0000","last_undegraded":"2024-08-17T02:23:35.612998+0000","last_fullsized":"2024-08-17T02:23:35.612998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605360+0000","last_change":"2024-08-17T02:23:35.600825+0000","last_active":"2024-08-17T02:23:35.605360+0000","last_peered":"2024-08-17T02:23:35.605360+0000","last_clean":"2024-08-17T02:23:35.605360+0000","last_became_active":"2024-08-17T02:23:35.600525+0000","last_became_peered":"2024-08-17T02:23:35.600525+0000","last_unstale":"2024-08-17T02:23:35.605360+0000","last_undegraded":"2024-08-17T02:23:35.605360+0000","last_fullsized":"2024-08-17T02:23:35.605360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:30.865202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615727+0000","last_change":"2024-08-17T02:23:34.568078+0000","last_active":"2024-08-17T02:23:35.615727+0000","last_peered":"2024-08-17T02:23:35.615727+0000","last_clean":"2024-08-17T02:23:35.615727+0000","last_became_active":"2024-08-17T02:23:34.567754+0000","last_became_peered":"2024-08-17T02:23:34.567754+0000","last_unstale":"2024-08-17T02:23:35.615727+0000","last_undegraded":"2024-08-17T02:23:35.615727+0000","last_fullsized":"2024-08-17T02:23:35.615727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:45.647236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605384+0000","last_change":"2024-08-17T02:23:35.600247+0000","last_active":"2024-08-17T02:23:35.605384+0000","last_peered":"2024-08-17T02:23:35.605384+0000","last_clean":"2024-08-17T02:23:35.605384+0000","last_became_active":"2024-08-17T02:23:35.599892+0000","last_became_peered":"2024-08-17T02:23:35.599892+0000","last_unstale":"2024-08-17T02:23:35.605384+0000","last_undegraded":"2024-08-17T02:23:35.605384+0000","last_fullsized":"2024-08-17T02:23:35.605384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.609828+0000","last_change":"2024-08-17T02:23:34.577876+0000","last_active":"2024-08-17T02:23:35.609828+0000","last_peered":"2024-08-17T02:23:35.609828+0000","last_clean":"2024-08-17T02:23:35.609828+0000","last_became_active":"2024-08-17T02:23:34.577501+0000","last_became_peered":"2024-08-17T02:23:34.577501+0000","last_unstale":"2024-08-17T02:23:35.609828+0000","last_undegraded":"2024-08-17T02:23:35.609828+0000","last_fullsized":"2024-08-17T02:23:35.609828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:33.519680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.606464+0000","last_change":"2024-08-17T02:23:35.604376+0000","last_active":"2024-08-17T02:23:35.606464+0000","last_peered":"2024-08-17T02:23:35.606464+0000","last_clean":"2024-08-17T02:23:35.606464+0000","last_became_active":"2024-08-17T02:23:35.604116+0000","last_became_peered":"2024-08-17T02:23:35.604116+0000","last_unstale":"2024-08-17T02:23:35.606464+0000","last_undegraded":"2024-08-17T02:23:35.606464+0000","last_fullsized":"2024-08-17T02:23:35.606464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:58.699491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.613587+0000","last_change":"2024-08-17T02:23:34.585195+0000","last_active":"2024-08-17T02:23:35.613587+0000","last_peered":"2024-08-17T02:23:35.613587+0000","last_clean":"2024-08-17T02:23:35.613587+0000","last_became_active":"2024-08-17T02:23:34.584875+0000","last_became_peered":"2024-08-17T02:23:34.584875+0000","last_unstale":"2024-08-17T02:23:35.613587+0000","last_undegraded":"2024-08-17T02:23:35.613587+0000","last_fullsized":"2024-08-17T02:23:35.613587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:00.835021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.594448+0000","last_change":"2024-08-17T02:23:35.589341+0000","last_active":"2024-08-17T02:23:35.594448+0000","last_peered":"2024-08-17T02:23:35.594448+0000","last_clean":"2024-08-17T02:23:35.594448+0000","last_became_active":"2024-08-17T02:23:35.588957+0000","last_became_peered":"2024-08-17T02:23:35.588957+0000","last_unstale":"2024-08-17T02:23:35.594448+0000","last_undegraded":"2024-08-17T02:23:35.594448+0000","last_fullsized":"2024-08-17T02:23:35.594448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:57:57.262402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.576331+0000","last_change":"2024-08-17T02:23:34.587854+0000","last_active":"2024-08-17T02:23:35.576331+0000","last_peered":"2024-08-17T02:23:35.576331+0000","last_clean":"2024-08-17T02:23:35.576331+0000","last_became_active":"2024-08-17T02:23:34.587549+0000","last_became_peered":"2024-08-17T02:23:34.587549+0000","last_unstale":"2024-08-17T02:23:35.576331+0000","last_undegraded":"2024-08-17T02:23:35.576331+0000","last_fullsized":"2024-08-17T02:23:35.576331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:00.835021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.602005+0000","last_change":"2024-08-17T02:23:35.596727+0000","last_active":"2024-08-17T02:23:35.602005+0000","last_peered":"2024-08-17T02:23:35.602005+0000","last_clean":"2024-08-17T02:23:35.602005+0000","last_became_active":"2024-08-17T02:23:35.596442+0000","last_became_peered":"2024-08-17T02:23:35.596442+0000","last_unstale":"2024-08-17T02:23:35.602005+0000","last_undegraded":"2024-08-17T02:23:35.602005+0000","last_fullsized":"2024-08-17T02:23:35.602005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:53.779150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.580926+0000","last_change":"2024-08-17T02:23:30.651033+0000","last_active":"2024-08-17T02:23:35.580926+0000","last_peered":"2024-08-17T02:23:35.580926+0000","last_clean":"2024-08-17T02:23:35.580926+0000","last_became_active":"2024-08-17T02:23:30.649860+0000","last_became_peered":"2024-08-17T02:23:30.649860+0000","last_unstale":"2024-08-17T02:23:35.580926+0000","last_undegraded":"2024-08-17T02:23:35.580926+0000","last_fullsized":"2024-08-17T02:23:35.580926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.523857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:29:35.288625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583338+0000","last_change":"2024-08-17T02:23:34.574229+0000","last_active":"2024-08-17T02:23:35.583338+0000","last_peered":"2024-08-17T02:23:35.583338+0000","last_clean":"2024-08-17T02:23:35.583338+0000","last_became_active":"2024-08-17T02:23:34.573885+0000","last_became_peered":"2024-08-17T02:23:34.573885+0000","last_unstale":"2024-08-17T02:23:35.583338+0000","last_undegraded":"2024-08-17T02:23:35.583338+0000","last_fullsized":"2024-08-17T02:23:35.583338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:33.519680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.602258+0000","last_change":"2024-08-17T02:23:35.593836+0000","last_active":"2024-08-17T02:23:35.602258+0000","last_peered":"2024-08-17T02:23:35.602258+0000","last_clean":"2024-08-17T02:23:35.602258+0000","last_became_active":"2024-08-17T02:23:35.593564+0000","last_became_peered":"2024-08-17T02:23:35.593564+0000","last_unstale":"2024-08-17T02:23:35.602258+0000","last_undegraded":"2024-08-17T02:23:35.602258+0000","last_fullsized":"2024-08-17T02:23:35.602258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:47.878023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.580838+0000","last_change":"2024-08-17T02:23:34.582041+0000","last_active":"2024-08-17T02:23:35.580838+0000","last_peered":"2024-08-17T02:23:35.580838+0000","last_clean":"2024-08-17T02:23:35.580838+0000","last_became_active":"2024-08-17T02:23:34.581786+0000","last_became_peered":"2024-08-17T02:23:34.581786+0000","last_unstale":"2024-08-17T02:23:35.580838+0000","last_undegraded":"2024-08-17T02:23:35.580838+0000","last_fullsized":"2024-08-17T02:23:35.580838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:53.571063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.598226+0000","last_change":"2024-08-17T02:23:35.593384+0000","last_active":"2024-08-17T02:23:35.598226+0000","last_peered":"2024-08-17T02:23:35.598226+0000","last_clean":"2024-08-17T02:23:35.598226+0000","last_became_active":"2024-08-17T02:23:35.593105+0000","last_became_peered":"2024-08-17T02:23:35.593105+0000","last_unstale":"2024-08-17T02:23:35.598226+0000","last_undegraded":"2024-08-17T02:23:35.598226+0000","last_fullsized":"2024-08-17T02:23:35.598226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:19:09.314565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.576062+0000","last_change":"2024-08-17T02:23:34.577822+0000","last_active":"2024-08-17T02:23:35.576062+0000","last_peered":"2024-08-17T02:23:35.576062+0000","last_clean":"2024-08-17T02:23:35.576062+0000","last_became_active":"2024-08-17T02:23:34.577467+0000","last_became_peered":"2024-08-17T02:23:34.577467+0000","last_unstale":"2024-08-17T02:23:35.576062+0000","last_undegraded":"2024-08-17T02:23:35.576062+0000","last_fullsized":"2024-08-17T02:23:35.576062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.588280+0000","last_change":"2024-08-17T02:23:35.584388+0000","last_active":"2024-08-17T02:23:35.588280+0000","last_peered":"2024-08-17T02:23:35.588280+0000","last_clean":"2024-08-17T02:23:35.588280+0000","last_became_active":"2024-08-17T02:23:35.584056+0000","last_became_peered":"2024-08-17T02:23:35.584056+0000","last_unstale":"2024-08-17T02:23:35.588280+0000","last_undegraded":"2024-08-17T02:23:35.588280+0000","last_fullsized":"2024-08-17T02:23:35.588280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:37.276820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583764+0000","last_change":"2024-08-17T02:23:34.585609+0000","last_active":"2024-08-17T02:23:35.583764+0000","last_peered":"2024-08-17T02:23:35.583764+0000","last_clean":"2024-08-17T02:23:35.583764+0000","last_became_active":"2024-08-17T02:23:34.585328+0000","last_became_peered":"2024-08-17T02:23:34.585328+0000","last_unstale":"2024-08-17T02:23:35.583764+0000","last_undegraded":"2024-08-17T02:23:35.583764+0000","last_fullsized":"2024-08-17T02:23:35.583764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.593219+0000","last_change":"2024-08-17T02:23:35.582716+0000","last_active":"2024-08-17T02:23:35.593219+0000","last_peered":"2024-08-17T02:23:35.593219+0000","last_clean":"2024-08-17T02:23:35.593219+0000","last_became_active":"2024-08-17T02:23:35.582042+0000","last_became_peered":"2024-08-17T02:23:35.582042+0000","last_unstale":"2024-08-17T02:23:35.593219+0000","last_undegraded":"2024-08-17T02:23:35.593219+0000","last_fullsized":"2024-08-17T02:23:35.593219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:19.127243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.570431+0000","last_change":"2024-08-17T02:23:34.579748+0000","last_active":"2024-08-17T02:23:35.570431+0000","last_peered":"2024-08-17T02:23:35.570431+0000","last_clean":"2024-08-17T02:23:35.570431+0000","last_became_active":"2024-08-17T02:23:34.579282+0000","last_became_peered":"2024-08-17T02:23:34.579282+0000","last_unstale":"2024-08-17T02:23:35.570431+0000","last_undegraded":"2024-08-17T02:23:35.570431+0000","last_fullsized":"2024-08-17T02:23:35.570431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:53.571063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604616+0000","last_change":"2024-08-17T02:23:35.599794+0000","last_active":"2024-08-17T02:23:35.604616+0000","last_peered":"2024-08-17T02:23:35.604616+0000","last_clean":"2024-08-17T02:23:35.604616+0000","last_became_active":"2024-08-17T02:23:35.596190+0000","last_became_peered":"2024-08-17T02:23:35.596190+0000","last_unstale":"2024-08-17T02:23:35.604616+0000","last_undegraded":"2024-08-17T02:23:35.604616+0000","last_fullsized":"2024-08-17T02:23:35.604616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583507+0000","last_change":"2024-08-17T02:23:34.585808+0000","last_active":"2024-08-17T02:23:35.583507+0000","last_peered":"2024-08-17T02:23:35.583507+0000","last_clean":"2024-08-17T02:23:35.583507+0000","last_became_active":"2024-08-17T02:23:34.584698+0000","last_became_peered":"2024-08-17T02:23:34.584698+0000","last_unstale":"2024-08-17T02:23:35.583507+0000","last_undegraded":"2024-08-17T02:23:35.583507+0000","last_fullsized":"2024-08-17T02:23:35.583507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:29:02.697073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.588719+0000","last_change":"2024-08-17T02:23:35.584214+0000","last_active":"2024-08-17T02:23:35.588719+0000","last_peered":"2024-08-17T02:23:35.588719+0000","last_clean":"2024-08-17T02:23:35.588719+0000","last_became_active":"2024-08-17T02:23:35.583938+0000","last_became_peered":"2024-08-17T02:23:35.583938+0000","last_unstale":"2024-08-17T02:23:35.588719+0000","last_undegraded":"2024-08-17T02:23:35.588719+0000","last_fullsized":"2024-08-17T02:23:35.588719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:16.596695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.569971+0000","last_change":"2024-08-17T02:23:34.576832+0000","last_active":"2024-08-17T02:23:35.569971+0000","last_peered":"2024-08-17T02:23:35.569971+0000","last_clean":"2024-08-17T02:23:35.569971+0000","last_became_active":"2024-08-17T02:23:34.576507+0000","last_became_peered":"2024-08-17T02:23:34.576507+0000","last_unstale":"2024-08-17T02:23:35.569971+0000","last_undegraded":"2024-08-17T02:23:35.569971+0000","last_fullsized":"2024-08-17T02:23:35.569971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.591343+0000","last_change":"2024-08-17T02:23:35.590465+0000","last_active":"2024-08-17T02:23:35.591343+0000","last_peered":"2024-08-17T02:23:35.591343+0000","last_clean":"2024-08-17T02:23:35.591343+0000","last_became_active":"2024-08-17T02:23:35.590114+0000","last_became_peered":"2024-08-17T02:23:35.590114+0000","last_unstale":"2024-08-17T02:23:35.591343+0000","last_undegraded":"2024-08-17T02:23:35.591343+0000","last_fullsized":"2024-08-17T02:23:35.591343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:53.892837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615597+0000","last_change":"2024-08-17T02:23:34.579565+0000","last_active":"2024-08-17T02:23:35.615597+0000","last_peered":"2024-08-17T02:23:35.615597+0000","last_clean":"2024-08-17T02:23:35.615597+0000","last_became_active":"2024-08-17T02:23:34.579256+0000","last_became_peered":"2024-08-17T02:23:34.579256+0000","last_unstale":"2024-08-17T02:23:35.615597+0000","last_undegraded":"2024-08-17T02:23:35.615597+0000","last_fullsized":"2024-08-17T02:23:35.615597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:33.519680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.598466+0000","last_change":"2024-08-17T02:23:35.591642+0000","last_active":"2024-08-17T02:23:35.598466+0000","last_peered":"2024-08-17T02:23:35.598466+0000","last_clean":"2024-08-17T02:23:35.598466+0000","last_became_active":"2024-08-17T02:23:35.591364+0000","last_became_peered":"2024-08-17T02:23:35.591364+0000","last_unstale":"2024-08-17T02:23:35.598466+0000","last_undegraded":"2024-08-17T02:23:35.598466+0000","last_fullsized":"2024-08-17T02:23:35.598466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:10.629891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.580732+0000","last_change":"2024-08-17T02:23:34.584710+0000","last_active":"2024-08-17T02:23:35.580732+0000","last_peered":"2024-08-17T02:23:35.580732+0000","last_clean":"2024-08-17T02:23:35.580732+0000","last_became_active":"2024-08-17T02:23:34.584459+0000","last_became_peered":"2024-08-17T02:23:34.584459+0000","last_unstale":"2024-08-17T02:23:35.580732+0000","last_undegraded":"2024-08-17T02:23:35.580732+0000","last_fullsized":"2024-08-17T02:23:35.580732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.592273+0000","last_change":"2024-08-17T02:23:35.579802+0000","last_active":"2024-08-17T02:23:35.592273+0000","last_peered":"2024-08-17T02:23:35.592273+0000","last_clean":"2024-08-17T02:23:35.592273+0000","last_became_active":"2024-08-17T02:23:35.579505+0000","last_became_peered":"2024-08-17T02:23:35.579505+0000","last_unstale":"2024-08-17T02:23:35.592273+0000","last_undegraded":"2024-08-17T02:23:35.592273+0000","last_fullsized":"2024-08-17T02:23:35.592273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:51.900850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.569935+0000","last_change":"2024-08-17T02:23:34.584346+0000","last_active":"2024-08-17T02:23:35.569935+0000","last_peered":"2024-08-17T02:23:35.569935+0000","last_clean":"2024-08-17T02:23:35.569935+0000","last_became_active":"2024-08-17T02:23:34.584030+0000","last_became_peered":"2024-08-17T02:23:34.584030+0000","last_unstale":"2024-08-17T02:23:35.569935+0000","last_undegraded":"2024-08-17T02:23:35.569935+0000","last_fullsized":"2024-08-17T02:23:35.569935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.602212+0000","last_change":"2024-08-17T02:23:35.593165+0000","last_active":"2024-08-17T02:23:35.602212+0000","last_peered":"2024-08-17T02:23:35.602212+0000","last_clean":"2024-08-17T02:23:35.602212+0000","last_became_active":"2024-08-17T02:23:35.585416+0000","last_became_peered":"2024-08-17T02:23:35.585416+0000","last_unstale":"2024-08-17T02:23:35.602212+0000","last_undegraded":"2024-08-17T02:23:35.602212+0000","last_fullsized":"2024-08-17T02:23:35.602212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:10.629891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.569524+0000","last_change":"2024-08-17T02:23:34.586914+0000","last_active":"2024-08-17T02:23:35.569524+0000","last_peered":"2024-08-17T02:23:35.569524+0000","last_clean":"2024-08-17T02:23:35.569524+0000","last_became_active":"2024-08-17T02:23:34.586476+0000","last_became_peered":"2024-08-17T02:23:34.586476+0000","last_unstale":"2024-08-17T02:23:35.569524+0000","last_undegraded":"2024-08-17T02:23:35.569524+0000","last_fullsized":"2024-08-17T02:23:35.569524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:20:34.979718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.589645+0000","last_change":"2024-08-17T02:23:35.585526+0000","last_active":"2024-08-17T02:23:35.589645+0000","last_peered":"2024-08-17T02:23:35.589645+0000","last_clean":"2024-08-17T02:23:35.589645+0000","last_became_active":"2024-08-17T02:23:35.585223+0000","last_became_peered":"2024-08-17T02:23:35.585223+0000","last_unstale":"2024-08-17T02:23:35.589645+0000","last_undegraded":"2024-08-17T02:23:35.589645+0000","last_fullsized":"2024-08-17T02:23:35.589645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:37.276820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615445+0000","last_change":"2024-08-17T02:23:34.583608+0000","last_active":"2024-08-17T02:23:35.615445+0000","last_peered":"2024-08-17T02:23:35.615445+0000","last_clean":"2024-08-17T02:23:35.615445+0000","last_became_active":"2024-08-17T02:23:34.583262+0000","last_became_peered":"2024-08-17T02:23:34.583262+0000","last_unstale":"2024-08-17T02:23:35.615445+0000","last_undegraded":"2024-08-17T02:23:35.615445+0000","last_fullsized":"2024-08-17T02:23:35.615445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.584243+0000","last_change":"2024-08-17T02:23:35.582216+0000","last_active":"2024-08-17T02:23:35.584243+0000","last_peered":"2024-08-17T02:23:35.584243+0000","last_clean":"2024-08-17T02:23:35.584243+0000","last_became_active":"2024-08-17T02:23:35.581896+0000","last_became_peered":"2024-08-17T02:23:35.581896+0000","last_unstale":"2024-08-17T02:23:35.584243+0000","last_undegraded":"2024-08-17T02:23:35.584243+0000","last_fullsized":"2024-08-17T02:23:35.584243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:37.276820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604633+0000","last_change":"2024-08-17T02:23:35.600164+0000","last_active":"2024-08-17T02:23:35.604633+0000","last_peered":"2024-08-17T02:23:35.604633+0000","last_clean":"2024-08-17T02:23:35.604633+0000","last_became_active":"2024-08-17T02:23:35.594009+0000","last_became_peered":"2024-08-17T02:23:35.594009+0000","last_unstale":"2024-08-17T02:23:35.604633+0000","last_undegraded":"2024-08-17T02:23:35.604633+0000","last_fullsized":"2024-08-17T02:23:35.604633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:04:25.119433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615820+0000","last_change":"2024-08-17T02:23:34.586673+0000","last_active":"2024-08-17T02:23:35.615820+0000","last_peered":"2024-08-17T02:23:35.615820+0000","last_clean":"2024-08-17T02:23:35.615820+0000","last_became_active":"2024-08-17T02:23:34.586204+0000","last_became_peered":"2024-08-17T02:23:34.586204+0000","last_unstale":"2024-08-17T02:23:35.615820+0000","last_undegraded":"2024-08-17T02:23:35.615820+0000","last_fullsized":"2024-08-17T02:23:35.615820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:54:12.191670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603990+0000","last_change":"2024-08-17T02:23:35.597722+0000","last_active":"2024-08-17T02:23:35.603990+0000","last_peered":"2024-08-17T02:23:35.603990+0000","last_clean":"2024-08-17T02:23:35.603990+0000","last_became_active":"2024-08-17T02:23:35.593591+0000","last_became_peered":"2024-08-17T02:23:35.593591+0000","last_unstale":"2024-08-17T02:23:35.603990+0000","last_undegraded":"2024-08-17T02:23:35.603990+0000","last_fullsized":"2024-08-17T02:23:35.603990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:54:21.053209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.612181+0000","last_change":"2024-08-17T02:23:34.576713+0000","last_active":"2024-08-17T02:23:35.612181+0000","last_peered":"2024-08-17T02:23:35.612181+0000","last_clean":"2024-08-17T02:23:35.612181+0000","last_became_active":"2024-08-17T02:23:34.576458+0000","last_became_peered":"2024-08-17T02:23:34.576458+0000","last_unstale":"2024-08-17T02:23:35.612181+0000","last_undegraded":"2024-08-17T02:23:35.612181+0000","last_fullsized":"2024-08-17T02:23:35.612181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:00.835021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603641+0000","last_change":"2024-08-17T02:23:35.597367+0000","last_active":"2024-08-17T02:23:35.603641+0000","last_peered":"2024-08-17T02:23:35.603641+0000","last_clean":"2024-08-17T02:23:35.603641+0000","last_became_active":"2024-08-17T02:23:35.597133+0000","last_became_peered":"2024-08-17T02:23:35.597133+0000","last_unstale":"2024-08-17T02:23:35.603641+0000","last_undegraded":"2024-08-17T02:23:35.603641+0000","last_fullsized":"2024-08-17T02:23:35.603641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.610320+0000","last_change":"2024-08-17T02:23:34.573028+0000","last_active":"2024-08-17T02:23:35.610320+0000","last_peered":"2024-08-17T02:23:35.610320+0000","last_clean":"2024-08-17T02:23:35.610320+0000","last_became_active":"2024-08-17T02:23:34.572521+0000","last_became_peered":"2024-08-17T02:23:34.572521+0000","last_unstale":"2024-08-17T02:23:35.610320+0000","last_undegraded":"2024-08-17T02:23:35.610320+0000","last_fullsized":"2024-08-17T02:23:35.610320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:20:34.979718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.590393+0000","last_change":"2024-08-17T02:23:35.587484+0000","last_active":"2024-08-17T02:23:35.590393+0000","last_peered":"2024-08-17T02:23:35.590393+0000","last_clean":"2024-08-17T02:23:35.590393+0000","last_became_active":"2024-08-17T02:23:35.585250+0000","last_became_peered":"2024-08-17T02:23:35.585250+0000","last_unstale":"2024-08-17T02:23:35.590393+0000","last_undegraded":"2024-08-17T02:23:35.590393+0000","last_fullsized":"2024-08-17T02:23:35.590393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.616297+0000","last_change":"2024-08-17T02:23:34.577769+0000","last_active":"2024-08-17T02:23:35.616297+0000","last_peered":"2024-08-17T02:23:35.616297+0000","last_clean":"2024-08-17T02:23:35.616297+0000","last_became_active":"2024-08-17T02:23:34.576757+0000","last_became_peered":"2024-08-17T02:23:34.576757+0000","last_unstale":"2024-08-17T02:23:35.616297+0000","last_undegraded":"2024-08-17T02:23:35.616297+0000","last_fullsized":"2024-08-17T02:23:35.616297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:05:52.667388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":823296,"data_stored":669534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":237568,"data_stored":80148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":72398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":237568,"data_stored":78722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301752,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070088,"statfs":{"total":96636764160,"available":96327770112,"internally_reserved":0,"allocated":237568,"data_stored":80148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":225280,"data_stored":78596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301748,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070092,"statfs":{"total":96636764160,"available":96327774208,"internally_reserved":0,"allocated":233472,"data_stored":78756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302328,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069512,"statfs":{"total":96636764160,"available":96327180288,"internally_reserved":0,"allocated":831488,"data_stored":669590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:23:39.811 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:23:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.996+0000 7f984e200640 1 Processor -- start 2024-08-17T02:23:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.996+0000 7f984e200640 1 -- start start 2024-08-17T02:23:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.997+0000 7f984e200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f984815cdc0 0x7f98480ae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.997+0000 7f984e200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98480aeda0 0x7f98480b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.997+0000 7f984e200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98480aff30 con 0x7f98480b0900 2024-08-17T02:23:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.997+0000 7f984e200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98480af320 con 0x7f98480aeda0 2024-08-17T02:23:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.997+0000 7f984e200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98480af600 con 0x7f984815cdc0 2024-08-17T02:23:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.998+0000 7f9846a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98480aeda0 0x7f98480b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.998+0000 7f9846a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98480aeda0 0x7f98480b03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43700/0 (socket says 172.21.15.5:43700) 2024-08-17T02:23:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.998+0000 7f9846a00640 1 -- 172.21.15.5:0/1920256916 learned_addr learned my addr 172.21.15.5:0/1920256916 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.998+0000 7f9847400640 1 --2- 172.21.15.5:0/1920256916 >> v2:172.21.15.87:3300/0 conn(0x7f984815cdc0 0x7f98480ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.998+0000 7f9846a00640 1 -- 172.21.15.5:0/1920256916 >> v2:172.21.15.87:3300/0 conn(0x7f984815cdc0 msgr2=0x7f98480ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.998+0000 7f9846a00640 1 --2- 172.21.15.5:0/1920256916 >> v2:172.21.15.87:3300/0 conn(0x7f984815cdc0 0x7f98480ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.998+0000 7f9846a00640 1 -- 172.21.15.5:0/1920256916 >> v1:172.21.15.5:6789/0 conn(0x7f98480b0900 legacy=0x7f984806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.998+0000 7f9846a00640 1 -- 172.21.15.5:0/1920256916 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98480af8e0 con 0x7f98480aeda0 2024-08-17T02:23:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.999+0000 7f9846a00640 1 --2- 172.21.15.5:0/1920256916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98480aeda0 0x7f98480b03c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f98480cc910 tx=0x7f98340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3185801c21261230 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.999+0000 7f9846000640 1 -- 172.21.15.5:0/1920256916 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983402add0 con 0x7f98480aeda0 2024-08-17T02:23:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.999+0000 7f9846000640 1 -- 172.21.15.5:0/1920256916 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9834032440 con 0x7f98480aeda0 2024-08-17T02:23:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:39.999+0000 7f9846000640 1 -- 172.21.15.5:0/1920256916 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9834032820 con 0x7f98480aeda0 2024-08-17T02:23:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.000+0000 7f984e200640 1 -- 172.21.15.5:0/1920256916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98480aeda0 msgr2=0x7f98480b03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.000+0000 7f984e200640 1 --2- 172.21.15.5:0/1920256916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98480aeda0 0x7f98480b03c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f98480cc910 tx=0x7f98340091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.000+0000 7f984e200640 1 -- 172.21.15.5:0/1920256916 shutdown_connections 2024-08-17T02:23:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.000+0000 7f984e200640 1 --2- 172.21.15.5:0/1920256916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98480aeda0 0x7f98480b03c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.000+0000 7f984e200640 1 --2- 172.21.15.5:0/1920256916 >> v2:172.21.15.87:3300/0 conn(0x7f984815cdc0 0x7f98480ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.000+0000 7f984e200640 1 -- 172.21.15.5:0/1920256916 >> 172.21.15.5:0/1920256916 conn(0x7f9848066e60 msgr2=0x7f9848067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.000+0000 7f984e200640 1 -- 172.21.15.5:0/1920256916 shutdown_connections 2024-08-17T02:23:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.000+0000 7f984e200640 1 -- 172.21.15.5:0/1920256916 wait complete. 2024-08-17T02:23:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.001+0000 7f984e200640 1 Processor -- start 2024-08-17T02:23:40.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.001+0000 7f984e200640 1 -- start start 2024-08-17T02:23:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.002+0000 7f984e200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98480aeda0 0x7f984814fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.002+0000 7f984e200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98480b0900 0x7f984816d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.002+0000 7f984e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984815cdc0 0x7f9848152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.002+0000 7f984e200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9848154b00 con 0x7f984815cdc0 2024-08-17T02:23:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.002+0000 7f984e200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98481550c0 con 0x7f98480b0900 2024-08-17T02:23:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.002+0000 7f984e200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9848154350 con 0x7f98480aeda0 2024-08-17T02:23:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.003+0000 7f9846a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98480b0900 0x7f984816d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.003+0000 7f9846a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98480b0900 0x7f984816d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:56372/0 (socket says 172.21.15.5:56372) 2024-08-17T02:23:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.003+0000 7f9847400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98480aeda0 0x7f984814fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.003+0000 7f9846a00640 1 -- 172.21.15.5:0/810333677 learned_addr learned my addr 172.21.15.5:0/810333677 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:40.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.003+0000 7f9847e00640 1 --2- 172.21.15.5:0/810333677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984815cdc0 0x7f9848152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.003+0000 7f9847e00640 1 -- 172.21.15.5:0/810333677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98480aeda0 msgr2=0x7f984814fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.003+0000 7f9847e00640 1 --2- 172.21.15.5:0/810333677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98480aeda0 0x7f984814fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.003+0000 7f9847e00640 1 -- 172.21.15.5:0/810333677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98480b0900 msgr2=0x7f984816d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.003+0000 7f9847e00640 1 --2- 172.21.15.5:0/810333677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98480b0900 0x7f984816d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.003+0000 7f9847e00640 1 -- 172.21.15.5:0/810333677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9834009450 con 0x7f984815cdc0 2024-08-17T02:23:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.003+0000 7f9847e00640 1 --2- 172.21.15.5:0/810333677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984815cdc0 0x7f9848152540 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f984000c7c0 tx=0x7f9840001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.004+0000 7f983ea00640 1 -- 172.21.15.5:0/810333677 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984000a640 con 0x7f984815cdc0 2024-08-17T02:23:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.004+0000 7f983ea00640 1 -- 172.21.15.5:0/810333677 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984000a7a0 con 0x7f984815cdc0 2024-08-17T02:23:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.004+0000 7f983ea00640 1 -- 172.21.15.5:0/810333677 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984000ab60 con 0x7f984815cdc0 2024-08-17T02:23:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.004+0000 7f984e200640 1 -- 172.21.15.5:0/810333677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9848150320 con 0x7f984815cdc0 2024-08-17T02:23:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.004+0000 7f984e200640 1 -- 172.21.15.5:0/810333677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9848153390 con 0x7f984815cdc0 2024-08-17T02:23:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.005+0000 7f984e200640 1 -- 172.21.15.5:0/810333677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9848155250 con 0x7f984815cdc0 2024-08-17T02:23:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.006+0000 7f983ea00640 1 -- 172.21.15.5:0/810333677 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9840012420 con 0x7f984815cdc0 2024-08-17T02:23:40.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.007+0000 7f983ea00640 1 --2- 172.21.15.5:0/810333677 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9828065180 0x7f9828067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.007+0000 7f983ea00640 1 -- 172.21.15.5:0/810333677 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9840082560 con 0x7f984815cdc0 2024-08-17T02:23:40.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.007+0000 7f9847400640 1 --2- 172.21.15.5:0/810333677 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9828065180 0x7f9828067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.008+0000 7f9847400640 1 --2- 172.21.15.5:0/810333677 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9828065180 0x7f9828067630 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f983800bd40 tx=0x7f9838008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.011+0000 7f983ea00640 1 -- 172.21.15.5:0/810333677 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9840050630 con 0x7f984815cdc0 2024-08-17T02:23:40.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.189+0000 7f984e200640 1 -- 172.21.15.5:0/810333677 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9848063fb0 con 0x7f9828065180 2024-08-17T02:23:40.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.196+0000 7f983ea00640 1 -- 172.21.15.5:0/810333677 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264620 (secure 0 0 0) 0x7f9848063fb0 con 0x7f9828065180 2024-08-17T02:23:40.199 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:40.201 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:23:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.200+0000 7f984e200640 1 -- 172.21.15.5:0/810333677 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9828065180 msgr2=0x7f9828067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.200+0000 7f984e200640 1 --2- 172.21.15.5:0/810333677 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9828065180 0x7f9828067630 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f983800bd40 tx=0x7f9838008040 comp rx=0 tx=0).stop 2024-08-17T02:23:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.200+0000 7f984e200640 1 -- 172.21.15.5:0/810333677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984815cdc0 msgr2=0x7f9848152540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.200+0000 7f984e200640 1 --2- 172.21.15.5:0/810333677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984815cdc0 0x7f9848152540 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f984000c7c0 tx=0x7f9840001610 comp rx=0 tx=0).stop 2024-08-17T02:23:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.200+0000 7f984e200640 1 -- 172.21.15.5:0/810333677 shutdown_connections 2024-08-17T02:23:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.200+0000 7f984e200640 1 --2- 172.21.15.5:0/810333677 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9828065180 0x7f9828067630 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.200+0000 7f984e200640 1 --2- 172.21.15.5:0/810333677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984815cdc0 0x7f9848152540 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.200+0000 7f984e200640 1 --2- 172.21.15.5:0/810333677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98480b0900 0x7f984816d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.200+0000 7f984e200640 1 --2- 172.21.15.5:0/810333677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98480aeda0 0x7f984814fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.200+0000 7f984e200640 1 -- 172.21.15.5:0/810333677 >> 172.21.15.5:0/810333677 conn(0x7f9848066e60 msgr2=0x7f9848150bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.200+0000 7f984e200640 1 -- 172.21.15.5:0/810333677 shutdown_connections 2024-08-17T02:23:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.200+0000 7f984e200640 1 -- 172.21.15.5:0/810333677 wait complete. 2024-08-17T02:23:40.216 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-08-17T02:23:38.720950+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398480,"kb_used_data":2972,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576240,"statfs":{"total":773094113280,"available":770638069760,"internally_reserved":0,"allocated":3043328,"data_stored":1807892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.170850"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596396+0000","last_change":"2024-08-17T02:23:35.589709+0000","last_active":"2024-08-17T02:23:35.596396+0000","last_peered":"2024-08-17T02:23:35.596396+0000","last_clean":"2024-08-17T02:23:35.596396+0000","last_became_active":"2024-08-17T02:23:35.589445+0000","last_became_peered":"2024-08-17T02:23:35.589445+0000","last_unstale":"2024-08-17T02:23:35.596396+0000","last_undegraded":"2024-08-17T02:23:35.596396+0000","last_fullsized":"2024-08-17T02:23:35.596396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:40.177968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.597886+0000","last_change":"2024-08-17T02:23:35.596541+0000","last_active":"2024-08-17T02:23:35.597886+0000","last_peered":"2024-08-17T02:23:35.597886+0000","last_clean":"2024-08-17T02:23:35.597886+0000","last_became_active":"2024-08-17T02:23:35.595984+0000","last_became_peered":"2024-08-17T02:23:35.595984+0000","last_unstale":"2024-08-17T02:23:35.597886+0000","last_undegraded":"2024-08-17T02:23:35.597886+0000","last_fullsized":"2024-08-17T02:23:35.597886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.592178+0000","last_change":"2024-08-17T02:23:35.589116+0000","last_active":"2024-08-17T02:23:35.592178+0000","last_peered":"2024-08-17T02:23:35.592178+0000","last_clean":"2024-08-17T02:23:35.592178+0000","last_became_active":"2024-08-17T02:23:35.588776+0000","last_became_peered":"2024-08-17T02:23:35.588776+0000","last_unstale":"2024-08-17T02:23:35.592178+0000","last_undegraded":"2024-08-17T02:23:35.592178+0000","last_fullsized":"2024-08-17T02:23:35.592178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604057+0000","last_change":"2024-08-17T02:23:35.597845+0000","last_active":"2024-08-17T02:23:35.604057+0000","last_peered":"2024-08-17T02:23:35.604057+0000","last_clean":"2024-08-17T02:23:35.604057+0000","last_became_active":"2024-08-17T02:23:35.593974+0000","last_became_peered":"2024-08-17T02:23:35.593974+0000","last_unstale":"2024-08-17T02:23:35.604057+0000","last_undegraded":"2024-08-17T02:23:35.604057+0000","last_fullsized":"2024-08-17T02:23:35.604057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:40.177968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596099+0000","last_change":"2024-08-17T02:23:35.592334+0000","last_active":"2024-08-17T02:23:35.596099+0000","last_peered":"2024-08-17T02:23:35.596099+0000","last_clean":"2024-08-17T02:23:35.596099+0000","last_became_active":"2024-08-17T02:23:35.591936+0000","last_became_peered":"2024-08-17T02:23:35.591936+0000","last_unstale":"2024-08-17T02:23:35.596099+0000","last_undegraded":"2024-08-17T02:23:35.596099+0000","last_fullsized":"2024-08-17T02:23:35.596099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:54:21.053209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605344+0000","last_change":"2024-08-17T02:23:35.601382+0000","last_active":"2024-08-17T02:23:35.605344+0000","last_peered":"2024-08-17T02:23:35.605344+0000","last_clean":"2024-08-17T02:23:35.605344+0000","last_became_active":"2024-08-17T02:23:35.600762+0000","last_became_peered":"2024-08-17T02:23:35.600762+0000","last_unstale":"2024-08-17T02:23:35.605344+0000","last_undegraded":"2024-08-17T02:23:35.605344+0000","last_fullsized":"2024-08-17T02:23:35.605344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:58.699491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.600889+0000","last_change":"2024-08-17T02:23:35.593406+0000","last_active":"2024-08-17T02:23:35.600889+0000","last_peered":"2024-08-17T02:23:35.600889+0000","last_clean":"2024-08-17T02:23:35.600889+0000","last_became_active":"2024-08-17T02:23:35.592939+0000","last_became_peered":"2024-08-17T02:23:35.592939+0000","last_unstale":"2024-08-17T02:23:35.600889+0000","last_undegraded":"2024-08-17T02:23:35.600889+0000","last_fullsized":"2024-08-17T02:23:35.600889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:58.163230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603257+0000","last_change":"2024-08-17T02:23:35.597151+0000","last_active":"2024-08-17T02:23:35.603257+0000","last_peered":"2024-08-17T02:23:35.603257+0000","last_clean":"2024-08-17T02:23:35.603257+0000","last_became_active":"2024-08-17T02:23:35.593461+0000","last_became_peered":"2024-08-17T02:23:35.593461+0000","last_unstale":"2024-08-17T02:23:35.603257+0000","last_undegraded":"2024-08-17T02:23:35.603257+0000","last_fullsized":"2024-08-17T02:23:35.603257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:04:25.119433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.601168+0000","last_change":"2024-08-17T02:23:35.598033+0000","last_active":"2024-08-17T02:23:35.601168+0000","last_peered":"2024-08-17T02:23:35.601168+0000","last_clean":"2024-08-17T02:23:35.601168+0000","last_became_active":"2024-08-17T02:23:35.595752+0000","last_became_peered":"2024-08-17T02:23:35.595752+0000","last_unstale":"2024-08-17T02:23:35.601168+0000","last_undegraded":"2024-08-17T02:23:35.601168+0000","last_fullsized":"2024-08-17T02:23:35.601168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:23:53.610539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.595948+0000","last_change":"2024-08-17T02:23:35.592023+0000","last_active":"2024-08-17T02:23:35.595948+0000","last_peered":"2024-08-17T02:23:35.595948+0000","last_clean":"2024-08-17T02:23:35.595948+0000","last_became_active":"2024-08-17T02:23:35.591200+0000","last_became_peered":"2024-08-17T02:23:35.591200+0000","last_unstale":"2024-08-17T02:23:35.595948+0000","last_undegraded":"2024-08-17T02:23:35.595948+0000","last_fullsized":"2024-08-17T02:23:35.595948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.600098+0000","last_change":"2024-08-17T02:23:35.596390+0000","last_active":"2024-08-17T02:23:35.600098+0000","last_peered":"2024-08-17T02:23:35.600098+0000","last_clean":"2024-08-17T02:23:35.600098+0000","last_became_active":"2024-08-17T02:23:35.596157+0000","last_became_peered":"2024-08-17T02:23:35.596157+0000","last_unstale":"2024-08-17T02:23:35.600098+0000","last_undegraded":"2024-08-17T02:23:35.600098+0000","last_fullsized":"2024-08-17T02:23:35.600098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.592637+0000","last_change":"2024-08-17T02:23:35.582359+0000","last_active":"2024-08-17T02:23:35.592637+0000","last_peered":"2024-08-17T02:23:35.592637+0000","last_clean":"2024-08-17T02:23:35.592637+0000","last_became_active":"2024-08-17T02:23:35.581946+0000","last_became_peered":"2024-08-17T02:23:35.581946+0000","last_unstale":"2024-08-17T02:23:35.592637+0000","last_undegraded":"2024-08-17T02:23:35.592637+0000","last_fullsized":"2024-08-17T02:23:35.592637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:27:42.753023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.590492+0000","last_change":"2024-08-17T02:23:35.587890+0000","last_active":"2024-08-17T02:23:35.590492+0000","last_peered":"2024-08-17T02:23:35.590492+0000","last_clean":"2024-08-17T02:23:35.590492+0000","last_became_active":"2024-08-17T02:23:35.585585+0000","last_became_peered":"2024-08-17T02:23:35.585585+0000","last_unstale":"2024-08-17T02:23:35.590492+0000","last_undegraded":"2024-08-17T02:23:35.590492+0000","last_fullsized":"2024-08-17T02:23:35.590492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603716+0000","last_change":"2024-08-17T02:23:35.596596+0000","last_active":"2024-08-17T02:23:35.603716+0000","last_peered":"2024-08-17T02:23:35.603716+0000","last_clean":"2024-08-17T02:23:35.603716+0000","last_became_active":"2024-08-17T02:23:35.596293+0000","last_became_peered":"2024-08-17T02:23:35.596293+0000","last_unstale":"2024-08-17T02:23:35.603716+0000","last_undegraded":"2024-08-17T02:23:35.603716+0000","last_fullsized":"2024-08-17T02:23:35.603716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:25:10.908502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.580252+0000","last_change":"2024-08-17T02:23:35.576127+0000","last_active":"2024-08-17T02:23:35.580252+0000","last_peered":"2024-08-17T02:23:35.580252+0000","last_clean":"2024-08-17T02:23:35.580252+0000","last_became_active":"2024-08-17T02:23:35.575812+0000","last_became_peered":"2024-08-17T02:23:35.575812+0000","last_unstale":"2024-08-17T02:23:35.580252+0000","last_undegraded":"2024-08-17T02:23:35.580252+0000","last_fullsized":"2024-08-17T02:23:35.580252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604727+0000","last_change":"2024-08-17T02:23:35.598920+0000","last_active":"2024-08-17T02:23:35.604727+0000","last_peered":"2024-08-17T02:23:35.604727+0000","last_clean":"2024-08-17T02:23:35.604727+0000","last_became_active":"2024-08-17T02:23:35.598446+0000","last_became_peered":"2024-08-17T02:23:35.598446+0000","last_unstale":"2024-08-17T02:23:35.604727+0000","last_undegraded":"2024-08-17T02:23:35.604727+0000","last_fullsized":"2024-08-17T02:23:35.604727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:44.471490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603819+0000","last_change":"2024-08-17T02:23:35.597673+0000","last_active":"2024-08-17T02:23:35.603819+0000","last_peered":"2024-08-17T02:23:35.603819+0000","last_clean":"2024-08-17T02:23:35.603819+0000","last_became_active":"2024-08-17T02:23:35.596284+0000","last_became_peered":"2024-08-17T02:23:35.596284+0000","last_unstale":"2024-08-17T02:23:35.603819+0000","last_undegraded":"2024-08-17T02:23:35.603819+0000","last_fullsized":"2024-08-17T02:23:35.603819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.586639+0000","last_change":"2024-08-17T02:23:35.581433+0000","last_active":"2024-08-17T02:23:35.586639+0000","last_peered":"2024-08-17T02:23:35.586639+0000","last_clean":"2024-08-17T02:23:35.586639+0000","last_became_active":"2024-08-17T02:23:35.581150+0000","last_became_peered":"2024-08-17T02:23:35.581150+0000","last_unstale":"2024-08-17T02:23:35.586639+0000","last_undegraded":"2024-08-17T02:23:35.586639+0000","last_fullsized":"2024-08-17T02:23:35.586639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:19:09.314565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596841+0000","last_change":"2024-08-17T02:23:35.590432+0000","last_active":"2024-08-17T02:23:35.596841+0000","last_peered":"2024-08-17T02:23:35.596841+0000","last_clean":"2024-08-17T02:23:35.596841+0000","last_became_active":"2024-08-17T02:23:35.590171+0000","last_became_peered":"2024-08-17T02:23:35.590171+0000","last_unstale":"2024-08-17T02:23:35.596841+0000","last_undegraded":"2024-08-17T02:23:35.596841+0000","last_fullsized":"2024-08-17T02:23:35.596841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:44.471490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.581293+0000","last_change":"2024-08-17T02:23:35.576756+0000","last_active":"2024-08-17T02:23:35.581293+0000","last_peered":"2024-08-17T02:23:35.581293+0000","last_clean":"2024-08-17T02:23:35.581293+0000","last_became_active":"2024-08-17T02:23:35.575447+0000","last_became_peered":"2024-08-17T02:23:35.575447+0000","last_unstale":"2024-08-17T02:23:35.581293+0000","last_undegraded":"2024-08-17T02:23:35.581293+0000","last_fullsized":"2024-08-17T02:23:35.581293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:53.414346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.598137+0000","last_change":"2024-08-17T02:23:35.592931+0000","last_active":"2024-08-17T02:23:35.598137+0000","last_peered":"2024-08-17T02:23:35.598137+0000","last_clean":"2024-08-17T02:23:35.598137+0000","last_became_active":"2024-08-17T02:23:35.592658+0000","last_became_peered":"2024-08-17T02:23:35.592658+0000","last_unstale":"2024-08-17T02:23:35.598137+0000","last_undegraded":"2024-08-17T02:23:35.598137+0000","last_fullsized":"2024-08-17T02:23:35.598137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:53.892837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604091+0000","last_change":"2024-08-17T02:23:35.597950+0000","last_active":"2024-08-17T02:23:35.604091+0000","last_peered":"2024-08-17T02:23:35.604091+0000","last_clean":"2024-08-17T02:23:35.604091+0000","last_became_active":"2024-08-17T02:23:35.597671+0000","last_became_peered":"2024-08-17T02:23:35.597671+0000","last_unstale":"2024-08-17T02:23:35.604091+0000","last_undegraded":"2024-08-17T02:23:35.604091+0000","last_fullsized":"2024-08-17T02:23:35.604091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:47.878023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603319+0000","last_change":"2024-08-17T02:23:35.598952+0000","last_active":"2024-08-17T02:23:35.603319+0000","last_peered":"2024-08-17T02:23:35.603319+0000","last_clean":"2024-08-17T02:23:35.603319+0000","last_became_active":"2024-08-17T02:23:35.598602+0000","last_became_peered":"2024-08-17T02:23:35.598602+0000","last_unstale":"2024-08-17T02:23:35.603319+0000","last_undegraded":"2024-08-17T02:23:35.603319+0000","last_fullsized":"2024-08-17T02:23:35.603319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:16.596695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604477+0000","last_change":"2024-08-17T02:23:35.594022+0000","last_active":"2024-08-17T02:23:35.604477+0000","last_peered":"2024-08-17T02:23:35.604477+0000","last_clean":"2024-08-17T02:23:35.604477+0000","last_became_active":"2024-08-17T02:23:35.593747+0000","last_became_peered":"2024-08-17T02:23:35.593747+0000","last_unstale":"2024-08-17T02:23:35.604477+0000","last_undegraded":"2024-08-17T02:23:35.604477+0000","last_fullsized":"2024-08-17T02:23:35.604477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:30.865202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605226+0000","last_change":"2024-08-17T02:23:35.601823+0000","last_active":"2024-08-17T02:23:35.605226+0000","last_peered":"2024-08-17T02:23:35.605226+0000","last_clean":"2024-08-17T02:23:35.605226+0000","last_became_active":"2024-08-17T02:23:35.594672+0000","last_became_peered":"2024-08-17T02:23:35.594672+0000","last_unstale":"2024-08-17T02:23:35.605226+0000","last_undegraded":"2024-08-17T02:23:35.605226+0000","last_fullsized":"2024-08-17T02:23:35.605226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:30.865202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596800+0000","last_change":"2024-08-17T02:23:35.594464+0000","last_active":"2024-08-17T02:23:35.596800+0000","last_peered":"2024-08-17T02:23:35.596800+0000","last_clean":"2024-08-17T02:23:35.596800+0000","last_became_active":"2024-08-17T02:23:35.594132+0000","last_became_peered":"2024-08-17T02:23:35.594132+0000","last_unstale":"2024-08-17T02:23:35.596800+0000","last_undegraded":"2024-08-17T02:23:35.596800+0000","last_fullsized":"2024-08-17T02:23:35.596800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:16.596695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.587445+0000","last_change":"2024-08-17T02:23:35.584046+0000","last_active":"2024-08-17T02:23:35.587445+0000","last_peered":"2024-08-17T02:23:35.587445+0000","last_clean":"2024-08-17T02:23:35.587445+0000","last_became_active":"2024-08-17T02:23:35.583501+0000","last_became_peered":"2024-08-17T02:23:35.583501+0000","last_unstale":"2024-08-17T02:23:35.587445+0000","last_undegraded":"2024-08-17T02:23:35.587445+0000","last_fullsized":"2024-08-17T02:23:35.587445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603996+0000","last_change":"2024-08-17T02:23:35.601673+0000","last_active":"2024-08-17T02:23:35.603996+0000","last_peered":"2024-08-17T02:23:35.603996+0000","last_clean":"2024-08-17T02:23:35.603996+0000","last_became_active":"2024-08-17T02:23:35.600053+0000","last_became_peered":"2024-08-17T02:23:35.600053+0000","last_unstale":"2024-08-17T02:23:35.603996+0000","last_undegraded":"2024-08-17T02:23:35.603996+0000","last_fullsized":"2024-08-17T02:23:35.603996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603669+0000","last_change":"2024-08-17T02:23:35.596895+0000","last_active":"2024-08-17T02:23:35.603669+0000","last_peered":"2024-08-17T02:23:35.603669+0000","last_clean":"2024-08-17T02:23:35.603669+0000","last_became_active":"2024-08-17T02:23:35.596357+0000","last_became_peered":"2024-08-17T02:23:35.596357+0000","last_unstale":"2024-08-17T02:23:35.603669+0000","last_undegraded":"2024-08-17T02:23:35.603669+0000","last_fullsized":"2024-08-17T02:23:35.603669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:16.596695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604107+0000","last_change":"2024-08-17T02:23:35.598186+0000","last_active":"2024-08-17T02:23:35.604107+0000","last_peered":"2024-08-17T02:23:35.604107+0000","last_clean":"2024-08-17T02:23:35.604107+0000","last_became_active":"2024-08-17T02:23:35.597916+0000","last_became_peered":"2024-08-17T02:23:35.597916+0000","last_unstale":"2024-08-17T02:23:35.604107+0000","last_undegraded":"2024-08-17T02:23:35.604107+0000","last_fullsized":"2024-08-17T02:23:35.604107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:58.163230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.595983+0000","last_change":"2024-08-17T02:23:35.592760+0000","last_active":"2024-08-17T02:23:35.595983+0000","last_peered":"2024-08-17T02:23:35.595983+0000","last_clean":"2024-08-17T02:23:35.595983+0000","last_became_active":"2024-08-17T02:23:35.592422+0000","last_became_peered":"2024-08-17T02:23:35.592422+0000","last_unstale":"2024-08-17T02:23:35.595983+0000","last_undegraded":"2024-08-17T02:23:35.595983+0000","last_fullsized":"2024-08-17T02:23:35.595983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:14.018866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604612+0000","last_change":"2024-08-17T02:23:35.597586+0000","last_active":"2024-08-17T02:23:35.604612+0000","last_peered":"2024-08-17T02:23:35.604612+0000","last_clean":"2024-08-17T02:23:35.604612+0000","last_became_active":"2024-08-17T02:23:35.597307+0000","last_became_peered":"2024-08-17T02:23:35.597307+0000","last_unstale":"2024-08-17T02:23:35.604612+0000","last_undegraded":"2024-08-17T02:23:35.604612+0000","last_fullsized":"2024-08-17T02:23:35.604612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596676+0000","last_change":"2024-08-17T02:23:35.590260+0000","last_active":"2024-08-17T02:23:35.596676+0000","last_peered":"2024-08-17T02:23:35.596676+0000","last_clean":"2024-08-17T02:23:35.596676+0000","last_became_active":"2024-08-17T02:23:35.585495+0000","last_became_peered":"2024-08-17T02:23:35.585495+0000","last_unstale":"2024-08-17T02:23:35.596676+0000","last_undegraded":"2024-08-17T02:23:35.596676+0000","last_fullsized":"2024-08-17T02:23:35.596676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:21.900954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.608774+0000","last_change":"2024-08-17T02:23:34.577323+0000","last_active":"2024-08-17T02:23:35.608774+0000","last_peered":"2024-08-17T02:23:35.608774+0000","last_clean":"2024-08-17T02:23:35.608774+0000","last_became_active":"2024-08-17T02:23:34.577034+0000","last_became_peered":"2024-08-17T02:23:34.577034+0000","last_unstale":"2024-08-17T02:23:35.608774+0000","last_undegraded":"2024-08-17T02:23:35.608774+0000","last_fullsized":"2024-08-17T02:23:35.608774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:29.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603650+0000","last_change":"2024-08-17T02:23:35.596697+0000","last_active":"2024-08-17T02:23:35.603650+0000","last_peered":"2024-08-17T02:23:35.603650+0000","last_clean":"2024-08-17T02:23:35.603650+0000","last_became_active":"2024-08-17T02:23:35.595923+0000","last_became_peered":"2024-08-17T02:23:35.595923+0000","last_unstale":"2024-08-17T02:23:35.603650+0000","last_undegraded":"2024-08-17T02:23:35.603650+0000","last_fullsized":"2024-08-17T02:23:35.603650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:08:23.329877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.613478+0000","last_change":"2024-08-17T02:23:34.572025+0000","last_active":"2024-08-17T02:23:35.613478+0000","last_peered":"2024-08-17T02:23:35.613478+0000","last_clean":"2024-08-17T02:23:35.613478+0000","last_became_active":"2024-08-17T02:23:34.571705+0000","last_became_peered":"2024-08-17T02:23:34.571705+0000","last_unstale":"2024-08-17T02:23:35.613478+0000","last_undegraded":"2024-08-17T02:23:35.613478+0000","last_fullsized":"2024-08-17T02:23:35.613478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.576708+0000","last_change":"2024-08-17T02:23:34.580257+0000","last_active":"2024-08-17T02:23:35.576708+0000","last_peered":"2024-08-17T02:23:35.576708+0000","last_clean":"2024-08-17T02:23:35.576708+0000","last_became_active":"2024-08-17T02:23:34.579936+0000","last_became_peered":"2024-08-17T02:23:34.579936+0000","last_unstale":"2024-08-17T02:23:35.576708+0000","last_undegraded":"2024-08-17T02:23:35.576708+0000","last_fullsized":"2024-08-17T02:23:35.576708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:05:52.667388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603279+0000","last_change":"2024-08-17T02:23:35.597773+0000","last_active":"2024-08-17T02:23:35.603279+0000","last_peered":"2024-08-17T02:23:35.603279+0000","last_clean":"2024-08-17T02:23:35.603279+0000","last_became_active":"2024-08-17T02:23:35.597536+0000","last_became_peered":"2024-08-17T02:23:35.597536+0000","last_unstale":"2024-08-17T02:23:35.603279+0000","last_undegraded":"2024-08-17T02:23:35.603279+0000","last_fullsized":"2024-08-17T02:23:35.603279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:25:10.908502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583113+0000","last_change":"2024-08-17T02:23:34.577723+0000","last_active":"2024-08-17T02:23:35.583113+0000","last_peered":"2024-08-17T02:23:35.583113+0000","last_clean":"2024-08-17T02:23:35.583113+0000","last_became_active":"2024-08-17T02:23:34.577455+0000","last_became_peered":"2024-08-17T02:23:34.577455+0000","last_unstale":"2024-08-17T02:23:35.583113+0000","last_undegraded":"2024-08-17T02:23:35.583113+0000","last_fullsized":"2024-08-17T02:23:35.583113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:29.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.595349+0000","last_change":"2024-08-17T02:23:35.593879+0000","last_active":"2024-08-17T02:23:35.595349+0000","last_peered":"2024-08-17T02:23:35.595349+0000","last_clean":"2024-08-17T02:23:35.595349+0000","last_became_active":"2024-08-17T02:23:35.593445+0000","last_became_peered":"2024-08-17T02:23:35.593445+0000","last_unstale":"2024-08-17T02:23:35.595349+0000","last_undegraded":"2024-08-17T02:23:35.595349+0000","last_fullsized":"2024-08-17T02:23:35.595349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:53.892837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.571971+0000","last_change":"2024-08-17T02:23:34.579703+0000","last_active":"2024-08-17T02:23:35.571971+0000","last_peered":"2024-08-17T02:23:35.571971+0000","last_clean":"2024-08-17T02:23:35.571971+0000","last_became_active":"2024-08-17T02:23:34.579430+0000","last_became_peered":"2024-08-17T02:23:34.579430+0000","last_unstale":"2024-08-17T02:23:35.571971+0000","last_undegraded":"2024-08-17T02:23:35.571971+0000","last_fullsized":"2024-08-17T02:23:35.571971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:00.835021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603795+0000","last_change":"2024-08-17T02:23:35.596266+0000","last_active":"2024-08-17T02:23:35.603795+0000","last_peered":"2024-08-17T02:23:35.603795+0000","last_clean":"2024-08-17T02:23:35.603795+0000","last_became_active":"2024-08-17T02:23:35.593899+0000","last_became_peered":"2024-08-17T02:23:35.593899+0000","last_unstale":"2024-08-17T02:23:35.603795+0000","last_undegraded":"2024-08-17T02:23:35.603795+0000","last_fullsized":"2024-08-17T02:23:35.603795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:10.629891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.585770+0000","last_change":"2024-08-17T02:23:34.579638+0000","last_active":"2024-08-17T02:23:35.585770+0000","last_peered":"2024-08-17T02:23:35.585770+0000","last_clean":"2024-08-17T02:23:35.585770+0000","last_became_active":"2024-08-17T02:23:34.579374+0000","last_became_peered":"2024-08-17T02:23:34.579374+0000","last_unstale":"2024-08-17T02:23:35.585770+0000","last_undegraded":"2024-08-17T02:23:35.585770+0000","last_fullsized":"2024-08-17T02:23:35.585770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:28.453656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603912+0000","last_change":"2024-08-17T02:23:35.599779+0000","last_active":"2024-08-17T02:23:35.603912+0000","last_peered":"2024-08-17T02:23:35.603912+0000","last_clean":"2024-08-17T02:23:35.603912+0000","last_became_active":"2024-08-17T02:23:35.599431+0000","last_became_peered":"2024-08-17T02:23:35.599431+0000","last_unstale":"2024-08-17T02:23:35.603912+0000","last_undegraded":"2024-08-17T02:23:35.603912+0000","last_fullsized":"2024-08-17T02:23:35.603912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.610216+0000","last_change":"2024-08-17T02:23:34.587150+0000","last_active":"2024-08-17T02:23:35.610216+0000","last_peered":"2024-08-17T02:23:35.610216+0000","last_clean":"2024-08-17T02:23:35.610216+0000","last_became_active":"2024-08-17T02:23:34.586406+0000","last_became_peered":"2024-08-17T02:23:34.586406+0000","last_unstale":"2024-08-17T02:23:35.610216+0000","last_undegraded":"2024-08-17T02:23:35.610216+0000","last_fullsized":"2024-08-17T02:23:35.610216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:29:02.697073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.602428+0000","last_change":"2024-08-17T02:23:35.594894+0000","last_active":"2024-08-17T02:23:35.602428+0000","last_peered":"2024-08-17T02:23:35.602428+0000","last_clean":"2024-08-17T02:23:35.602428+0000","last_became_active":"2024-08-17T02:23:35.593967+0000","last_became_peered":"2024-08-17T02:23:35.593967+0000","last_unstale":"2024-08-17T02:23:35.602428+0000","last_undegraded":"2024-08-17T02:23:35.602428+0000","last_fullsized":"2024-08-17T02:23:35.602428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:13.277984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615851+0000","last_change":"2024-08-17T02:23:34.586772+0000","last_active":"2024-08-17T02:23:35.615851+0000","last_peered":"2024-08-17T02:23:35.615851+0000","last_clean":"2024-08-17T02:23:35.615851+0000","last_became_active":"2024-08-17T02:23:34.586079+0000","last_became_peered":"2024-08-17T02:23:34.586079+0000","last_unstale":"2024-08-17T02:23:35.615851+0000","last_undegraded":"2024-08-17T02:23:35.615851+0000","last_fullsized":"2024-08-17T02:23:35.615851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.606223+0000","last_change":"2024-08-17T02:23:35.603795+0000","last_active":"2024-08-17T02:23:35.606223+0000","last_peered":"2024-08-17T02:23:35.606223+0000","last_clean":"2024-08-17T02:23:35.606223+0000","last_became_active":"2024-08-17T02:23:35.603063+0000","last_became_peered":"2024-08-17T02:23:35.603063+0000","last_unstale":"2024-08-17T02:23:35.606223+0000","last_undegraded":"2024-08-17T02:23:35.606223+0000","last_fullsized":"2024-08-17T02:23:35.606223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:04:25.119433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.618735+0000","last_change":"2024-08-17T02:23:34.574467+0000","last_active":"2024-08-17T02:23:35.618735+0000","last_peered":"2024-08-17T02:23:35.618735+0000","last_clean":"2024-08-17T02:23:35.618735+0000","last_became_active":"2024-08-17T02:23:34.569946+0000","last_became_peered":"2024-08-17T02:23:34.569946+0000","last_unstale":"2024-08-17T02:23:35.618735+0000","last_undegraded":"2024-08-17T02:23:35.618735+0000","last_fullsized":"2024-08-17T02:23:35.618735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:20:34.979718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.598102+0000","last_change":"2024-08-17T02:23:35.592294+0000","last_active":"2024-08-17T02:23:35.598102+0000","last_peered":"2024-08-17T02:23:35.598102+0000","last_clean":"2024-08-17T02:23:35.598102+0000","last_became_active":"2024-08-17T02:23:35.591912+0000","last_became_peered":"2024-08-17T02:23:35.591912+0000","last_unstale":"2024-08-17T02:23:35.598102+0000","last_undegraded":"2024-08-17T02:23:35.598102+0000","last_fullsized":"2024-08-17T02:23:35.598102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:53.414346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583563+0000","last_change":"2024-08-17T02:23:34.587458+0000","last_active":"2024-08-17T02:23:35.583563+0000","last_peered":"2024-08-17T02:23:35.583563+0000","last_clean":"2024-08-17T02:23:35.583563+0000","last_became_active":"2024-08-17T02:23:34.587141+0000","last_became_peered":"2024-08-17T02:23:34.587141+0000","last_unstale":"2024-08-17T02:23:35.583563+0000","last_undegraded":"2024-08-17T02:23:35.583563+0000","last_fullsized":"2024-08-17T02:23:35.583563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605470+0000","last_change":"2024-08-17T02:23:35.601716+0000","last_active":"2024-08-17T02:23:35.605470+0000","last_peered":"2024-08-17T02:23:35.605470+0000","last_clean":"2024-08-17T02:23:35.605470+0000","last_became_active":"2024-08-17T02:23:35.600481+0000","last_became_peered":"2024-08-17T02:23:35.600481+0000","last_unstale":"2024-08-17T02:23:35.605470+0000","last_undegraded":"2024-08-17T02:23:35.605470+0000","last_fullsized":"2024-08-17T02:23:35.605470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:57:57.262402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.571127+0000","last_change":"2024-08-17T02:23:34.572877+0000","last_active":"2024-08-17T02:23:35.571127+0000","last_peered":"2024-08-17T02:23:35.571127+0000","last_clean":"2024-08-17T02:23:35.571127+0000","last_became_active":"2024-08-17T02:23:34.572606+0000","last_became_peered":"2024-08-17T02:23:34.572606+0000","last_unstale":"2024-08-17T02:23:35.571127+0000","last_undegraded":"2024-08-17T02:23:35.571127+0000","last_fullsized":"2024-08-17T02:23:35.571127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:28.453656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596192+0000","last_change":"2024-08-17T02:23:35.590217+0000","last_active":"2024-08-17T02:23:35.596192+0000","last_peered":"2024-08-17T02:23:35.596192+0000","last_clean":"2024-08-17T02:23:35.596192+0000","last_became_active":"2024-08-17T02:23:35.589427+0000","last_became_peered":"2024-08-17T02:23:35.589427+0000","last_unstale":"2024-08-17T02:23:35.596192+0000","last_undegraded":"2024-08-17T02:23:35.596192+0000","last_fullsized":"2024-08-17T02:23:35.596192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:53.892837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.612998+0000","last_change":"2024-08-17T02:23:34.580970+0000","last_active":"2024-08-17T02:23:35.612998+0000","last_peered":"2024-08-17T02:23:35.612998+0000","last_clean":"2024-08-17T02:23:35.612998+0000","last_became_active":"2024-08-17T02:23:34.580699+0000","last_became_peered":"2024-08-17T02:23:34.580699+0000","last_unstale":"2024-08-17T02:23:35.612998+0000","last_undegraded":"2024-08-17T02:23:35.612998+0000","last_fullsized":"2024-08-17T02:23:35.612998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605360+0000","last_change":"2024-08-17T02:23:35.600825+0000","last_active":"2024-08-17T02:23:35.605360+0000","last_peered":"2024-08-17T02:23:35.605360+0000","last_clean":"2024-08-17T02:23:35.605360+0000","last_became_active":"2024-08-17T02:23:35.600525+0000","last_became_peered":"2024-08-17T02:23:35.600525+0000","last_unstale":"2024-08-17T02:23:35.605360+0000","last_undegraded":"2024-08-17T02:23:35.605360+0000","last_fullsized":"2024-08-17T02:23:35.605360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:30.865202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615727+0000","last_change":"2024-08-17T02:23:34.568078+0000","last_active":"2024-08-17T02:23:35.615727+0000","last_peered":"2024-08-17T02:23:35.615727+0000","last_clean":"2024-08-17T02:23:35.615727+0000","last_became_active":"2024-08-17T02:23:34.567754+0000","last_became_peered":"2024-08-17T02:23:34.567754+0000","last_unstale":"2024-08-17T02:23:35.615727+0000","last_undegraded":"2024-08-17T02:23:35.615727+0000","last_fullsized":"2024-08-17T02:23:35.615727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:45.647236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605384+0000","last_change":"2024-08-17T02:23:35.600247+0000","last_active":"2024-08-17T02:23:35.605384+0000","last_peered":"2024-08-17T02:23:35.605384+0000","last_clean":"2024-08-17T02:23:35.605384+0000","last_became_active":"2024-08-17T02:23:35.599892+0000","last_became_peered":"2024-08-17T02:23:35.599892+0000","last_unstale":"2024-08-17T02:23:35.605384+0000","last_undegraded":"2024-08-17T02:23:35.605384+0000","last_fullsized":"2024-08-17T02:23:35.605384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.609828+0000","last_change":"2024-08-17T02:23:34.577876+0000","last_active":"2024-08-17T02:23:35.609828+0000","last_peered":"2024-08-17T02:23:35.609828+0000","last_clean":"2024-08-17T02:23:35.609828+0000","last_became_active":"2024-08-17T02:23:34.577501+0000","last_became_peered":"2024-08-17T02:23:34.577501+0000","last_unstale":"2024-08-17T02:23:35.609828+0000","last_undegraded":"2024-08-17T02:23:35.609828+0000","last_fullsized":"2024-08-17T02:23:35.609828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:33.519680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.606464+0000","last_change":"2024-08-17T02:23:35.604376+0000","last_active":"2024-08-17T02:23:35.606464+0000","last_peered":"2024-08-17T02:23:35.606464+0000","last_clean":"2024-08-17T02:23:35.606464+0000","last_became_active":"2024-08-17T02:23:35.604116+0000","last_became_peered":"2024-08-17T02:23:35.604116+0000","last_unstale":"2024-08-17T02:23:35.606464+0000","last_undegraded":"2024-08-17T02:23:35.606464+0000","last_fullsized":"2024-08-17T02:23:35.606464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:58.699491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.613587+0000","last_change":"2024-08-17T02:23:34.585195+0000","last_active":"2024-08-17T02:23:35.613587+0000","last_peered":"2024-08-17T02:23:35.613587+0000","last_clean":"2024-08-17T02:23:35.613587+0000","last_became_active":"2024-08-17T02:23:34.584875+0000","last_became_peered":"2024-08-17T02:23:34.584875+0000","last_unstale":"2024-08-17T02:23:35.613587+0000","last_undegraded":"2024-08-17T02:23:35.613587+0000","last_fullsized":"2024-08-17T02:23:35.613587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:00.835021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.594448+0000","last_change":"2024-08-17T02:23:35.589341+0000","last_active":"2024-08-17T02:23:35.594448+0000","last_peered":"2024-08-17T02:23:35.594448+0000","last_clean":"2024-08-17T02:23:35.594448+0000","last_became_active":"2024-08-17T02:23:35.588957+0000","last_became_peered":"2024-08-17T02:23:35.588957+0000","last_unstale":"2024-08-17T02:23:35.594448+0000","last_undegraded":"2024-08-17T02:23:35.594448+0000","last_fullsized":"2024-08-17T02:23:35.594448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:57:57.262402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.576331+0000","last_change":"2024-08-17T02:23:34.587854+0000","last_active":"2024-08-17T02:23:35.576331+0000","last_peered":"2024-08-17T02:23:35.576331+0000","last_clean":"2024-08-17T02:23:35.576331+0000","last_became_active":"2024-08-17T02:23:34.587549+0000","last_became_peered":"2024-08-17T02:23:34.587549+0000","last_unstale":"2024-08-17T02:23:35.576331+0000","last_undegraded":"2024-08-17T02:23:35.576331+0000","last_fullsized":"2024-08-17T02:23:35.576331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:00.835021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.602005+0000","last_change":"2024-08-17T02:23:35.596727+0000","last_active":"2024-08-17T02:23:35.602005+0000","last_peered":"2024-08-17T02:23:35.602005+0000","last_clean":"2024-08-17T02:23:35.602005+0000","last_became_active":"2024-08-17T02:23:35.596442+0000","last_became_peered":"2024-08-17T02:23:35.596442+0000","last_unstale":"2024-08-17T02:23:35.602005+0000","last_undegraded":"2024-08-17T02:23:35.602005+0000","last_fullsized":"2024-08-17T02:23:35.602005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:53.779150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.580926+0000","last_change":"2024-08-17T02:23:30.651033+0000","last_active":"2024-08-17T02:23:35.580926+0000","last_peered":"2024-08-17T02:23:35.580926+0000","last_clean":"2024-08-17T02:23:35.580926+0000","last_became_active":"2024-08-17T02:23:30.649860+0000","last_became_peered":"2024-08-17T02:23:30.649860+0000","last_unstale":"2024-08-17T02:23:35.580926+0000","last_undegraded":"2024-08-17T02:23:35.580926+0000","last_fullsized":"2024-08-17T02:23:35.580926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.523857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:29:35.288625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583338+0000","last_change":"2024-08-17T02:23:34.574229+0000","last_active":"2024-08-17T02:23:35.583338+0000","last_peered":"2024-08-17T02:23:35.583338+0000","last_clean":"2024-08-17T02:23:35.583338+0000","last_became_active":"2024-08-17T02:23:34.573885+0000","last_became_peered":"2024-08-17T02:23:34.573885+0000","last_unstale":"2024-08-17T02:23:35.583338+0000","last_undegraded":"2024-08-17T02:23:35.583338+0000","last_fullsized":"2024-08-17T02:23:35.583338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:33.519680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.602258+0000","last_change":"2024-08-17T02:23:35.593836+0000","last_active":"2024-08-17T02:23:35.602258+0000","last_peered":"2024-08-17T02:23:35.602258+0000","last_clean":"2024-08-17T02:23:35.602258+0000","last_became_active":"2024-08-17T02:23:35.593564+0000","last_became_peered":"2024-08-17T02:23:35.593564+0000","last_unstale":"2024-08-17T02:23:35.602258+0000","last_undegraded":"2024-08-17T02:23:35.602258+0000","last_fullsized":"2024-08-17T02:23:35.602258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:47.878023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.580838+0000","last_change":"2024-08-17T02:23:34.582041+0000","last_active":"2024-08-17T02:23:35.580838+0000","last_peered":"2024-08-17T02:23:35.580838+0000","last_clean":"2024-08-17T02:23:35.580838+0000","last_became_active":"2024-08-17T02:23:34.581786+0000","last_became_peered":"2024-08-17T02:23:34.581786+0000","last_unstale":"2024-08-17T02:23:35.580838+0000","last_undegraded":"2024-08-17T02:23:35.580838+0000","last_fullsized":"2024-08-17T02:23:35.580838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:53.571063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.598226+0000","last_change":"2024-08-17T02:23:35.593384+0000","last_active":"2024-08-17T02:23:35.598226+0000","last_peered":"2024-08-17T02:23:35.598226+0000","last_clean":"2024-08-17T02:23:35.598226+0000","last_became_active":"2024-08-17T02:23:35.593105+0000","last_became_peered":"2024-08-17T02:23:35.593105+0000","last_unstale":"2024-08-17T02:23:35.598226+0000","last_undegraded":"2024-08-17T02:23:35.598226+0000","last_fullsized":"2024-08-17T02:23:35.598226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:19:09.314565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.576062+0000","last_change":"2024-08-17T02:23:34.577822+0000","last_active":"2024-08-17T02:23:35.576062+0000","last_peered":"2024-08-17T02:23:35.576062+0000","last_clean":"2024-08-17T02:23:35.576062+0000","last_became_active":"2024-08-17T02:23:34.577467+0000","last_became_peered":"2024-08-17T02:23:34.577467+0000","last_unstale":"2024-08-17T02:23:35.576062+0000","last_undegraded":"2024-08-17T02:23:35.576062+0000","last_fullsized":"2024-08-17T02:23:35.576062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.588280+0000","last_change":"2024-08-17T02:23:35.584388+0000","last_active":"2024-08-17T02:23:35.588280+0000","last_peered":"2024-08-17T02:23:35.588280+0000","last_clean":"2024-08-17T02:23:35.588280+0000","last_became_active":"2024-08-17T02:23:35.584056+0000","last_became_peered":"2024-08-17T02:23:35.584056+0000","last_unstale":"2024-08-17T02:23:35.588280+0000","last_undegraded":"2024-08-17T02:23:35.588280+0000","last_fullsized":"2024-08-17T02:23:35.588280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:37.276820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583764+0000","last_change":"2024-08-17T02:23:34.585609+0000","last_active":"2024-08-17T02:23:35.583764+0000","last_peered":"2024-08-17T02:23:35.583764+0000","last_clean":"2024-08-17T02:23:35.583764+0000","last_became_active":"2024-08-17T02:23:34.585328+0000","last_became_peered":"2024-08-17T02:23:34.585328+0000","last_unstale":"2024-08-17T02:23:35.583764+0000","last_undegraded":"2024-08-17T02:23:35.583764+0000","last_fullsized":"2024-08-17T02:23:35.583764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.593219+0000","last_change":"2024-08-17T02:23:35.582716+0000","last_active":"2024-08-17T02:23:35.593219+0000","last_peered":"2024-08-17T02:23:35.593219+0000","last_clean":"2024-08-17T02:23:35.593219+0000","last_became_active":"2024-08-17T02:23:35.582042+0000","last_became_peered":"2024-08-17T02:23:35.582042+0000","last_unstale":"2024-08-17T02:23:35.593219+0000","last_undegraded":"2024-08-17T02:23:35.593219+0000","last_fullsized":"2024-08-17T02:23:35.593219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:19.127243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.570431+0000","last_change":"2024-08-17T02:23:34.579748+0000","last_active":"2024-08-17T02:23:35.570431+0000","last_peered":"2024-08-17T02:23:35.570431+0000","last_clean":"2024-08-17T02:23:35.570431+0000","last_became_active":"2024-08-17T02:23:34.579282+0000","last_became_peered":"2024-08-17T02:23:34.579282+0000","last_unstale":"2024-08-17T02:23:35.570431+0000","last_undegraded":"2024-08-17T02:23:35.570431+0000","last_fullsized":"2024-08-17T02:23:35.570431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:53.571063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604616+0000","last_change":"2024-08-17T02:23:35.599794+0000","last_active":"2024-08-17T02:23:35.604616+0000","last_peered":"2024-08-17T02:23:35.604616+0000","last_clean":"2024-08-17T02:23:35.604616+0000","last_became_active":"2024-08-17T02:23:35.596190+0000","last_became_peered":"2024-08-17T02:23:35.596190+0000","last_unstale":"2024-08-17T02:23:35.604616+0000","last_undegraded":"2024-08-17T02:23:35.604616+0000","last_fullsized":"2024-08-17T02:23:35.604616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583507+0000","last_change":"2024-08-17T02:23:34.585808+0000","last_active":"2024-08-17T02:23:35.583507+0000","last_peered":"2024-08-17T02:23:35.583507+0000","last_clean":"2024-08-17T02:23:35.583507+0000","last_became_active":"2024-08-17T02:23:34.584698+0000","last_became_peered":"2024-08-17T02:23:34.584698+0000","last_unstale":"2024-08-17T02:23:35.583507+0000","last_undegraded":"2024-08-17T02:23:35.583507+0000","last_fullsized":"2024-08-17T02:23:35.583507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:29:02.697073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.588719+0000","last_change":"2024-08-17T02:23:35.584214+0000","last_active":"2024-08-17T02:23:35.588719+0000","last_peered":"2024-08-17T02:23:35.588719+0000","last_clean":"2024-08-17T02:23:35.588719+0000","last_became_active":"2024-08-17T02:23:35.583938+0000","last_became_peered":"2024-08-17T02:23:35.583938+0000","last_unstale":"2024-08-17T02:23:35.588719+0000","last_undegraded":"2024-08-17T02:23:35.588719+0000","last_fullsized":"2024-08-17T02:23:35.588719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:16.596695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.569971+0000","last_change":"2024-08-17T02:23:34.576832+0000","last_active":"2024-08-17T02:23:35.569971+0000","last_peered":"2024-08-17T02:23:35.569971+0000","last_clean":"2024-08-17T02:23:35.569971+0000","last_became_active":"2024-08-17T02:23:34.576507+0000","last_became_peered":"2024-08-17T02:23:34.576507+0000","last_unstale":"2024-08-17T02:23:35.569971+0000","last_undegraded":"2024-08-17T02:23:35.569971+0000","last_fullsized":"2024-08-17T02:23:35.569971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.591343+0000","last_change":"2024-08-17T02:23:35.590465+0000","last_active":"2024-08-17T02:23:35.591343+0000","last_peered":"2024-08-17T02:23:35.591343+0000","last_clean":"2024-08-17T02:23:35.591343+0000","last_became_active":"2024-08-17T02:23:35.590114+0000","last_became_peered":"2024-08-17T02:23:35.590114+0000","last_unstale":"2024-08-17T02:23:35.591343+0000","last_undegraded":"2024-08-17T02:23:35.591343+0000","last_fullsized":"2024-08-17T02:23:35.591343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:53.892837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615597+0000","last_change":"2024-08-17T02:23:34.579565+0000","last_active":"2024-08-17T02:23:35.615597+0000","last_peered":"2024-08-17T02:23:35.615597+0000","last_clean":"2024-08-17T02:23:35.615597+0000","last_became_active":"2024-08-17T02:23:34.579256+0000","last_became_peered":"2024-08-17T02:23:34.579256+0000","last_unstale":"2024-08-17T02:23:35.615597+0000","last_undegraded":"2024-08-17T02:23:35.615597+0000","last_fullsized":"2024-08-17T02:23:35.615597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:33.519680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.598466+0000","last_change":"2024-08-17T02:23:35.591642+0000","last_active":"2024-08-17T02:23:35.598466+0000","last_peered":"2024-08-17T02:23:35.598466+0000","last_clean":"2024-08-17T02:23:35.598466+0000","last_became_active":"2024-08-17T02:23:35.591364+0000","last_became_peered":"2024-08-17T02:23:35.591364+0000","last_unstale":"2024-08-17T02:23:35.598466+0000","last_undegraded":"2024-08-17T02:23:35.598466+0000","last_fullsized":"2024-08-17T02:23:35.598466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:10.629891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.580732+0000","last_change":"2024-08-17T02:23:34.584710+0000","last_active":"2024-08-17T02:23:35.580732+0000","last_peered":"2024-08-17T02:23:35.580732+0000","last_clean":"2024-08-17T02:23:35.580732+0000","last_became_active":"2024-08-17T02:23:34.584459+0000","last_became_peered":"2024-08-17T02:23:34.584459+0000","last_unstale":"2024-08-17T02:23:35.580732+0000","last_undegraded":"2024-08-17T02:23:35.580732+0000","last_fullsized":"2024-08-17T02:23:35.580732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.592273+0000","last_change":"2024-08-17T02:23:35.579802+0000","last_active":"2024-08-17T02:23:35.592273+0000","last_peered":"2024-08-17T02:23:35.592273+0000","last_clean":"2024-08-17T02:23:35.592273+0000","last_became_active":"2024-08-17T02:23:35.579505+0000","last_became_peered":"2024-08-17T02:23:35.579505+0000","last_unstale":"2024-08-17T02:23:35.592273+0000","last_undegraded":"2024-08-17T02:23:35.592273+0000","last_fullsized":"2024-08-17T02:23:35.592273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:51.900850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.569935+0000","last_change":"2024-08-17T02:23:34.584346+0000","last_active":"2024-08-17T02:23:35.569935+0000","last_peered":"2024-08-17T02:23:35.569935+0000","last_clean":"2024-08-17T02:23:35.569935+0000","last_became_active":"2024-08-17T02:23:34.584030+0000","last_became_peered":"2024-08-17T02:23:34.584030+0000","last_unstale":"2024-08-17T02:23:35.569935+0000","last_undegraded":"2024-08-17T02:23:35.569935+0000","last_fullsized":"2024-08-17T02:23:35.569935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.602212+0000","last_change":"2024-08-17T02:23:35.593165+0000","last_active":"2024-08-17T02:23:35.602212+0000","last_peered":"2024-08-17T02:23:35.602212+0000","last_clean":"2024-08-17T02:23:35.602212+0000","last_became_active":"2024-08-17T02:23:35.585416+0000","last_became_peered":"2024-08-17T02:23:35.585416+0000","last_unstale":"2024-08-17T02:23:35.602212+0000","last_undegraded":"2024-08-17T02:23:35.602212+0000","last_fullsized":"2024-08-17T02:23:35.602212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:10.629891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.569524+0000","last_change":"2024-08-17T02:23:34.586914+0000","last_active":"2024-08-17T02:23:35.569524+0000","last_peered":"2024-08-17T02:23:35.569524+0000","last_clean":"2024-08-17T02:23:35.569524+0000","last_became_active":"2024-08-17T02:23:34.586476+0000","last_became_peered":"2024-08-17T02:23:34.586476+0000","last_unstale":"2024-08-17T02:23:35.569524+0000","last_undegraded":"2024-08-17T02:23:35.569524+0000","last_fullsized":"2024-08-17T02:23:35.569524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:20:34.979718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.589645+0000","last_change":"2024-08-17T02:23:35.585526+0000","last_active":"2024-08-17T02:23:35.589645+0000","last_peered":"2024-08-17T02:23:35.589645+0000","last_clean":"2024-08-17T02:23:35.589645+0000","last_became_active":"2024-08-17T02:23:35.585223+0000","last_became_peered":"2024-08-17T02:23:35.585223+0000","last_unstale":"2024-08-17T02:23:35.589645+0000","last_undegraded":"2024-08-17T02:23:35.589645+0000","last_fullsized":"2024-08-17T02:23:35.589645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:37.276820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615445+0000","last_change":"2024-08-17T02:23:34.583608+0000","last_active":"2024-08-17T02:23:35.615445+0000","last_peered":"2024-08-17T02:23:35.615445+0000","last_clean":"2024-08-17T02:23:35.615445+0000","last_became_active":"2024-08-17T02:23:34.583262+0000","last_became_peered":"2024-08-17T02:23:34.583262+0000","last_unstale":"2024-08-17T02:23:35.615445+0000","last_undegraded":"2024-08-17T02:23:35.615445+0000","last_fullsized":"2024-08-17T02:23:35.615445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.584243+0000","last_change":"2024-08-17T02:23:35.582216+0000","last_active":"2024-08-17T02:23:35.584243+0000","last_peered":"2024-08-17T02:23:35.584243+0000","last_clean":"2024-08-17T02:23:35.584243+0000","last_became_active":"2024-08-17T02:23:35.581896+0000","last_became_peered":"2024-08-17T02:23:35.581896+0000","last_unstale":"2024-08-17T02:23:35.584243+0000","last_undegraded":"2024-08-17T02:23:35.584243+0000","last_fullsized":"2024-08-17T02:23:35.584243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:37.276820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604633+0000","last_change":"2024-08-17T02:23:35.600164+0000","last_active":"2024-08-17T02:23:35.604633+0000","last_peered":"2024-08-17T02:23:35.604633+0000","last_clean":"2024-08-17T02:23:35.604633+0000","last_became_active":"2024-08-17T02:23:35.594009+0000","last_became_peered":"2024-08-17T02:23:35.594009+0000","last_unstale":"2024-08-17T02:23:35.604633+0000","last_undegraded":"2024-08-17T02:23:35.604633+0000","last_fullsized":"2024-08-17T02:23:35.604633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:04:25.119433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615820+0000","last_change":"2024-08-17T02:23:34.586673+0000","last_active":"2024-08-17T02:23:35.615820+0000","last_peered":"2024-08-17T02:23:35.615820+0000","last_clean":"2024-08-17T02:23:35.615820+0000","last_became_active":"2024-08-17T02:23:34.586204+0000","last_became_peered":"2024-08-17T02:23:34.586204+0000","last_unstale":"2024-08-17T02:23:35.615820+0000","last_undegraded":"2024-08-17T02:23:35.615820+0000","last_fullsized":"2024-08-17T02:23:35.615820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:54:12.191670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603990+0000","last_change":"2024-08-17T02:23:35.597722+0000","last_active":"2024-08-17T02:23:35.603990+0000","last_peered":"2024-08-17T02:23:35.603990+0000","last_clean":"2024-08-17T02:23:35.603990+0000","last_became_active":"2024-08-17T02:23:35.593591+0000","last_became_peered":"2024-08-17T02:23:35.593591+0000","last_unstale":"2024-08-17T02:23:35.603990+0000","last_undegraded":"2024-08-17T02:23:35.603990+0000","last_fullsized":"2024-08-17T02:23:35.603990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:54:21.053209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.612181+0000","last_change":"2024-08-17T02:23:34.576713+0000","last_active":"2024-08-17T02:23:35.612181+0000","last_peered":"2024-08-17T02:23:35.612181+0000","last_clean":"2024-08-17T02:23:35.612181+0000","last_became_active":"2024-08-17T02:23:34.576458+0000","last_became_peered":"2024-08-17T02:23:34.576458+0000","last_unstale":"2024-08-17T02:23:35.612181+0000","last_undegraded":"2024-08-17T02:23:35.612181+0000","last_fullsized":"2024-08-17T02:23:35.612181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:00.835021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603641+0000","last_change":"2024-08-17T02:23:35.597367+0000","last_active":"2024-08-17T02:23:35.603641+0000","last_peered":"2024-08-17T02:23:35.603641+0000","last_clean":"2024-08-17T02:23:35.603641+0000","last_became_active":"2024-08-17T02:23:35.597133+0000","last_became_peered":"2024-08-17T02:23:35.597133+0000","last_unstale":"2024-08-17T02:23:35.603641+0000","last_undegraded":"2024-08-17T02:23:35.603641+0000","last_fullsized":"2024-08-17T02:23:35.603641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.610320+0000","last_change":"2024-08-17T02:23:34.573028+0000","last_active":"2024-08-17T02:23:35.610320+0000","last_peered":"2024-08-17T02:23:35.610320+0000","last_clean":"2024-08-17T02:23:35.610320+0000","last_became_active":"2024-08-17T02:23:34.572521+0000","last_became_peered":"2024-08-17T02:23:34.572521+0000","last_unstale":"2024-08-17T02:23:35.610320+0000","last_undegraded":"2024-08-17T02:23:35.610320+0000","last_fullsized":"2024-08-17T02:23:35.610320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:20:34.979718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.590393+0000","last_change":"2024-08-17T02:23:35.587484+0000","last_active":"2024-08-17T02:23:35.590393+0000","last_peered":"2024-08-17T02:23:35.590393+0000","last_clean":"2024-08-17T02:23:35.590393+0000","last_became_active":"2024-08-17T02:23:35.585250+0000","last_became_peered":"2024-08-17T02:23:35.585250+0000","last_unstale":"2024-08-17T02:23:35.590393+0000","last_undegraded":"2024-08-17T02:23:35.590393+0000","last_fullsized":"2024-08-17T02:23:35.590393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.616297+0000","last_change":"2024-08-17T02:23:34.577769+0000","last_active":"2024-08-17T02:23:35.616297+0000","last_peered":"2024-08-17T02:23:35.616297+0000","last_clean":"2024-08-17T02:23:35.616297+0000","last_became_active":"2024-08-17T02:23:34.576757+0000","last_became_peered":"2024-08-17T02:23:34.576757+0000","last_unstale":"2024-08-17T02:23:35.616297+0000","last_undegraded":"2024-08-17T02:23:35.616297+0000","last_fullsized":"2024-08-17T02:23:35.616297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:05:52.667388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":823296,"data_stored":669534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":237568,"data_stored":80148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":72398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":237568,"data_stored":78722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301752,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070088,"statfs":{"total":96636764160,"available":96327770112,"internally_reserved":0,"allocated":237568,"data_stored":80148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":225280,"data_stored":78596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301748,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070092,"statfs":{"total":96636764160,"available":96327774208,"internally_reserved":0,"allocated":233472,"data_stored":78756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302328,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069512,"statfs":{"total":96636764160,"available":96327180288,"internally_reserved":0,"allocated":831488,"data_stored":669590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:23:40.220 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:23:40.220 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:23:40.221 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:23:40.221 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:23:40.221 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:23:40.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.407+0000 7fdce7200640 1 Processor -- start 2024-08-17T02:23:40.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.408+0000 7fdce7200640 1 -- start start 2024-08-17T02:23:40.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.409+0000 7fdce7200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdce8156f90 0x7fdce80b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.409+0000 7fdce7200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdce815a590 0x7fdce813fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.409+0000 7fdce7200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce806d7c0 con 0x7fdce80b0e30 2024-08-17T02:23:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.409+0000 7fdce7200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce815ab30 con 0x7fdce8156f90 2024-08-17T02:23:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.409+0000 7fdce7200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce815ae10 con 0x7fdce815a590 2024-08-17T02:23:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.409+0000 7fdce5e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdce80b0e30 0x7fdce80cb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49214/0 (socket says 172.21.15.5:49214) 2024-08-17T02:23:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.409+0000 7fdce5e00640 1 -- 172.21.15.5:0/775963885 learned_addr learned my addr 172.21.15.5:0/775963885 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:40.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.409+0000 7fdcdfe00640 1 --2- 172.21.15.5:0/775963885 >> v2:172.21.15.5:3300/0 conn(0x7fdce8156f90 0x7fdce80b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.409+0000 7fdce6800640 1 --2- 172.21.15.5:0/775963885 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdce815a590 0x7fdce813fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.410+0000 7fdce5400640 1 -- 172.21.15.5:0/775963885 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552438696 0 0) 0x7fdce806d7c0 con 0x7fdce80b0e30 2024-08-17T02:23:40.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.410+0000 7fdce5400640 1 -- 172.21.15.5:0/775963885 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdccc0034e0 con 0x7fdce80b0e30 2024-08-17T02:23:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.410+0000 7fdcdfe00640 1 -- 172.21.15.5:0/775963885 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdce815a590 msgr2=0x7fdce813fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.410+0000 7fdcdfe00640 1 --2- 172.21.15.5:0/775963885 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdce815a590 0x7fdce813fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.410+0000 7fdcdfe00640 1 -- 172.21.15.5:0/775963885 >> v1:172.21.15.5:6789/0 conn(0x7fdce80b0e30 legacy=0x7fdce80cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.410+0000 7fdcdfe00640 1 -- 172.21.15.5:0/775963885 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce815b0f0 con 0x7fdce8156f90 2024-08-17T02:23:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.410+0000 7fdce6800640 1 --2- 172.21.15.5:0/775963885 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdce815a590 0x7fdce813fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.411+0000 7fdcdfe00640 1 --2- 172.21.15.5:0/775963885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce8156f90 0x7fdce80b1200 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009850 tx=0x7fdcd00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da58a1c378693d78 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.411+0000 7fdce5400640 1 -- 172.21.15.5:0/775963885 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd002ad90 con 0x7fdce8156f90 2024-08-17T02:23:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.411+0000 7fdce5400640 1 -- 172.21.15.5:0/775963885 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd0032440 con 0x7fdce8156f90 2024-08-17T02:23:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.411+0000 7fdce5400640 1 -- 172.21.15.5:0/775963885 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0032820 con 0x7fdce8156f90 2024-08-17T02:23:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.411+0000 7fdce7200640 1 -- 172.21.15.5:0/775963885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce8156f90 msgr2=0x7fdce80b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.411+0000 7fdce7200640 1 --2- 172.21.15.5:0/775963885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce8156f90 0x7fdce80b1200 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009850 tx=0x7fdcd00090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.412+0000 7fdce7200640 1 -- 172.21.15.5:0/775963885 shutdown_connections 2024-08-17T02:23:40.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.412+0000 7fdce7200640 1 --2- 172.21.15.5:0/775963885 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdce815a590 0x7fdce813fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.412+0000 7fdce7200640 1 --2- 172.21.15.5:0/775963885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce8156f90 0x7fdce80b1200 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.412+0000 7fdce7200640 1 -- 172.21.15.5:0/775963885 >> 172.21.15.5:0/775963885 conn(0x7fdce8062af0 msgr2=0x7fdce8062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.412+0000 7fdce7200640 1 -- 172.21.15.5:0/775963885 shutdown_connections 2024-08-17T02:23:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.412+0000 7fdce7200640 1 -- 172.21.15.5:0/775963885 wait complete. 2024-08-17T02:23:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.413+0000 7fdce7200640 1 Processor -- start 2024-08-17T02:23:40.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.413+0000 7fdce7200640 1 -- start start 2024-08-17T02:23:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.414+0000 7fdce7200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce80b0e30 0x7fdce8159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.414+0000 7fdce7200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdce8156f90 0x7fdce8136160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.414+0000 7fdce7200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdce815a590 0x7fdce813e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.414+0000 7fdce7200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce81597a0 con 0x7fdce80b0e30 2024-08-17T02:23:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.414+0000 7fdce7200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce8158b90 con 0x7fdce815a590 2024-08-17T02:23:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.414+0000 7fdce7200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce8158e70 con 0x7fdce8156f90 2024-08-17T02:23:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.414+0000 7fdce5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce80b0e30 0x7fdce8159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.414+0000 7fdce5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce80b0e30 0x7fdce8159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43734/0 (socket says 172.21.15.5:43734) 2024-08-17T02:23:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.414+0000 7fdce5e00640 1 -- 172.21.15.5:0/3887583071 learned_addr learned my addr 172.21.15.5:0/3887583071 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.415+0000 7fdce5e00640 1 -- 172.21.15.5:0/3887583071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdce8156f90 msgr2=0x7fdce8136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.415+0000 7fdce5e00640 1 --2- 172.21.15.5:0/3887583071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdce8156f90 0x7fdce8136160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.415+0000 7fdce5e00640 1 -- 172.21.15.5:0/3887583071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdce815a590 msgr2=0x7fdce813e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.415+0000 7fdce5e00640 1 --2- 172.21.15.5:0/3887583071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdce815a590 0x7fdce813e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.415+0000 7fdce5e00640 1 -- 172.21.15.5:0/3887583071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd0009390 con 0x7fdce80b0e30 2024-08-17T02:23:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.415+0000 7fdce5e00640 1 --2- 172.21.15.5:0/3887583071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce80b0e30 0x7fdce8159c30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800c590 tx=0x7fdcd8007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.415+0000 7fdcdd600640 1 -- 172.21.15.5:0/3887583071 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8005aa0 con 0x7fdce80b0e30 2024-08-17T02:23:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.415+0000 7fdcdd600640 1 -- 172.21.15.5:0/3887583071 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd8005c40 con 0x7fdce80b0e30 2024-08-17T02:23:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.415+0000 7fdcdd600640 1 -- 172.21.15.5:0/3887583071 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd80070f0 con 0x7fdce80b0e30 2024-08-17T02:23:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.415+0000 7fdce7200640 1 -- 172.21.15.5:0/3887583071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce8159150 con 0x7fdce80b0e30 2024-08-17T02:23:40.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.415+0000 7fdce7200640 1 -- 172.21.15.5:0/3887583071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce815a170 con 0x7fdce80b0e30 2024-08-17T02:23:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.416+0000 7fdce7200640 1 -- 172.21.15.5:0/3887583071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce8070720 con 0x7fdce80b0e30 2024-08-17T02:23:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.417+0000 7fdcdd600640 1 -- 172.21.15.5:0/3887583071 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdcd8007520 con 0x7fdce80b0e30 2024-08-17T02:23:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.418+0000 7fdcdd600640 1 --2- 172.21.15.5:0/3887583071 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdcc4065150 0x7fdcc4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.418+0000 7fdcdd600640 1 -- 172.21.15.5:0/3887583071 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdcd8081fa0 con 0x7fdce80b0e30 2024-08-17T02:23:40.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.418+0000 7fdcdfe00640 1 --2- 172.21.15.5:0/3887583071 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdcc4065150 0x7fdcc4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.419+0000 7fdcdfe00640 1 --2- 172.21.15.5:0/3887583071 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdcc4065150 0x7fdcc4067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0034000 tx=0x7fdcd0032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.422+0000 7fdcdd600640 1 -- 172.21.15.5:0/3887583071 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdcd8050040 con 0x7fdce80b0e30 2024-08-17T02:23:40.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.657+0000 7fdce7200640 1 -- 172.21.15.5:0/3887583071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fdce813d0a0 con 0x7fdce80b0e30 2024-08-17T02:23:40.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.660+0000 7fdcdd600640 1 -- 172.21.15.5:0/3887583071 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161023 (secure 0 0 0) 0x7fdcd8053660 con 0x7fdce80b0e30 2024-08-17T02:23:40.662 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:40.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.663+0000 7fdce7200640 1 -- 172.21.15.5:0/3887583071 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdcc4065150 msgr2=0x7fdcc4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.663+0000 7fdce7200640 1 --2- 172.21.15.5:0/3887583071 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdcc4065150 0x7fdcc4067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0034000 tx=0x7fdcd0032000 comp rx=0 tx=0).stop 2024-08-17T02:23:40.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.663+0000 7fdce7200640 1 -- 172.21.15.5:0/3887583071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce80b0e30 msgr2=0x7fdce8159c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.663+0000 7fdce7200640 1 --2- 172.21.15.5:0/3887583071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce80b0e30 0x7fdce8159c30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800c590 tx=0x7fdcd8007d40 comp rx=0 tx=0).stop 2024-08-17T02:23:40.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.663+0000 7fdce7200640 1 -- 172.21.15.5:0/3887583071 shutdown_connections 2024-08-17T02:23:40.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.663+0000 7fdce7200640 1 --2- 172.21.15.5:0/3887583071 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdcc4065150 0x7fdcc4067600 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.663+0000 7fdce7200640 1 --2- 172.21.15.5:0/3887583071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdce8156f90 0x7fdce8136160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.663+0000 7fdce7200640 1 --2- 172.21.15.5:0/3887583071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdce815a590 0x7fdce813e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.663+0000 7fdce7200640 1 --2- 172.21.15.5:0/3887583071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce80b0e30 0x7fdce8159c30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.663+0000 7fdce7200640 1 -- 172.21.15.5:0/3887583071 >> 172.21.15.5:0/3887583071 conn(0x7fdce8062af0 msgr2=0x7fdce80aee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.663+0000 7fdce7200640 1 -- 172.21.15.5:0/3887583071 shutdown_connections 2024-08-17T02:23:40.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.663+0000 7fdce7200640 1 -- 172.21.15.5:0/3887583071 wait complete. 2024-08-17T02:23:40.678 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":36852},{"type":"v1","addr":"172.21.15.5:6833","nonce":36852}]},"active_addr":"172.21.15.5:6833/36852","active_change":"2024-08-17T02:23:20.709182+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":3279046780}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":3688937544}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":364000914}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":2818866207}]}]} 2024-08-17T02:23:40.681 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:23:40.681 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:23:40.682 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:40.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.832+0000 7f59e0e00640 1 Processor -- start 2024-08-17T02:23:40.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.832+0000 7f59e0e00640 1 -- start start 2024-08-17T02:23:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.833+0000 7f59e0e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f59dc158c60 0x7f59dc0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.833+0000 7f59e0e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59dc159030 0x7f59dc0b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.833+0000 7f59e0e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59dc0cbd40 0x7f59dc0cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.833+0000 7f59e0e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc0b2ae0 con 0x7f59dc159030 2024-08-17T02:23:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.833+0000 7f59e0e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc0b2dc0 con 0x7f59dc158c60 2024-08-17T02:23:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.833+0000 7f59e0e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0b25f0 con 0x7f59dc0cbd40 2024-08-17T02:23:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.834+0000 7f59d9400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59dc159030 0x7f59dc0b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.834+0000 7f59d9400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59dc159030 0x7f59dc0b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43746/0 (socket says 172.21.15.5:43746) 2024-08-17T02:23:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.834+0000 7f59d9400640 1 -- 172.21.15.5:0/609389292 learned_addr learned my addr 172.21.15.5:0/609389292 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.834+0000 7f59d9e00640 1 --2- 172.21.15.5:0/609389292 >> v2:172.21.15.87:3300/0 conn(0x7f59dc158c60 0x7f59dc0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.834+0000 7f59da800640 1 --2- 172.21.15.5:0/609389292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59dc0cbd40 0x7f59dc0cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.834+0000 7f59d9400640 1 -- 172.21.15.5:0/609389292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59dc0cbd40 msgr2=0x7f59dc0cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.834+0000 7f59d9400640 1 --2- 172.21.15.5:0/609389292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59dc0cbd40 0x7f59dc0cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.834+0000 7f59d9400640 1 -- 172.21.15.5:0/609389292 >> v2:172.21.15.87:3300/0 conn(0x7f59dc158c60 msgr2=0x7f59dc0b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.834+0000 7f59d9400640 1 --2- 172.21.15.5:0/609389292 >> v2:172.21.15.87:3300/0 conn(0x7f59dc158c60 0x7f59dc0b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.834+0000 7f59d9400640 1 -- 172.21.15.5:0/609389292 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc0cca80 con 0x7f59dc159030 2024-08-17T02:23:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.835+0000 7f59d9400640 1 --2- 172.21.15.5:0/609389292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc159030 0x7f59dc0b20b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0cfc70 tx=0x7f59c40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a434691548eed4b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.835+0000 7f59d8a00640 1 -- 172.21.15.5:0/609389292 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c402ad40 con 0x7f59dc159030 2024-08-17T02:23:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.835+0000 7f59d8a00640 1 -- 172.21.15.5:0/609389292 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c4032440 con 0x7f59dc159030 2024-08-17T02:23:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.835+0000 7f59d8a00640 1 -- 172.21.15.5:0/609389292 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c402aea0 con 0x7f59dc159030 2024-08-17T02:23:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.836+0000 7f59e0e00640 1 -- 172.21.15.5:0/609389292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc159030 msgr2=0x7f59dc0b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.836+0000 7f59e0e00640 1 --2- 172.21.15.5:0/609389292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc159030 0x7f59dc0b20b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0cfc70 tx=0x7f59c40091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.836+0000 7f59e0e00640 1 -- 172.21.15.5:0/609389292 shutdown_connections 2024-08-17T02:23:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.836+0000 7f59e0e00640 1 --2- 172.21.15.5:0/609389292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59dc0cbd40 0x7f59dc0cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.836+0000 7f59e0e00640 1 --2- 172.21.15.5:0/609389292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc159030 0x7f59dc0b20b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.836+0000 7f59e0e00640 1 --2- 172.21.15.5:0/609389292 >> v2:172.21.15.87:3300/0 conn(0x7f59dc158c60 0x7f59dc0b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.836+0000 7f59e0e00640 1 -- 172.21.15.5:0/609389292 >> 172.21.15.5:0/609389292 conn(0x7f59dc06e590 msgr2=0x7f59dc06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:40.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.836+0000 7f59e0e00640 1 -- 172.21.15.5:0/609389292 shutdown_connections 2024-08-17T02:23:40.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.836+0000 7f59e0e00640 1 -- 172.21.15.5:0/609389292 wait complete. 2024-08-17T02:23:40.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.837+0000 7f59e0e00640 1 Processor -- start 2024-08-17T02:23:40.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.837+0000 7f59e0e00640 1 -- start start 2024-08-17T02:23:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.838+0000 7f59e0e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59dc0cbd40 0x7f59dc0cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.838+0000 7f59e0e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc158c60 0x7f59dc0c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.838+0000 7f59e0e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59dc159030 0x7f59dc154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.838+0000 7f59e0e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0d0a60 con 0x7f59dc158c60 2024-08-17T02:23:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.838+0000 7f59e0e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc15a590 con 0x7f59dc159030 2024-08-17T02:23:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.838+0000 7f59e0e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc15a830 con 0x7f59dc0cbd40 2024-08-17T02:23:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.839+0000 7f59d9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc158c60 0x7f59dc0c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.839+0000 7f59d9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc158c60 0x7f59dc0c8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43758/0 (socket says 172.21.15.5:43758) 2024-08-17T02:23:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.839+0000 7f59d9400640 1 -- 172.21.15.5:0/4173766598 learned_addr learned my addr 172.21.15.5:0/4173766598 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.839+0000 7f59da800640 1 --2- 172.21.15.5:0/4173766598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59dc159030 0x7f59dc154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.839+0000 7f59d9e00640 1 --2- 172.21.15.5:0/4173766598 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59dc0cbd40 0x7f59dc0cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.839+0000 7f59d9400640 1 -- 172.21.15.5:0/4173766598 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59dc0cbd40 msgr2=0x7f59dc0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.839+0000 7f59d9400640 1 --2- 172.21.15.5:0/4173766598 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59dc0cbd40 0x7f59dc0cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.839+0000 7f59d9400640 1 -- 172.21.15.5:0/4173766598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59dc159030 msgr2=0x7f59dc154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:40.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.839+0000 7f59d9400640 1 --2- 172.21.15.5:0/4173766598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59dc159030 0x7f59dc154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:40.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.839+0000 7f59d9400640 1 -- 172.21.15.5:0/4173766598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c4009450 con 0x7f59dc158c60 2024-08-17T02:23:40.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.839+0000 7f59d9400640 1 --2- 172.21.15.5:0/4173766598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc158c60 0x7f59dc0c8670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009210 tx=0x7f59c4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.839+0000 7f59d1600640 1 -- 172.21.15.5:0/4173766598 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c40317b0 con 0x7f59dc158c60 2024-08-17T02:23:40.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.840+0000 7f59d1600640 1 -- 172.21.15.5:0/4173766598 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c4031930 con 0x7f59dc158c60 2024-08-17T02:23:40.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.840+0000 7f59d1600640 1 -- 172.21.15.5:0/4173766598 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4031cf0 con 0x7f59dc158c60 2024-08-17T02:23:40.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.840+0000 7f59e0e00640 1 -- 172.21.15.5:0/4173766598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59dc15ab10 con 0x7f59dc158c60 2024-08-17T02:23:40.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.840+0000 7f59e0e00640 1 -- 172.21.15.5:0/4173766598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc15b0d0 con 0x7f59dc158c60 2024-08-17T02:23:40.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.841+0000 7f59e0e00640 1 -- 172.21.15.5:0/4173766598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59dc15b2c0 con 0x7f59dc158c60 2024-08-17T02:23:40.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.841+0000 7f59d1600640 1 -- 172.21.15.5:0/4173766598 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f59c4039040 con 0x7f59dc158c60 2024-08-17T02:23:40.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.842+0000 7f59d1600640 1 --2- 172.21.15.5:0/4173766598 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f59b8065180 0x7f59b8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:40.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.842+0000 7f59d1600640 1 -- 172.21.15.5:0/4173766598 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59c40a1fe0 con 0x7f59dc158c60 2024-08-17T02:23:40.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.843+0000 7f59d9e00640 1 --2- 172.21.15.5:0/4173766598 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f59b8065180 0x7f59b8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:40.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.843+0000 7f59d9e00640 1 --2- 172.21.15.5:0/4173766598 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f59b8065180 0x7f59b8067630 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009c80 tx=0x7f59cc0090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:40.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:40.846+0000 7f59d1600640 1 -- 172.21.15.5:0/4173766598 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f59c40700b0 con 0x7f59dc158c60 2024-08-17T02:23:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.032+0000 7f59e0e00640 1 -- 172.21.15.5:0/4173766598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59dc063fb0 con 0x7f59dc158c60 2024-08-17T02:23:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.033+0000 7f59d1600640 1 -- 172.21.15.5:0/4173766598 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f59c40736d0 con 0x7f59dc158c60 2024-08-17T02:23:41.033 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:41.033 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:36.575545+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:32.642845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:33.982937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.035+0000 7f59e0e00640 1 -- 172.21.15.5:0/4173766598 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f59b8065180 msgr2=0x7f59b8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.035+0000 7f59e0e00640 1 --2- 172.21.15.5:0/4173766598 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f59b8065180 0x7f59b8067630 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009c80 tx=0x7f59cc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.035+0000 7f59e0e00640 1 -- 172.21.15.5:0/4173766598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc158c60 msgr2=0x7f59dc0c8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.035+0000 7f59e0e00640 1 --2- 172.21.15.5:0/4173766598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc158c60 0x7f59dc0c8670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009210 tx=0x7f59c4032000 comp rx=0 tx=0).stop 2024-08-17T02:23:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.035+0000 7f59e0e00640 1 -- 172.21.15.5:0/4173766598 shutdown_connections 2024-08-17T02:23:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.035+0000 7f59e0e00640 1 --2- 172.21.15.5:0/4173766598 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f59b8065180 0x7f59b8067630 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.035+0000 7f59e0e00640 1 --2- 172.21.15.5:0/4173766598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59dc159030 0x7f59dc154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.035+0000 7f59e0e00640 1 --2- 172.21.15.5:0/4173766598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc158c60 0x7f59dc0c8670 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.035+0000 7f59e0e00640 1 --2- 172.21.15.5:0/4173766598 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59dc0cbd40 0x7f59dc0cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.035+0000 7f59e0e00640 1 -- 172.21.15.5:0/4173766598 >> 172.21.15.5:0/4173766598 conn(0x7f59dc06e590 msgr2=0x7f59dc06e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.035+0000 7f59e0e00640 1 -- 172.21.15.5:0/4173766598 shutdown_connections 2024-08-17T02:23:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.035+0000 7f59e0e00640 1 -- 172.21.15.5:0/4173766598 wait complete. 2024-08-17T02:23:41.051 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:23:41.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:41.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.201+0000 7f71bda00640 1 Processor -- start 2024-08-17T02:23:41.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.201+0000 7f71bda00640 1 -- start start 2024-08-17T02:23:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.203+0000 7f71bda00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71b80ad790 0x7f71b80adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.203+0000 7f71bda00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71b80c9d20 0x7f71b80ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.203+0000 7f71bda00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b80ca6b0 con 0x7f71b81552d0 2024-08-17T02:23:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.203+0000 7f71bda00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b80cb180 con 0x7f71b80ad790 2024-08-17T02:23:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.203+0000 7f71bda00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b80af530 con 0x7f71b80c9d20 2024-08-17T02:23:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.203+0000 7f71b7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71b80ad790 0x7f71b80adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.203+0000 7f71b7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71b80ad790 0x7f71b80adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43768/0 (socket says 172.21.15.5:43768) 2024-08-17T02:23:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.203+0000 7f71b7e00640 1 -- 172.21.15.5:0/3681858154 learned_addr learned my addr 172.21.15.5:0/3681858154 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.203+0000 7f71afe00640 1 --2- 172.21.15.5:0/3681858154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71b80c9d20 0x7f71b80ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.203+0000 7f71b7e00640 1 -- 172.21.15.5:0/3681858154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71b80c9d20 msgr2=0x7f71b80ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.203+0000 7f71b7e00640 1 --2- 172.21.15.5:0/3681858154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71b80c9d20 0x7f71b80ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.203+0000 7f71b7e00640 1 -- 172.21.15.5:0/3681858154 >> v1:172.21.15.87:6789/0 conn(0x7f71b81552d0 legacy=0x7f71b8155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.203+0000 7f71b7e00640 1 -- 172.21.15.5:0/3681858154 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b80ca8e0 con 0x7f71b80ad790 2024-08-17T02:23:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.204+0000 7f71b7e00640 1 --2- 172.21.15.5:0/3681858154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b80ad790 0x7f71b80adb60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009910 tx=0x7f71a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41aa8589bda14033 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.205+0000 7f71b7400640 1 -- 172.21.15.5:0/3681858154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a802add0 con 0x7f71b80ad790 2024-08-17T02:23:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.205+0000 7f71b7400640 1 -- 172.21.15.5:0/3681858154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a8032440 con 0x7f71b80ad790 2024-08-17T02:23:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.205+0000 7f71b7400640 1 -- 172.21.15.5:0/3681858154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8032820 con 0x7f71b80ad790 2024-08-17T02:23:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.205+0000 7f71bda00640 1 -- 172.21.15.5:0/3681858154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b80ad790 msgr2=0x7f71b80adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.205+0000 7f71bda00640 1 --2- 172.21.15.5:0/3681858154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b80ad790 0x7f71b80adb60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009910 tx=0x7f71a80091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.205+0000 7f71bda00640 1 -- 172.21.15.5:0/3681858154 shutdown_connections 2024-08-17T02:23:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.205+0000 7f71bda00640 1 --2- 172.21.15.5:0/3681858154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71b80c9d20 0x7f71b80ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.205+0000 7f71bda00640 1 --2- 172.21.15.5:0/3681858154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b80ad790 0x7f71b80adb60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.205+0000 7f71bda00640 1 -- 172.21.15.5:0/3681858154 >> 172.21.15.5:0/3681858154 conn(0x7f71b8062af0 msgr2=0x7f71b8062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.205+0000 7f71bda00640 1 -- 172.21.15.5:0/3681858154 shutdown_connections 2024-08-17T02:23:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.205+0000 7f71bda00640 1 -- 172.21.15.5:0/3681858154 wait complete. 2024-08-17T02:23:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.207+0000 7f71bda00640 1 Processor -- start 2024-08-17T02:23:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.207+0000 7f71bda00640 1 -- start start 2024-08-17T02:23:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.208+0000 7f71bda00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71b80ad790 0x7f71b81512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.208+0000 7f71bda00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b80c9d20 0x7f71b813b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.208+0000 7f71bda00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71b81552d0 0x7f71b814ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.208+0000 7f71bda00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b813cb20 con 0x7f71b80c9d20 2024-08-17T02:23:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.208+0000 7f71bda00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b813bf10 con 0x7f71b81552d0 2024-08-17T02:23:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.208+0000 7f71bda00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b813c1f0 con 0x7f71b80ad790 2024-08-17T02:23:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.208+0000 7f71afe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b80c9d20 0x7f71b813b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.208+0000 7f71afe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b80c9d20 0x7f71b813b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43772/0 (socket says 172.21.15.5:43772) 2024-08-17T02:23:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.208+0000 7f71afe00640 1 -- 172.21.15.5:0/3093113076 learned_addr learned my addr 172.21.15.5:0/3093113076 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.208+0000 7f71bd000640 1 --2- 172.21.15.5:0/3093113076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71b81552d0 0x7f71b814ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.208+0000 7f71b7e00640 1 --2- 172.21.15.5:0/3093113076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71b80ad790 0x7f71b81512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.208+0000 7f71afe00640 1 -- 172.21.15.5:0/3093113076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71b80ad790 msgr2=0x7f71b81512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.208+0000 7f71afe00640 1 --2- 172.21.15.5:0/3093113076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71b80ad790 0x7f71b81512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.209+0000 7f71afe00640 1 -- 172.21.15.5:0/3093113076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71b81552d0 msgr2=0x7f71b814ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.209+0000 7f71afe00640 1 --2- 172.21.15.5:0/3093113076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71b81552d0 0x7f71b814ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.209+0000 7f71afe00640 1 -- 172.21.15.5:0/3093113076 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a8009450 con 0x7f71b80c9d20 2024-08-17T02:23:41.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.209+0000 7f71bd000640 1 --2- 172.21.15.5:0/3093113076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71b81552d0 0x7f71b814ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:41.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.209+0000 7f71afe00640 1 --2- 172.21.15.5:0/3093113076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b80c9d20 0x7f71b813b440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f71a000d890 tx=0x7f71a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.209+0000 7f71af400640 1 -- 172.21.15.5:0/3093113076 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a000de20 con 0x7f71b80c9d20 2024-08-17T02:23:41.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.209+0000 7f71af400640 1 -- 172.21.15.5:0/3093113076 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a000b8d0 con 0x7f71b80c9d20 2024-08-17T02:23:41.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.209+0000 7f71bda00640 1 -- 172.21.15.5:0/3093113076 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b813c4d0 con 0x7f71b80c9d20 2024-08-17T02:23:41.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.209+0000 7f71af400640 1 -- 172.21.15.5:0/3093113076 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a000bc70 con 0x7f71b80c9d20 2024-08-17T02:23:41.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.209+0000 7f71bda00640 1 -- 172.21.15.5:0/3093113076 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b815bff0 con 0x7f71b80c9d20 2024-08-17T02:23:41.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.210+0000 7f71bda00640 1 -- 172.21.15.5:0/3093113076 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b80b11a0 con 0x7f71b80c9d20 2024-08-17T02:23:41.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.211+0000 7f71af400640 1 -- 172.21.15.5:0/3093113076 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f71a0014640 con 0x7f71b80c9d20 2024-08-17T02:23:41.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.212+0000 7f71af400640 1 --2- 172.21.15.5:0/3093113076 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7194065150 0x7f7194067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.212+0000 7f71af400640 1 -- 172.21.15.5:0/3093113076 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f71a0082a00 con 0x7f71b80c9d20 2024-08-17T02:23:41.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.212+0000 7f71b7e00640 1 --2- 172.21.15.5:0/3093113076 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7194065150 0x7f7194067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.213+0000 7f71b7e00640 1 --2- 172.21.15.5:0/3093113076 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7194065150 0x7f7194067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f71a8034000 tx=0x7f71a8032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.216+0000 7f71af400640 1 -- 172.21.15.5:0/3093113076 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f71b80b11a0 con 0x7f71b80c9d20 2024-08-17T02:23:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.403+0000 7f71bda00640 1 -- 172.21.15.5:0/3093113076 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71b80b11a0 con 0x7f71b80c9d20 2024-08-17T02:23:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.403+0000 7f71af400640 1 -- 172.21.15.5:0/3093113076 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f71b80b11a0 con 0x7f71b80c9d20 2024-08-17T02:23:41.404 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:41.404 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:36.575545+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:32.642845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:33.982937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:41.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.406+0000 7f71bda00640 1 -- 172.21.15.5:0/3093113076 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7194065150 msgr2=0x7f7194067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.406+0000 7f71bda00640 1 --2- 172.21.15.5:0/3093113076 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7194065150 0x7f7194067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f71a8034000 tx=0x7f71a8032000 comp rx=0 tx=0).stop 2024-08-17T02:23:41.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.406+0000 7f71bda00640 1 -- 172.21.15.5:0/3093113076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b80c9d20 msgr2=0x7f71b813b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.406+0000 7f71bda00640 1 --2- 172.21.15.5:0/3093113076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b80c9d20 0x7f71b813b440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f71a000d890 tx=0x7f71a0008040 comp rx=0 tx=0).stop 2024-08-17T02:23:41.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.406+0000 7f71bda00640 1 -- 172.21.15.5:0/3093113076 shutdown_connections 2024-08-17T02:23:41.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.406+0000 7f71bda00640 1 --2- 172.21.15.5:0/3093113076 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7194065150 0x7f7194067600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.406+0000 7f71bda00640 1 --2- 172.21.15.5:0/3093113076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71b81552d0 0x7f71b814ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.406+0000 7f71bda00640 1 --2- 172.21.15.5:0/3093113076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b80c9d20 0x7f71b813b440 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.406+0000 7f71bda00640 1 --2- 172.21.15.5:0/3093113076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71b80ad790 0x7f71b81512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.406+0000 7f71bda00640 1 -- 172.21.15.5:0/3093113076 >> 172.21.15.5:0/3093113076 conn(0x7f71b8062af0 msgr2=0x7f71b80b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.406+0000 7f71bda00640 1 -- 172.21.15.5:0/3093113076 shutdown_connections 2024-08-17T02:23:41.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.406+0000 7f71bda00640 1 -- 172.21.15.5:0/3093113076 wait complete. 2024-08-17T02:23:41.422 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:23:41.422 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:23:41.422 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:23:41.423 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:23:41.423 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:23:41.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:23:41.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:23:41.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:23:41.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.692+0000 7f4c32200640 1 Processor -- start 2024-08-17T02:23:41.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.692+0000 7f4c32200640 1 -- start start 2024-08-17T02:23:41.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.694+0000 7f4c32200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c2c15cdc0 0x7f4c2c0ae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.694+0000 7f4c32200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4c2c0aeda0 0x7f4c2c0b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.694+0000 7f4c32200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4c2c0b0900 0x7f4c2c06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.694+0000 7f4c32200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2c0aff30 con 0x7f4c2c0b0900 2024-08-17T02:23:41.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.694+0000 7f4c32200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2c0af320 con 0x7f4c2c0aeda0 2024-08-17T02:23:41.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.694+0000 7f4c32200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c0af600 con 0x7f4c2c15cdc0 2024-08-17T02:23:41.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.696+0000 7f4c2b400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c2c15cdc0 0x7f4c2c0ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.696+0000 7f4c2aa00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4c2c0aeda0 0x7f4c2c0b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.696+0000 7f4c2aa00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4c2c0aeda0 0x7f4c2c0b03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:56418/0 (socket says 172.21.15.5:56418) 2024-08-17T02:23:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.696+0000 7f4c2aa00640 1 -- 172.21.15.5:0/2414291075 learned_addr learned my addr 172.21.15.5:0/2414291075 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.696+0000 7f4c2be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4c2c0b0900 0x7f4c2c06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.697+0000 7f4c2b400640 1 -- 172.21.15.5:0/2414291075 >> v2:172.21.15.87:3300/0 conn(0x7f4c2c0aeda0 msgr2=0x7f4c2c0b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.697+0000 7f4c2b400640 1 --2- 172.21.15.5:0/2414291075 >> v2:172.21.15.87:3300/0 conn(0x7f4c2c0aeda0 0x7f4c2c0b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.697+0000 7f4c2b400640 1 -- 172.21.15.5:0/2414291075 >> v2:172.21.15.5:3300/0 conn(0x7f4c2c0b0900 msgr2=0x7f4c2c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:41.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.697+0000 7f4c2b400640 1 --2- 172.21.15.5:0/2414291075 >> v2:172.21.15.5:3300/0 conn(0x7f4c2c0b0900 0x7f4c2c06d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.697+0000 7f4c2b400640 1 -- 172.21.15.5:0/2414291075 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c0af8e0 con 0x7f4c2c15cdc0 2024-08-17T02:23:41.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.698+0000 7f4c2be00640 1 --2- 172.21.15.5:0/2414291075 >> v2:172.21.15.5:3300/0 conn(0x7f4c2c0b0900 0x7f4c2c06d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:41.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.699+0000 7f4c2b400640 1 --2- 172.21.15.5:0/2414291075 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c2c15cdc0 0x7f4c2c0ae860 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0cc970 tx=0x7f4c1c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c5bdae0b390d3f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.699+0000 7f4c2a000640 1 -- 172.21.15.5:0/2414291075 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c02ac90 con 0x7f4c2c15cdc0 2024-08-17T02:23:41.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.699+0000 7f4c2a000640 1 -- 172.21.15.5:0/2414291075 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c02adf0 con 0x7f4c2c15cdc0 2024-08-17T02:23:41.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.699+0000 7f4c2a000640 1 -- 172.21.15.5:0/2414291075 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c032670 con 0x7f4c2c15cdc0 2024-08-17T02:23:41.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.700+0000 7f4c32200640 1 -- 172.21.15.5:0/2414291075 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c2c15cdc0 msgr2=0x7f4c2c0ae860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.700+0000 7f4c32200640 1 --2- 172.21.15.5:0/2414291075 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c2c15cdc0 0x7f4c2c0ae860 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0cc970 tx=0x7f4c1c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.701+0000 7fef27000640 1 Processor -- start 2024-08-17T02:23:41.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.701+0000 7fef27000640 1 -- start start 2024-08-17T02:23:41.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.701+0000 7f4c32200640 1 -- 172.21.15.5:0/2414291075 shutdown_connections 2024-08-17T02:23:41.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.701+0000 7f4c32200640 1 --2- 172.21.15.5:0/2414291075 >> v2:172.21.15.5:3300/0 conn(0x7f4c2c0b0900 0x7f4c2c06d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.701+0000 7f4c32200640 1 --2- 172.21.15.5:0/2414291075 >> v2:172.21.15.87:3300/0 conn(0x7f4c2c0aeda0 0x7f4c2c0b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.701+0000 7f4c32200640 1 --2- 172.21.15.5:0/2414291075 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c2c15cdc0 0x7f4c2c0ae860 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.701+0000 7f4c32200640 1 -- 172.21.15.5:0/2414291075 >> 172.21.15.5:0/2414291075 conn(0x7f4c2c066e60 msgr2=0x7f4c2c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.702+0000 7fa06ec00640 1 Processor -- start 2024-08-17T02:23:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.701+0000 7f1f69400640 1 Processor -- start 2024-08-17T02:23:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.702+0000 7f1f69400640 1 -- start start 2024-08-17T02:23:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.702+0000 7fef27000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef2015d460 0x7fef20068980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.702+0000 7fef27000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fef200aef40 0x7fef200b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.702+0000 7fef27000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef20069020 con 0x7fef2015d090 2024-08-17T02:23:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.702+0000 7f4c32200640 1 -- 172.21.15.5:0/2414291075 shutdown_connections 2024-08-17T02:23:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.702+0000 7f4c32200640 1 -- 172.21.15.5:0/2414291075 wait complete. 2024-08-17T02:23:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.702+0000 7fef27000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef20069300 con 0x7fef200aef40 2024-08-17T02:23:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.702+0000 7fef27000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef200695e0 con 0x7fef2015d460 2024-08-17T02:23:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.703+0000 7fef1fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fef2015d090 0x7fef200ae830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49222/0 (socket says 172.21.15.5:49222) 2024-08-17T02:23:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.703+0000 7fef1fe00640 1 -- 172.21.15.5:0/1144419816 learned_addr learned my addr 172.21.15.5:0/1144419816 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.704+0000 7fef1ea00640 1 -- 172.21.15.5:0/1144419816 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080352191 0 0) 0x7fef20069020 con 0x7fef2015d090 2024-08-17T02:23:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.704+0000 7fef1ea00640 1 -- 172.21.15.5:0/1144419816 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef040034e0 con 0x7fef2015d090 2024-08-17T02:23:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.702+0000 7fa06ec00640 1 -- start start 2024-08-17T02:23:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.704+0000 7fa06ec00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa068154a60 0x7fa06806d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.704+0000 7fa06ec00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa068154e30 0x7fa06806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.704+0000 7fa06ec00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa068069580 con 0x7fa0680abe60 2024-08-17T02:23:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.704+0000 7fa06ec00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa068069860 con 0x7fa068154a60 2024-08-17T02:23:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.704+0000 7fa06ec00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa068069b40 con 0x7fa068154e30 2024-08-17T02:23:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.704+0000 7f4c32200640 1 Processor -- start 2024-08-17T02:23:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.705+0000 7fa067400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa068154e30 0x7fa06806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.704+0000 7fef25000640 1 --2- 172.21.15.5:0/1144419816 >> v2:172.21.15.5:3300/0 conn(0x7fef200aef40 0x7fef200b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.705+0000 7fef1ea00640 1 -- 172.21.15.5:0/1144419816 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1261631446 0 0) 0x7fef040034e0 con 0x7fef2015d090 2024-08-17T02:23:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.705+0000 7fef1ea00640 1 -- 172.21.15.5:0/1144419816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef2015d460 msgr2=0x7fef20068980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.705+0000 7fef1f400640 1 --2- 172.21.15.5:0/1144419816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef2015d460 0x7fef20068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.705+0000 7fef1ea00640 1 --2- 172.21.15.5:0/1144419816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef2015d460 0x7fef20068980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.705+0000 7fef1ea00640 1 -- 172.21.15.5:0/1144419816 >> v2:172.21.15.5:3300/0 conn(0x7fef200aef40 msgr2=0x7fef200b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.705+0000 7fef1ea00640 1 --2- 172.21.15.5:0/1144419816 >> v2:172.21.15.5:3300/0 conn(0x7fef200aef40 0x7fef200b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.705+0000 7fef1ea00640 1 -- 172.21.15.5:0/1144419816 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef200698c0 con 0x7fef2015d090 2024-08-17T02:23:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.705+0000 7fef25000640 1 --2- 172.21.15.5:0/1144419816 >> v2:172.21.15.5:3300/0 conn(0x7fef200aef40 0x7fef200b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.705+0000 7fa067400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa068154e30 0x7fa06806db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:33754/0 (socket says 172.21.15.5:33754) 2024-08-17T02:23:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.705+0000 7fa067400640 1 -- 172.21.15.5:0/993927380 learned_addr learned my addr 172.21.15.5:0/993927380 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.705+0000 7fa067e00640 1 --2- 172.21.15.5:0/993927380 >> v2:172.21.15.5:3300/0 conn(0x7fa068154a60 0x7fa06806d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.705+0000 7fef1f400640 1 --2- 172.21.15.5:0/1144419816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef2015d460 0x7fef20068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.706+0000 7f1f69400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f64146890 0x7f1f640cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.706+0000 7f1f69400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1f640ce3c0 0x7f1f640b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.706+0000 7f1f69400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f640b2ad0 con 0x7f1f640d0150 2024-08-17T02:23:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.706+0000 7f1f69400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f640ce800 con 0x7f1f640ce3c0 2024-08-17T02:23:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.706+0000 7f1f69400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f640d0580 con 0x7f1f64146890 2024-08-17T02:23:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.705+0000 7f4c32200640 1 -- start start 2024-08-17T02:23:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.706+0000 7fa067400640 1 -- 172.21.15.5:0/993927380 >> v2:172.21.15.5:3300/0 conn(0x7fa068154a60 msgr2=0x7fa06806d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.706+0000 7fa067400640 1 --2- 172.21.15.5:0/993927380 >> v2:172.21.15.5:3300/0 conn(0x7fa068154a60 0x7fa06806d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.706+0000 7f8159400640 1 Processor -- start 2024-08-17T02:23:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.706+0000 7f1f62800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f64146890 0x7f1f640cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.706+0000 7f1f63200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1f640ce3c0 0x7f1f640b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.706+0000 7f1f63200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1f640ce3c0 0x7f1f640b2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:56424/0 (socket says 172.21.15.5:56424) 2024-08-17T02:23:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.706+0000 7f1f63200640 1 -- 172.21.15.5:0/4279450461 learned_addr learned my addr 172.21.15.5:0/4279450461 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.706+0000 7fa067400640 1 -- 172.21.15.5:0/993927380 >> v1:172.21.15.5:6789/0 conn(0x7fa0680abe60 legacy=0x7fa0680ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.706+0000 7f8159400640 1 -- start start 2024-08-17T02:23:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7f4c32200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c2c0aeda0 0x7f4c2c144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7f4c32200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c2c0b0900 0x7f4c2c156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7f4c32200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c2c15cdc0 0x7f4c2c1475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7f4c32200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c1579e0 con 0x7f4c2c15cdc0 2024-08-17T02:23:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7f4c32200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c157fa0 con 0x7f4c2c0b0900 2024-08-17T02:23:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7f4c32200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c156ae0 con 0x7f4c2c0aeda0 2024-08-17T02:23:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7fef1ea00640 1 -- 172.21.15.5:0/1144419816 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2658686246 0 0) 0x7fef180017f0 con 0x7fef2015d090 2024-08-17T02:23:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7f1f62800640 1 -- 172.21.15.5:0/4279450461 >> v2:172.21.15.87:3300/0 conn(0x7f1f640ce3c0 msgr2=0x7f1f640b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7f1f62800640 1 --2- 172.21.15.5:0/4279450461 >> v2:172.21.15.87:3300/0 conn(0x7f1f640ce3c0 0x7f1f640b2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7fa067400640 1 -- 172.21.15.5:0/993927380 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa068069e20 con 0x7fa068154e30 2024-08-17T02:23:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.708+0000 7f4c2aa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c2c0b0900 0x7f4c2c156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.708+0000 7f4c2b400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c2c0aeda0 0x7f4c2c144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.708+0000 7f4c2aa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c2c0b0900 0x7f4c2c156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:56428/0 (socket says 172.21.15.5:56428) 2024-08-17T02:23:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.708+0000 7f4c2aa00640 1 -- 172.21.15.5:0/2810478161 learned_addr learned my addr 172.21.15.5:0/2810478161 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7fef1ea00640 1 -- 172.21.15.5:0/1144419816 >> v1:172.21.15.5:6789/0 conn(0x7fef2015d090 legacy=0x7fef200ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7fef1ea00640 1 --2- 172.21.15.5:0/1144419816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef040039d0 0x7fef04003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7fef1ea00640 1 --2- 172.21.15.5:0/1144419816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef04004780 0x7fef04004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7fef1ea00640 1 --2- 172.21.15.5:0/1144419816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef2015d460 0x7fef04005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7fef1ea00640 1 -- 172.21.15.5:0/1144419816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef20069300 con 0x7fef04004780 2024-08-17T02:23:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7fef1ea00640 1 -- 172.21.15.5:0/1144419816 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef200695e0 con 0x7fef040039d0 2024-08-17T02:23:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7fef1ea00640 1 -- 172.21.15.5:0/1144419816 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0400bb30 con 0x7fef2015d460 2024-08-17T02:23:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7f1f62800640 1 -- 172.21.15.5:0/4279450461 >> v1:172.21.15.5:6789/0 conn(0x7f1f640d0150 legacy=0x7f1f640cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.707+0000 7f1f62800640 1 -- 172.21.15.5:0/4279450461 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f640cea00 con 0x7f1f64146890 2024-08-17T02:23:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.708+0000 7f4c2be00640 1 --2- 172.21.15.5:0/2810478161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c2c15cdc0 0x7f4c2c1475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.708+0000 7f4c2aa00640 1 -- 172.21.15.5:0/2810478161 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c2c0aeda0 msgr2=0x7f4c2c144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.708+0000 7f4c2aa00640 1 --2- 172.21.15.5:0/2810478161 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c2c0aeda0 0x7f4c2c144aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.708+0000 7f4c2aa00640 1 -- 172.21.15.5:0/2810478161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c2c15cdc0 msgr2=0x7f4c2c1475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.708+0000 7f4c2aa00640 1 --2- 172.21.15.5:0/2810478161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c2c15cdc0 0x7f4c2c1475d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.709+0000 7f4c2aa00640 1 -- 172.21.15.5:0/2810478161 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c24009a20 con 0x7f4c2c0b0900 2024-08-17T02:23:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.709+0000 7f4c2be00640 1 --2- 172.21.15.5:0/2810478161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c2c15cdc0 0x7f4c2c1475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.709+0000 7fef25000640 1 --2- 172.21.15.5:0/1144419816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef2015d460 0x7fef04005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.709+0000 7fef1fe00640 1 --2- 172.21.15.5:0/1144419816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef040039d0 0x7fef04003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.709+0000 7fa067400640 1 --2- 172.21.15.5:0/993927380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa068154e30 0x7fa06806db20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa054008920 tx=0x7fa054008240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dae4419c13913c1c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.709+0000 7f8159400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f814c0ea1f0 0x7f814c0ea5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.709+0000 7f8159400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f814c054440 0x7f814c0e93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.709+0000 7f8159400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814c007ad0 con 0x7f814c053ff0 2024-08-17T02:23:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.709+0000 7f8159400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f814c055120 con 0x7f814c054440 2024-08-17T02:23:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.709+0000 7f8159400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814c006320 con 0x7f814c0ea1f0 2024-08-17T02:23:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.709+0000 7fef1f400640 1 --2- 172.21.15.5:0/1144419816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef04004780 0x7fef04004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.709+0000 7f8158a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f814c054440 0x7f814c0e93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.710+0000 7f8158a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f814c054440 0x7f814c0e93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:56444/0 (socket says 172.21.15.5:56444) 2024-08-17T02:23:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.710+0000 7f8158a00640 1 -- 172.21.15.5:0/419165659 learned_addr learned my addr 172.21.15.5:0/419165659 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.710+0000 7fa066a00640 1 -- 172.21.15.5:0/993927380 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054032480 con 0x7fa068154e30 2024-08-17T02:23:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.710+0000 7fa066a00640 1 -- 172.21.15.5:0/993927380 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05402f030 con 0x7fa068154e30 2024-08-17T02:23:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.710+0000 7f4c2aa00640 1 --2- 172.21.15.5:0/2810478161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c2c0b0900 0x7f4c2c156020 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800d890 tx=0x7f4c18008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.710+0000 7f1f62800640 1 --2- 172.21.15.5:0/4279450461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f64146890 0x7f1f640cfc10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009850 tx=0x7f1f5c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9c7a04f5abfd13c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.710+0000 7f8153e00640 1 --2- 172.21.15.5:0/419165659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f814c0ea1f0 0x7f814c0ea5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.710+0000 7fa066a00640 1 -- 172.21.15.5:0/993927380 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054032850 con 0x7fa068154e30 2024-08-17T02:23:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.710+0000 7fef1f400640 1 -- 172.21.15.5:0/1144419816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef2015d460 msgr2=0x7fef04005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.710+0000 7fef1f400640 1 --2- 172.21.15.5:0/1144419816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef2015d460 0x7fef04005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.710+0000 7fef1f400640 1 -- 172.21.15.5:0/1144419816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef040039d0 msgr2=0x7fef04003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.710+0000 7fef1f400640 1 --2- 172.21.15.5:0/1144419816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef040039d0 0x7fef04003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.710+0000 7fef1f400640 1 -- 172.21.15.5:0/1144419816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef040034e0 con 0x7fef04004780 2024-08-17T02:23:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.710+0000 7fef1fe00640 1 --2- 172.21.15.5:0/1144419816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef040039d0 0x7fef04003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.711+0000 7f1f61400640 1 -- 172.21.15.5:0/4279450461 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c02ad00 con 0x7f1f64146890 2024-08-17T02:23:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.711+0000 7f1f61400640 1 -- 172.21.15.5:0/4279450461 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c02ae60 con 0x7f1f64146890 2024-08-17T02:23:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.711+0000 7f1f61400640 1 -- 172.21.15.5:0/4279450461 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c032670 con 0x7f1f64146890 2024-08-17T02:23:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.711+0000 7f8153e00640 1 -- 172.21.15.5:0/419165659 >> v2:172.21.15.87:3300/0 conn(0x7f814c054440 msgr2=0x7f814c0e93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.711+0000 7f8153e00640 1 --2- 172.21.15.5:0/419165659 >> v2:172.21.15.87:3300/0 conn(0x7f814c054440 0x7f814c0e93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.711+0000 7f8153e00640 1 -- 172.21.15.5:0/419165659 >> v1:172.21.15.5:6789/0 conn(0x7f814c053ff0 legacy=0x7f814c0073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.711+0000 7f8153e00640 1 -- 172.21.15.5:0/419165659 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c006600 con 0x7f814c0ea1f0 2024-08-17T02:23:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.710+0000 7f4c22a00640 1 -- 172.21.15.5:0/2810478161 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1800de20 con 0x7f4c2c0b0900 2024-08-17T02:23:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.711+0000 7f4c22a00640 1 -- 172.21.15.5:0/2810478161 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c180098b0 con 0x7f4c2c0b0900 2024-08-17T02:23:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.711+0000 7f4c22a00640 1 -- 172.21.15.5:0/2810478161 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18009c70 con 0x7f4c2c0b0900 2024-08-17T02:23:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.712+0000 7f1f69400640 1 -- 172.21.15.5:0/4279450461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f64146890 msgr2=0x7f1f640cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.712+0000 7f1f69400640 1 --2- 172.21.15.5:0/4279450461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f64146890 0x7f1f640cfc10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009850 tx=0x7f1f5c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.712+0000 7f8153e00640 1 --2- 172.21.15.5:0/419165659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f814c0ea1f0 0x7f814c0ea5c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f815404c0c0 tx=0x7f8154064990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f7358a97dba462 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.712+0000 7fa06ec00640 1 -- 172.21.15.5:0/993927380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa068154e30 msgr2=0x7fa06806db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.712+0000 7fef1f400640 1 --2- 172.21.15.5:0/1144419816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef04004780 0x7fef04004bf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fef1000ab20 tx=0x7fef10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc06c9731346ea8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.712+0000 7fa06ec00640 1 --2- 172.21.15.5:0/993927380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa068154e30 0x7fa06806db20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa054008920 tx=0x7fa054008240 comp rx=0 tx=0).stop 2024-08-17T02:23:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.712+0000 7f1f69400640 1 -- 172.21.15.5:0/4279450461 shutdown_connections 2024-08-17T02:23:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.712+0000 7f1f69400640 1 --2- 172.21.15.5:0/4279450461 >> v2:172.21.15.87:3300/0 conn(0x7f1f640ce3c0 0x7f1f640b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.712+0000 7f1f69400640 1 --2- 172.21.15.5:0/4279450461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f64146890 0x7f1f640cfc10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.712+0000 7f1f69400640 1 -- 172.21.15.5:0/4279450461 >> 172.21.15.5:0/4279450461 conn(0x7f1f6406e590 msgr2=0x7f1f6406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.711+0000 7f4c32200640 1 -- 172.21.15.5:0/2810478161 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1c009390 con 0x7f4c2c0b0900 2024-08-17T02:23:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.711+0000 7f4c32200640 1 -- 172.21.15.5:0/2810478161 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2c157c30 con 0x7f4c2c0b0900 2024-08-17T02:23:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.712+0000 7fef1ea00640 1 -- 172.21.15.5:0/1144419816 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1002a9e0 con 0x7fef04004780 2024-08-17T02:23:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.713+0000 7f4c32200640 1 -- 172.21.15.5:0/2810478161 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4c2c063fb0 con 0x7f4c2c0b0900 2024-08-17T02:23:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.713+0000 7fef1ea00640 1 -- 172.21.15.5:0/1144419816 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1002ab40 con 0x7fef04004780 2024-08-17T02:23:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.713+0000 7fef1ea00640 1 -- 172.21.15.5:0/1144419816 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef10032440 con 0x7fef04004780 2024-08-17T02:23:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.713+0000 7fef27000640 1 -- 172.21.15.5:0/1144419816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef04004780 msgr2=0x7fef04004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.713+0000 7fef27000640 1 --2- 172.21.15.5:0/1144419816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef04004780 0x7fef04004bf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fef1000ab20 tx=0x7fef10008040 comp rx=0 tx=0).stop 2024-08-17T02:23:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.713+0000 7f1f69400640 1 -- 172.21.15.5:0/4279450461 shutdown_connections 2024-08-17T02:23:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.713+0000 7f1f69400640 1 -- 172.21.15.5:0/4279450461 wait complete. 2024-08-17T02:23:41.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.713+0000 7fa06ec00640 1 -- 172.21.15.5:0/993927380 shutdown_connections 2024-08-17T02:23:41.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.713+0000 7fa06ec00640 1 --2- 172.21.15.5:0/993927380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa068154e30 0x7fa06806db20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.713+0000 7fa06ec00640 1 --2- 172.21.15.5:0/993927380 >> v2:172.21.15.5:3300/0 conn(0x7fa068154a60 0x7fa06806d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.713+0000 7fa06ec00640 1 -- 172.21.15.5:0/993927380 >> 172.21.15.5:0/993927380 conn(0x7fa0680c8260 msgr2=0x7fa0680c8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.712+0000 7f8152a00640 1 -- 172.21.15.5:0/419165659 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81540a1d90 con 0x7f814c0ea1f0 2024-08-17T02:23:41.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.713+0000 7f8152a00640 1 -- 172.21.15.5:0/419165659 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81540a93f0 con 0x7f814c0ea1f0 2024-08-17T02:23:41.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.713+0000 7f8152a00640 1 -- 172.21.15.5:0/419165659 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81540a97f0 con 0x7f814c0ea1f0 2024-08-17T02:23:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.714+0000 7fef25000640 1 -- 172.21.15.5:0/1144419816 reap_dead start 2024-08-17T02:23:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.714+0000 7fef27000640 1 -- 172.21.15.5:0/1144419816 shutdown_connections 2024-08-17T02:23:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.714+0000 7fef27000640 1 -- 172.21.15.5:0/1144419816 >> 172.21.15.5:0/1144419816 conn(0x7fef200ce5a0 msgr2=0x7fef20095cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.714+0000 7f8159400640 1 -- 172.21.15.5:0/419165659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f814c0ea1f0 msgr2=0x7f814c0ea5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.714+0000 7f8159400640 1 --2- 172.21.15.5:0/419165659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f814c0ea1f0 0x7f814c0ea5c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f815404c0c0 tx=0x7f8154064990 comp rx=0 tx=0).stop 2024-08-17T02:23:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.714+0000 7fef27000640 1 -- 172.21.15.5:0/1144419816 shutdown_connections 2024-08-17T02:23:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.714+0000 7fef27000640 1 -- 172.21.15.5:0/1144419816 wait complete. 2024-08-17T02:23:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.714+0000 7f8159400640 1 -- 172.21.15.5:0/419165659 shutdown_connections 2024-08-17T02:23:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.714+0000 7f8159400640 1 --2- 172.21.15.5:0/419165659 >> v2:172.21.15.87:3300/0 conn(0x7f814c054440 0x7f814c0e93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.714+0000 7f8159400640 1 --2- 172.21.15.5:0/419165659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f814c0ea1f0 0x7f814c0ea5c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.714+0000 7f8159400640 1 -- 172.21.15.5:0/419165659 >> 172.21.15.5:0/419165659 conn(0x7f814c055a10 msgr2=0x7f814c055e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.715+0000 7faff1400640 1 Processor -- start 2024-08-17T02:23:41.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.715+0000 7f1f69400640 1 Processor -- start 2024-08-17T02:23:41.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.715+0000 7f8159400640 1 -- 172.21.15.5:0/419165659 shutdown_connections 2024-08-17T02:23:41.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.715+0000 7fa06ec00640 1 -- 172.21.15.5:0/993927380 shutdown_connections 2024-08-17T02:23:41.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.715+0000 7faff1400640 1 -- start start 2024-08-17T02:23:41.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.715+0000 7f1f69400640 1 -- start start 2024-08-17T02:23:41.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.715+0000 7fa06ec00640 1 -- 172.21.15.5:0/993927380 wait complete. 2024-08-17T02:23:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.715+0000 7f8159400640 1 -- 172.21.15.5:0/419165659 wait complete. 2024-08-17T02:23:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.715+0000 7f4c22a00640 1 -- 172.21.15.5:0/2810478161 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4c18014620 con 0x7f4c2c0b0900 2024-08-17T02:23:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.716+0000 7f1f69400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f640ce3c0 0x7f1f640c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.716+0000 7f1f69400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f640d0150 0x7f1f64170680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.717+0000 7f1f69400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f64146890 0x7f1f640cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.717+0000 7f1f69400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f640aff40 con 0x7f1f640d0150 2024-08-17T02:23:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.717+0000 7f1f69400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f64170f80 con 0x7f1f640ce3c0 2024-08-17T02:23:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.717+0000 7f1f69400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f64171260 con 0x7f1f64146890 2024-08-17T02:23:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.717+0000 7f8159400640 1 Processor -- start 2024-08-17T02:23:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.717+0000 7faff1400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec1589e0 0x7fafec158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.717+0000 7faff1400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fafec0cda30 0x7fafec0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.717+0000 7faff1400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafec0af9a0 con 0x7fafec0ca9c0 2024-08-17T02:23:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.717+0000 7faff1400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafec0af810 con 0x7fafec0cda30 2024-08-17T02:23:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.717+0000 7fef27000640 1 Processor -- start 2024-08-17T02:23:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.717+0000 7faff1400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafec0ce740 con 0x7fafec1589e0 2024-08-17T02:23:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.718+0000 7fa06ec00640 1 Processor -- start 2024-08-17T02:23:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.717+0000 7f4c22a00640 1 --2- 172.21.15.5:0/2810478161 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4c0c065150 0x7f4c0c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.718+0000 7f4c22a00640 1 -- 172.21.15.5:0/2810478161 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c18082750 con 0x7f4c2c0b0900 2024-08-17T02:23:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.718+0000 7f4c22a00640 1 --2- 172.21.15.5:0/2810478161 >> [v2:172.21.15.5:6817/37117,v1:172.21.15.5:6819/37117] conn(0x7f4c0c06d360 0x7f4c0c06f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.718+0000 7f4c22a00640 1 -- 172.21.15.5:0/2810478161 --> [v2:172.21.15.5:6817/37117,v1:172.21.15.5:6819/37117] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4c0c06fe20 con 0x7f4c0c06d360 2024-08-17T02:23:41.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.718+0000 7f4c22a00640 1 -- 172.21.15.5:0/2810478161 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c18084d30 con 0x7f4c2c0b0900 2024-08-17T02:23:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.718+0000 7fef27000640 1 -- start start 2024-08-17T02:23:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.717+0000 7f1f61e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f640d0150 0x7f1f64170680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.717+0000 7f1f63200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f64146890 0x7f1f640cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.717+0000 7f1f63200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f64146890 0x7f1f640cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:33808/0 (socket says 172.21.15.5:33808) 2024-08-17T02:23:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.717+0000 7f1f63200640 1 -- 172.21.15.5:0/193123060 learned_addr learned my addr 172.21.15.5:0/193123060 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.718+0000 7f1f62800640 1 --2- 172.21.15.5:0/193123060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f640ce3c0 0x7f1f640c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.718+0000 7f8159400640 1 -- start start 2024-08-17T02:23:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.718+0000 7fafea800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec1589e0 0x7fafec158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.718+0000 7fafea800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec1589e0 0x7fafec158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:33818/0 (socket says 172.21.15.5:33818) 2024-08-17T02:23:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.718+0000 7fafea800640 1 -- 172.21.15.5:0/3898145004 learned_addr learned my addr 172.21.15.5:0/3898145004 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.718+0000 7fafeb200640 1 --2- 172.21.15.5:0/3898145004 >> v2:172.21.15.5:3300/0 conn(0x7fafec0cda30 0x7fafec0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.718+0000 7f1f63200640 1 -- 172.21.15.5:0/193123060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f640ce3c0 msgr2=0x7f1f640c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.718+0000 7f1f63200640 1 --2- 172.21.15.5:0/193123060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f640ce3c0 0x7f1f640c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.718+0000 7f1f63200640 1 -- 172.21.15.5:0/193123060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f640d0150 msgr2=0x7f1f64170680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.718+0000 7f1f63200640 1 --2- 172.21.15.5:0/193123060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f640d0150 0x7f1f64170680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.719+0000 7f1f63200640 1 -- 172.21.15.5:0/193123060 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c009390 con 0x7f1f64146890 2024-08-17T02:23:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.719+0000 7fa06ec00640 1 -- start start 2024-08-17T02:23:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.719+0000 7fafea800640 1 -- 172.21.15.5:0/3898145004 >> v2:172.21.15.5:3300/0 conn(0x7fafec0cda30 msgr2=0x7fafec0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.719+0000 7fafea800640 1 --2- 172.21.15.5:0/3898145004 >> v2:172.21.15.5:3300/0 conn(0x7fafec0cda30 0x7fafec0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.719+0000 7fafea800640 1 -- 172.21.15.5:0/3898145004 >> v1:172.21.15.87:6789/0 conn(0x7fafec0ca9c0 legacy=0x7fafec0cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.719+0000 7fafea800640 1 -- 172.21.15.5:0/3898145004 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec0cea00 con 0x7fafec1589e0 2024-08-17T02:23:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.719+0000 7f1f63200640 1 --2- 172.21.15.5:0/193123060 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f64146890 0x7f1f640cc6e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009e50 tx=0x7f1f5400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.719+0000 7f4856000640 1 Processor -- start 2024-08-17T02:23:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7f8159400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f814c053ff0 0x7f814c0f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7f8159400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f814c054440 0x7f814c050a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7f8159400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f814c0ea1f0 0x7f814c0f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.719+0000 7f4c2b400640 1 --2- 172.21.15.5:0/2810478161 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4c0c065150 0x7f4c0c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.719+0000 7f4c2be00640 1 --2- 172.21.15.5:0/2810478161 >> [v2:172.21.15.5:6817/37117,v1:172.21.15.5:6819/37117] conn(0x7f4c0c06d360 0x7f4c0c06f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7f4c2be00640 1 --2- 172.21.15.5:0/2810478161 >> [v2:172.21.15.5:6817/37117,v1:172.21.15.5:6819/37117] conn(0x7f4c0c06d360 0x7f4c0c06f770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7f8159400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c052320 con 0x7f814c054440 2024-08-17T02:23:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7f8159400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c03d090 con 0x7f814c0ea1f0 2024-08-17T02:23:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7fabcf400640 1 Processor -- start 2024-08-17T02:23:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7f4856000640 1 -- start start 2024-08-17T02:23:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7f8159400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814c0f70d0 con 0x7f814c053ff0 2024-08-17T02:23:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.721+0000 7f1f5a000640 1 -- 172.21.15.5:0/193123060 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5400cb30 con 0x7f1f64146890 2024-08-17T02:23:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7fef27000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef04004780 0x7fef2016dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7f8158a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f814c0ea1f0 0x7f814c0f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7f8158a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f814c0ea1f0 0x7f814c0f7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:56464/0 (socket says 172.21.15.5:56464) 2024-08-17T02:23:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7f8158a00640 1 -- 172.21.15.5:0/618811373 learned_addr learned my addr 172.21.15.5:0/618811373 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7fef27000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef200ac420 0x7fef20158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7fef27000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef20099a00 0x7fef20099e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7fef27000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2009a3b0 con 0x7fef200ac420 2024-08-17T02:23:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7fef27000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2016e400 con 0x7fef20099a00 2024-08-17T02:23:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7fef27000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef20098570 con 0x7fef04004780 2024-08-17T02:23:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.720+0000 7f8153e00640 1 --2- 172.21.15.5:0/618811373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f814c053ff0 0x7f814c0f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.721+0000 7f8158a00640 1 -- 172.21.15.5:0/618811373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f814c053ff0 msgr2=0x7f814c0f6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.721+0000 7f8158a00640 1 --2- 172.21.15.5:0/618811373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f814c053ff0 0x7f814c0f6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.721+0000 7f8158a00640 1 -- 172.21.15.5:0/618811373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f814c054440 msgr2=0x7f814c050a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.721+0000 7f8158a00640 1 --2- 172.21.15.5:0/618811373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f814c054440 0x7f814c050a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.721+0000 7f8158a00640 1 -- 172.21.15.5:0/618811373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815404c200 con 0x7f814c0ea1f0 2024-08-17T02:23:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.721+0000 7f8153e00640 1 --2- 172.21.15.5:0/618811373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f814c053ff0 0x7f814c0f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:41.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.721+0000 7fef1fe00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef04004780 0x7fef2016dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.721+0000 7fef1fe00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef04004780 0x7fef2016dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:33830/0 (socket says 172.21.15.5:33830) 2024-08-17T02:23:41.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.721+0000 7fef1fe00640 1 -- 172.21.15.5:0/3137432404 learned_addr learned my addr 172.21.15.5:0/3137432404 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.721+0000 7f1f5a000640 1 -- 172.21.15.5:0/193123060 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5400f040 con 0x7f1f64146890 2024-08-17T02:23:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.721+0000 7f1f5a000640 1 -- 172.21.15.5:0/193123060 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54014440 con 0x7f1f64146890 2024-08-17T02:23:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.721+0000 7f1f69400640 1 -- 172.21.15.5:0/193123060 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f640afbd0 con 0x7f1f64146890 2024-08-17T02:23:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.721+0000 7f1f69400640 1 -- 172.21.15.5:0/193123060 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f64170bc0 con 0x7f1f64146890 2024-08-17T02:23:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7f4c22a00640 1 -- 172.21.15.5:0/2810478161 <== osd.0 v2:172.21.15.5:6817/37117 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f4c0c06fe20 con 0x7f4c0c06d360 2024-08-17T02:23:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7f8158a00640 1 --2- 172.21.15.5:0/618811373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f814c0ea1f0 0x7f814c0f7c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f814800d860 tx=0x7f8148008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7f4856000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48500b03c0 0x7f48500b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7f4c2b400640 1 --2- 172.21.15.5:0/2810478161 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4c0c065150 0x7f4c0c067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c034000 tx=0x7f4c1c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7fef1fe00640 1 -- 172.21.15.5:0/3137432404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef20099a00 msgr2=0x7fef20099e70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:23:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7fef1fe00640 1 --2- 172.21.15.5:0/3137432404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef20099a00 0x7fef20099e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7fef1fe00640 1 -- 172.21.15.5:0/3137432404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef200ac420 msgr2=0x7fef20158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7fef1fe00640 1 --2- 172.21.15.5:0/3137432404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef200ac420 0x7fef20158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7fef1fe00640 1 -- 172.21.15.5:0/3137432404 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef20158cd0 con 0x7fef04004780 2024-08-17T02:23:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7f8147400640 1 -- 172.21.15.5:0/618811373 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81480096a0 con 0x7f814c0ea1f0 2024-08-17T02:23:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7f8147400640 1 -- 172.21.15.5:0/618811373 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8148009820 con 0x7f814c0ea1f0 2024-08-17T02:23:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7f8147400640 1 -- 172.21.15.5:0/618811373 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8148009be0 con 0x7f814c0ea1f0 2024-08-17T02:23:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7f4856000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48500aff30 con 0x7f485015cdc0 2024-08-17T02:23:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7f4856000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48500af320 con 0x7f485006d7d0 2024-08-17T02:23:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7f4856000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48500af600 con 0x7f48500b03c0 2024-08-17T02:23:41.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7f4846a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48500b03c0 0x7f48500b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7f4846a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48500b03c0 0x7f48500b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43874/0 (socket says 172.21.15.5:43874) 2024-08-17T02:23:41.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7f8159400640 1 -- 172.21.15.5:0/618811373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814c0f73b0 con 0x7f814c0ea1f0 2024-08-17T02:23:41.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7f4846a00640 1 -- 172.21.15.5:0/3624838534 learned_addr learned my addr 172.21.15.5:0/3624838534 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:41.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.722+0000 7f484f400640 1 --1- 172.21.15.5:0/3624838534 >> v1:172.21.15.5:6789/0 conn(0x7f485015cdc0 0x7f48500ae860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49266/0 (socket says 172.21.15.5:49266) 2024-08-17T02:23:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.723+0000 7f8159400640 1 -- 172.21.15.5:0/618811373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814c0f7970 con 0x7f814c0ea1f0 2024-08-17T02:23:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.721+0000 7fabcf400640 1 -- start start 2024-08-17T02:23:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.723+0000 7fabcf400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabc81589e0 0x7fabc8158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.723+0000 7fabcf400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc80af9a0 con 0x7fabc80ca9c0 2024-08-17T02:23:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.723+0000 7fabcf400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc80ce740 con 0x7fabc80ce140 2024-08-17T02:23:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.723+0000 7fabcf400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc80af810 con 0x7fabc81589e0 2024-08-17T02:23:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.723+0000 7f484ea00640 1 -- 172.21.15.5:0/3624838534 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392297786 0 0) 0x7f48500aff30 con 0x7f485015cdc0 2024-08-17T02:23:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.723+0000 7f484ea00640 1 -- 172.21.15.5:0/3624838534 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48340034e0 con 0x7f485015cdc0 2024-08-17T02:23:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.723+0000 7fabcca00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabc81589e0 0x7fabc8158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.723+0000 7fabcca00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabc81589e0 0x7fabc8158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43890/0 (socket says 172.21.15.5:43890) 2024-08-17T02:23:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.723+0000 7fabcca00640 1 -- 172.21.15.5:0/2862846531 learned_addr learned my addr 172.21.15.5:0/2862846531 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.724+0000 7fabcca00640 1 -- 172.21.15.5:0/2862846531 >> v1:172.21.15.87:6789/0 conn(0x7fabc80ce140 legacy=0x7fabc80afe30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:23:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.724+0000 7f484ea00640 1 -- 172.21.15.5:0/3624838534 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4053708434 0 0) 0x7f48340034e0 con 0x7f485015cdc0 2024-08-17T02:23:41.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.724+0000 7fabcca00640 1 -- 172.21.15.5:0/2862846531 >> v1:172.21.15.5:6789/0 conn(0x7fabc80ca9c0 legacy=0x7fabc80cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:41.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.724+0000 7fabcca00640 1 -- 172.21.15.5:0/2862846531 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc80cea00 con 0x7fabc81589e0 2024-08-17T02:23:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.724+0000 7f484ea00640 1 -- 172.21.15.5:0/3624838534 >> v2:172.21.15.5:3300/0 conn(0x7f48500b03c0 msgr2=0x7f48500b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.724+0000 7f484ea00640 1 --2- 172.21.15.5:0/3624838534 >> v2:172.21.15.5:3300/0 conn(0x7f48500b03c0 0x7f48500b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.724+0000 7f484ea00640 1 -- 172.21.15.5:0/3624838534 >> v1:172.21.15.87:6789/0 conn(0x7f485006d7d0 legacy=0x7f4850160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.724+0000 7f484ea00640 1 -- 172.21.15.5:0/3624838534 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48500af8e0 con 0x7f485015cdc0 2024-08-17T02:23:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.724+0000 7f484ea00640 1 -- 172.21.15.5:0/3624838534 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2658686246 0 0) 0x7f48400017f0 con 0x7f485015cdc0 2024-08-17T02:23:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.724+0000 7f484ea00640 1 -- 172.21.15.5:0/3624838534 >> v1:172.21.15.5:6789/0 conn(0x7f485015cdc0 legacy=0x7f48500ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.724+0000 7f484ea00640 1 --2- 172.21.15.5:0/3624838534 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4834003a20 0x7f4834003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.724+0000 7f484ea00640 1 --2- 172.21.15.5:0/3624838534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4834004780 0x7f4834004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.724+0000 7f484ea00640 1 --2- 172.21.15.5:0/3624838534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4834005180 0x7f483400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.724+0000 7f484ea00640 1 -- 172.21.15.5:0/3624838534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48500af600 con 0x7f4834004780 2024-08-17T02:23:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.724+0000 7f484ea00640 1 -- 172.21.15.5:0/3624838534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483400c120 con 0x7f4834005180 2024-08-17T02:23:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.724+0000 7f484ea00640 1 -- 172.21.15.5:0/3624838534 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483400c2e0 con 0x7f4834003a20 2024-08-17T02:23:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.724+0000 7f484f400640 1 --2- 172.21.15.5:0/3624838534 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4834003a20 0x7f4834003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.724+0000 7fef1fe00640 1 --2- 172.21.15.5:0/3137432404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef04004780 0x7fef2016dec0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef18005f20 tx=0x7fef180051e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.725+0000 7f1f69400640 1 -- 172.21.15.5:0/193123060 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1f64063fb0 con 0x7f1f64146890 2024-08-17T02:23:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.725+0000 7f4846a00640 1 --2- 172.21.15.5:0/3624838534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4834004780 0x7f4834004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.725+0000 7fef17400640 1 -- 172.21.15.5:0/3137432404 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef180124c0 con 0x7fef04004780 2024-08-17T02:23:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.725+0000 7fafea800640 1 --2- 172.21.15.5:0/3898145004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec1589e0 0x7fafec158db0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fafdc009910 tx=0x7fafdc0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=212042c6157f4483 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.725+0000 7f8159400640 1 -- 172.21.15.5:0/618811373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f814c0056a0 con 0x7f814c0ea1f0 2024-08-17T02:23:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.725+0000 7fef17400640 1 -- 172.21.15.5:0/3137432404 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef18012620 con 0x7fef04004780 2024-08-17T02:23:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.725+0000 7f484f400640 1 -- 172.21.15.5:0/3624838534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4834005180 msgr2=0x7f483400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.725+0000 7f484f400640 1 --2- 172.21.15.5:0/3624838534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4834005180 0x7f483400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.725+0000 7f484f400640 1 -- 172.21.15.5:0/3624838534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4834004780 msgr2=0x7f4834004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.725+0000 7f484f400640 1 --2- 172.21.15.5:0/3624838534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4834004780 0x7f4834004bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.725+0000 7f484f400640 1 -- 172.21.15.5:0/3624838534 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48340034e0 con 0x7f4834003a20 2024-08-17T02:23:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.725+0000 7f484fe00640 1 -- 172.21.15.5:0/3624838534 reap_dead start 2024-08-17T02:23:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.726+0000 7f8147400640 1 -- 172.21.15.5:0/618811373 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8148012420 con 0x7f814c0ea1f0 2024-08-17T02:23:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.726+0000 7fa06ec00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0680abe60 0x7fa06816db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.726+0000 7fef17400640 1 -- 172.21.15.5:0/3137432404 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef180124c0 con 0x7fef04004780 2024-08-17T02:23:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.726+0000 7fef27000640 1 -- 172.21.15.5:0/3137432404 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef20097960 con 0x7fef04004780 2024-08-17T02:23:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.726+0000 7fef27000640 1 -- 172.21.15.5:0/3137432404 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef20097f20 con 0x7fef04004780 2024-08-17T02:23:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.726+0000 7fabcca00640 1 --2- 172.21.15.5:0/2862846531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabc81589e0 0x7fabc8158db0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009f20 tx=0x7fabc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80acace78e66c0f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.726+0000 7fafe9400640 1 -- 172.21.15.5:0/3898145004 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc02ae40 con 0x7fafec1589e0 2024-08-17T02:23:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.727+0000 7fa067e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0680abe60 0x7fa06816db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.727+0000 7fa067e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0680abe60 0x7fa06816db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:33850/0 (socket says 172.21.15.5:33850) 2024-08-17T02:23:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.727+0000 7fa067e00640 1 -- 172.21.15.5:0/1928758355 learned_addr learned my addr 172.21.15.5:0/1928758355 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:41.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.727+0000 7fafe9400640 1 -- 172.21.15.5:0/3898145004 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc032440 con 0x7fafec1589e0 2024-08-17T02:23:41.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.727+0000 7fafe9400640 1 -- 172.21.15.5:0/3898145004 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc032820 con 0x7fafec1589e0 2024-08-17T02:23:41.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.727+0000 7fa06ec00640 1 --2- 172.21.15.5:0/1928758355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa068154a60 0x7fa06814d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.727+0000 7f1f5a000640 1 -- 172.21.15.5:0/193123060 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1f54014830 con 0x7f1f64146890 2024-08-17T02:23:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.727+0000 7fabc7400640 1 -- 172.21.15.5:0/2862846531 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0031400 con 0x7fabc81589e0 2024-08-17T02:23:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.727+0000 7fabc7400640 1 -- 172.21.15.5:0/2862846531 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc002d050 con 0x7fabc81589e0 2024-08-17T02:23:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.727+0000 7fabc7400640 1 -- 172.21.15.5:0/2862846531 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0031790 con 0x7fabc81589e0 2024-08-17T02:23:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.726+0000 7f484f400640 1 --2- 172.21.15.5:0/3624838534 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4834003a20 0x7f4834003e30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f484000c440 tx=0x7f48500acf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54da1a0ea2625153 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.727+0000 7f484ea00640 1 -- 172.21.15.5:0/3624838534 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4840005c20 con 0x7f4834003a20 2024-08-17T02:23:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.727+0000 7f484ea00640 1 -- 172.21.15.5:0/3624838534 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4840005d80 con 0x7f4834003a20 2024-08-17T02:23:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.727+0000 7f484ea00640 1 -- 172.21.15.5:0/3624838534 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4840007340 con 0x7f4834003a20 2024-08-17T02:23:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.727+0000 7f8147400640 1 --2- 172.21.15.5:0/618811373 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f81340651d0 0x7f8134067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.728+0000 7f8147400640 1 -- 172.21.15.5:0/618811373 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f81480828c0 con 0x7f814c0ea1f0 2024-08-17T02:23:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.728+0000 7f8147400640 1 --2- 172.21.15.5:0/618811373 >> [v2:172.21.15.87:6824/37668,v1:172.21.15.87:6825/37668] conn(0x7f813406d3e0 0x7f813406f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.728+0000 7f8153e00640 1 --2- 172.21.15.5:0/618811373 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f81340651d0 0x7f8134067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.728+0000 7fabcf400640 1 -- 172.21.15.5:0/2862846531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabc81589e0 msgr2=0x7fabc8158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.728+0000 7fabcf400640 1 --2- 172.21.15.5:0/2862846531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabc81589e0 0x7fabc8158db0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009f20 tx=0x7fabc0009840 comp rx=0 tx=0).stop 2024-08-17T02:23:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.728+0000 7f8147400640 1 -- 172.21.15.5:0/618811373 --> [v2:172.21.15.87:6824/37668,v1:172.21.15.87:6825/37668] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f813406fea0 con 0x7f813406d3e0 2024-08-17T02:23:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.728+0000 7f8147400640 1 -- 172.21.15.5:0/618811373 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8148087200 con 0x7f814c0ea1f0 2024-08-17T02:23:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.728+0000 7faff1400640 1 -- 172.21.15.5:0/3898145004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec1589e0 msgr2=0x7fafec158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.728+0000 7faff1400640 1 --2- 172.21.15.5:0/3898145004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec1589e0 0x7fafec158db0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fafdc009910 tx=0x7fafdc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.728+0000 7fabcf400640 1 -- 172.21.15.5:0/2862846531 shutdown_connections 2024-08-17T02:23:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.728+0000 7fabcf400640 1 --2- 172.21.15.5:0/2862846531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabc81589e0 0x7fabc8158db0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.728+0000 7fabcf400640 1 -- 172.21.15.5:0/2862846531 >> 172.21.15.5:0/2862846531 conn(0x7fabc806e590 msgr2=0x7fabc806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.729+0000 7fabcf400640 1 -- 172.21.15.5:0/2862846531 shutdown_connections 2024-08-17T02:23:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.727+0000 7fa06ec00640 1 --2- 172.21.15.5:0/1928758355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa068154e30 0x7fa0680af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.728+0000 7fa06ec00640 1 -- 172.21.15.5:0/1928758355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06816e130 con 0x7fa068154a60 2024-08-17T02:23:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.728+0000 7fa06ec00640 1 -- 172.21.15.5:0/1928758355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06816e440 con 0x7fa068154e30 2024-08-17T02:23:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.728+0000 7fa06ec00640 1 -- 172.21.15.5:0/1928758355 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06816e720 con 0x7fa0680abe60 2024-08-17T02:23:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.729+0000 7fa067400640 1 --2- 172.21.15.5:0/1928758355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa068154a60 0x7fa06814d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.729+0000 7fa067e00640 1 -- 172.21.15.5:0/1928758355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa068154e30 msgr2=0x7fa0680af4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:23:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.729+0000 7fa067e00640 1 --2- 172.21.15.5:0/1928758355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa068154e30 0x7fa0680af4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.729+0000 7fa067e00640 1 -- 172.21.15.5:0/1928758355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa068154a60 msgr2=0x7fa06814d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.729+0000 7fa067e00640 1 --2- 172.21.15.5:0/1928758355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa068154a60 0x7fa06814d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.729+0000 7fa067e00640 1 -- 172.21.15.5:0/1928758355 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0540084e0 con 0x7fa0680abe60 2024-08-17T02:23:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.730+0000 7fa067e00640 1 --2- 172.21.15.5:0/1928758355 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0680abe60 0x7fa06816db00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa05800d890 tx=0x7fa058008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.730+0000 7f4856000640 1 -- 172.21.15.5:0/3624838534 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4834003a20 msgr2=0x7f4834003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.730+0000 7f4856000640 1 --2- 172.21.15.5:0/3624838534 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4834003a20 0x7f4834003e30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f484000c440 tx=0x7f48500acf20 comp rx=0 tx=0).stop 2024-08-17T02:23:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.729+0000 7fabcf400640 1 -- 172.21.15.5:0/2862846531 wait complete. 2024-08-17T02:23:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.728+0000 7f1f5a000640 1 --2- 172.21.15.5:0/193123060 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1f400652a0 0x7f1f40067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.729+0000 7f1f5a000640 1 -- 172.21.15.5:0/193123060 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f54082b00 con 0x7f1f64146890 2024-08-17T02:23:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.729+0000 7f1f5a000640 1 --2- 172.21.15.5:0/193123060 >> [v2:172.21.15.5:6800/37114,v1:172.21.15.5:6801/37114] conn(0x7f1f4006d430 0x7f1f4006f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.729+0000 7f1f5a000640 1 -- 172.21.15.5:0/193123060 --> [v2:172.21.15.5:6800/37114,v1:172.21.15.5:6801/37114] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f4006fef0 con 0x7f1f4006d430 2024-08-17T02:23:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.729+0000 7f1f61e00640 1 --2- 172.21.15.5:0/193123060 >> [v2:172.21.15.5:6800/37114,v1:172.21.15.5:6801/37114] conn(0x7f1f4006d430 0x7f1f4006f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.730+0000 7f1f62800640 1 --2- 172.21.15.5:0/193123060 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1f400652a0 0x7f1f40067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.730+0000 7faff1400640 1 -- 172.21.15.5:0/3898145004 shutdown_connections 2024-08-17T02:23:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.730+0000 7faff1400640 1 --2- 172.21.15.5:0/3898145004 >> v2:172.21.15.5:3300/0 conn(0x7fafec0cda30 0x7fafec0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.730+0000 7faff1400640 1 --2- 172.21.15.5:0/3898145004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec1589e0 0x7fafec158db0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.730+0000 7faff1400640 1 -- 172.21.15.5:0/3898145004 >> 172.21.15.5:0/3898145004 conn(0x7fafec06e590 msgr2=0x7fafec06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.730+0000 7f1f5a000640 1 -- 172.21.15.5:0/193123060 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f54084ea0 con 0x7f1f64146890 2024-08-17T02:23:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.730+0000 7f8153400640 1 --2- 172.21.15.5:0/618811373 >> [v2:172.21.15.87:6824/37668,v1:172.21.15.87:6825/37668] conn(0x7f813406d3e0 0x7f813406f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.731+0000 7fa05f400640 1 -- 172.21.15.5:0/1928758355 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05800de20 con 0x7fa0680abe60 2024-08-17T02:23:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.731+0000 7f4856000640 1 -- 172.21.15.5:0/3624838534 shutdown_connections 2024-08-17T02:23:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.731+0000 7f4856000640 1 --2- 172.21.15.5:0/3624838534 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4834003a20 0x7f4834003e30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.731+0000 7f4856000640 1 -- 172.21.15.5:0/3624838534 >> 172.21.15.5:0/3624838534 conn(0x7f4850066e60 msgr2=0x7f4850067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.731+0000 7f1f62800640 1 --2- 172.21.15.5:0/193123060 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1f400652a0 0x7f1f40067750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c034000 tx=0x7f1f5c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.731+0000 7fa05f400640 1 -- 172.21.15.5:0/1928758355 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05800b8d0 con 0x7fa0680abe60 2024-08-17T02:23:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.731+0000 7fa05f400640 1 -- 172.21.15.5:0/1928758355 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05800bc90 con 0x7fa0680abe60 2024-08-17T02:23:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.730+0000 7fef17400640 1 -- 172.21.15.5:0/3137432404 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fef180129a0 con 0x7fef04004780 2024-08-17T02:23:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.731+0000 7fa06ec00640 1 -- 172.21.15.5:0/1928758355 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa06816ea00 con 0x7fa0680abe60 2024-08-17T02:23:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.730+0000 7fef27000640 1 -- 172.21.15.5:0/3137432404 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feef8000fd0 con 0x7fef04004780 2024-08-17T02:23:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.731+0000 7fa06ec00640 1 -- 172.21.15.5:0/1928758355 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0680ae7c0 con 0x7fa0680abe60 2024-08-17T02:23:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.731+0000 7f4856000640 1 -- 172.21.15.5:0/3624838534 shutdown_connections 2024-08-17T02:23:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.731+0000 7faff1400640 1 -- 172.21.15.5:0/3898145004 shutdown_connections 2024-08-17T02:23:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.731+0000 7f8153e00640 1 --2- 172.21.15.5:0/618811373 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f81340651d0 0x7f8134067680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f814c006460 tx=0x7f81540ab000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.731+0000 7faff1400640 1 -- 172.21.15.5:0/3898145004 wait complete. 2024-08-17T02:23:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.731+0000 7f4856000640 1 -- 172.21.15.5:0/3624838534 wait complete. 2024-08-17T02:23:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.732+0000 7fabcf400640 1 Processor -- start 2024-08-17T02:23:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.732+0000 7fa06ec00640 1 -- 172.21.15.5:0/1928758355 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa06806a340 con 0x7fa0680abe60 2024-08-17T02:23:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.732+0000 7fabcf400640 1 -- start start 2024-08-17T02:23:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.732+0000 7f8153400640 1 --2- 172.21.15.5:0/618811373 >> [v2:172.21.15.87:6824/37668,v1:172.21.15.87:6825/37668] conn(0x7f813406d3e0 0x7f813406f7f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.733+0000 7fef17400640 1 --2- 172.21.15.5:0/3137432404 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fef00065230 0x7fef000676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.734+0000 7faff1400640 1 Processor -- start 2024-08-17T02:23:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.734+0000 7fabcf400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabc80ca9c0 0x7fabc814d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.734+0000 7f8147400640 1 -- 172.21.15.5:0/618811373 <== osd.4 v2:172.21.15.87:6824/37668 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f813406fea0 con 0x7f813406d3e0 2024-08-17T02:23:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.734+0000 7fabcf400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabc80ce140 0x7fabc814ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.734+0000 7faff1400640 1 -- start start 2024-08-17T02:23:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.734+0000 7fabcf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabc81589e0 0x7fabc814c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.734+0000 7f4856000640 1 Processor -- start 2024-08-17T02:23:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.734+0000 7f4856000640 1 -- start start 2024-08-17T02:23:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.735+0000 7f1f61e00640 1 --2- 172.21.15.5:0/193123060 >> [v2:172.21.15.5:6800/37114,v1:172.21.15.5:6801/37114] conn(0x7f1f4006d430 0x7f1f4006f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.733+0000 7fef17400640 1 -- 172.21.15.5:0/3137432404 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fef18082820 con 0x7fef04004780 2024-08-17T02:23:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.734+0000 7fabcca00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabc80ca9c0 0x7fabc814d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.735+0000 7fabcca00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabc80ca9c0 0x7fabc814d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:33860/0 (socket says 172.21.15.5:33860) 2024-08-17T02:23:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.735+0000 7fabcca00640 1 -- 172.21.15.5:0/251488275 learned_addr learned my addr 172.21.15.5:0/251488275 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.735+0000 7fabc7e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabc80ce140 0x7fabc814ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.734+0000 7fef17400640 1 --2- 172.21.15.5:0/3137432404 >> [v2:172.21.15.5:6808/37123,v1:172.21.15.5:6809/37123] conn(0x7fef0006d440 0x7fef0006f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.734+0000 7fef17400640 1 -- 172.21.15.5:0/3137432404 --> [v2:172.21.15.5:6808/37123,v1:172.21.15.5:6809/37123] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef0006ff00 con 0x7fef0006d440 2024-08-17T02:23:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.734+0000 7fef17400640 1 -- 172.21.15.5:0/3137432404 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef18084d00 con 0x7fef04004780 2024-08-17T02:23:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.735+0000 7fabcf400640 1 -- 172.21.15.5:0/251488275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc81501a0 con 0x7fabc81589e0 2024-08-17T02:23:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.735+0000 7fabcf400640 1 -- 172.21.15.5:0/251488275 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80c7280 con 0x7fabc80ce140 2024-08-17T02:23:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.735+0000 7fabcf400640 1 -- 172.21.15.5:0/251488275 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc814f620 con 0x7fabc80ca9c0 2024-08-17T02:23:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.735+0000 7fabcd400640 1 --2- 172.21.15.5:0/251488275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabc81589e0 0x7fabc814c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.735+0000 7fabcca00640 1 -- 172.21.15.5:0/251488275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabc80ce140 msgr2=0x7fabc814ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.735+0000 7fabcca00640 1 --2- 172.21.15.5:0/251488275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabc80ce140 0x7fabc814ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.735+0000 7fabcca00640 1 -- 172.21.15.5:0/251488275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabc81589e0 msgr2=0x7fabc814c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.735+0000 7fabcca00640 1 --2- 172.21.15.5:0/251488275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabc81589e0 0x7fabc814c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.735+0000 7fabcca00640 1 -- 172.21.15.5:0/251488275 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc0009ae0 con 0x7fabc80ca9c0 2024-08-17T02:23:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.736+0000 7fabcd400640 1 --2- 172.21.15.5:0/251488275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabc81589e0 0x7fabc814c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.736+0000 7fabcca00640 1 --2- 172.21.15.5:0/251488275 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabc80ca9c0 0x7fabc814d310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009ab0 tx=0x7fabc0036000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.736+0000 7f1f5a000640 1 -- 172.21.15.5:0/193123060 <== osd.2 v2:172.21.15.5:6800/37114 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f1f4006fef0 con 0x7f1f4006d430 2024-08-17T02:23:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.736+0000 7fa05f400640 1 -- 172.21.15.5:0/1928758355 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa05801e460 con 0x7fa0680abe60 2024-08-17T02:23:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.736+0000 7fef1f400640 1 --2- 172.21.15.5:0/3137432404 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fef00065230 0x7fef000676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.736+0000 7fef25000640 1 --2- 172.21.15.5:0/3137432404 >> [v2:172.21.15.5:6808/37123,v1:172.21.15.5:6809/37123] conn(0x7fef0006d440 0x7fef0006f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.737+0000 7faff1400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec0ca9c0 0x7fafec0b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.737+0000 7fabbfe00640 1 -- 172.21.15.5:0/251488275 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc003c700 con 0x7fabc80ca9c0 2024-08-17T02:23:41.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.737+0000 7faff1400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafec0cda30 0x7fafec0cf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.737+0000 7fabbfe00640 1 -- 172.21.15.5:0/251488275 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc003c860 con 0x7fabc80ca9c0 2024-08-17T02:23:41.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.737+0000 7fabbfe00640 1 -- 172.21.15.5:0/251488275 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc003cbe0 con 0x7fabc80ca9c0 2024-08-17T02:23:41.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.737+0000 7fabcf400640 1 -- 172.21.15.5:0/251488275 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc814f900 con 0x7fabc80ca9c0 2024-08-17T02:23:41.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.737+0000 7fabcf400640 1 -- 172.21.15.5:0/251488275 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc814fec0 con 0x7fabc80ca9c0 2024-08-17T02:23:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.737+0000 7fafea800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec0ca9c0 0x7fafec0b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.737+0000 7fafe9e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafec0cda30 0x7fafec0cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.738+0000 7fafe9e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafec0cda30 0x7fafec0cf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:56490/0 (socket says 172.21.15.5:56490) 2024-08-17T02:23:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.738+0000 7fa05f400640 1 --2- 172.21.15.5:0/1928758355 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa0480652a0 0x7fa048067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.738+0000 7fafea800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec0ca9c0 0x7fafec0b3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:33866/0 (socket says 172.21.15.5:33866) 2024-08-17T02:23:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.738+0000 7fafe9e00640 1 -- 172.21.15.5:0/3051878861 learned_addr learned my addr 172.21.15.5:0/3051878861 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.738+0000 7faff1400640 1 --2- 172.21.15.5:0/3051878861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafec1589e0 0x7fafec0cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.738+0000 7fef25000640 1 --2- 172.21.15.5:0/3137432404 >> [v2:172.21.15.5:6808/37123,v1:172.21.15.5:6809/37123] conn(0x7fef0006d440 0x7fef0006f850 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.739+0000 7fef1f400640 1 --2- 172.21.15.5:0/3137432404 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fef00065230 0x7fef000676e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fef10034000 tx=0x7fef10035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.739+0000 7faff1400640 1 -- 172.21.15.5:0/3051878861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec0b3a80 con 0x7fafec1589e0 2024-08-17T02:23:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.739+0000 7faff1400640 1 -- 172.21.15.5:0/3051878861 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec175f70 con 0x7fafec0cda30 2024-08-17T02:23:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.739+0000 7faff1400640 1 -- 172.21.15.5:0/3051878861 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafec0b2e70 con 0x7fafec0ca9c0 2024-08-17T02:23:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.739+0000 7fabcf400640 1 -- 172.21.15.5:0/251488275 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fabc8063fb0 con 0x7fabc80ca9c0 2024-08-17T02:23:41.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.739+0000 7fef17400640 1 -- 172.21.15.5:0/3137432404 <== osd.1 v2:172.21.15.5:6808/37123 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fef0006ff00 con 0x7fef0006d440 2024-08-17T02:23:41.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.740+0000 7fafeb200640 1 --2- 172.21.15.5:0/3051878861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafec1589e0 0x7fafec0cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.739+0000 7f4856000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4834003a20 0x7f4850170a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.740+0000 7fafe9e00640 1 -- 172.21.15.5:0/3051878861 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec0ca9c0 msgr2=0x7fafec0b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.740+0000 7fafe9e00640 1 --2- 172.21.15.5:0/3051878861 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec0ca9c0 0x7fafec0b3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.740+0000 7fafe9e00640 1 -- 172.21.15.5:0/3051878861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafec1589e0 msgr2=0x7fafec0cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.740+0000 7fa05f400640 1 -- 172.21.15.5:0/1928758355 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa058082b40 con 0x7fa0680abe60 2024-08-17T02:23:41.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.740+0000 7fafe9e00640 1 --2- 172.21.15.5:0/3051878861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafec1589e0 0x7fafec0cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.740+0000 7fafe9e00640 1 -- 172.21.15.5:0/3051878861 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc009450 con 0x7fafec0cda30 2024-08-17T02:23:41.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.740+0000 7fafea800640 1 --2- 172.21.15.5:0/3051878861 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec0ca9c0 0x7fafec0b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.740+0000 7fafeb200640 1 --2- 172.21.15.5:0/3051878861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafec1589e0 0x7fafec0cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.740+0000 7f4856000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48500a4d70 0x7f4850147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.740+0000 7f484f400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4834003a20 0x7f4850170a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.740+0000 7fa05f400640 1 --2- 172.21.15.5:0/1928758355 >> [v2:172.21.15.5:6816/37127,v1:172.21.15.5:6818/37127] conn(0x7fa04806d4b0 0x7fa04806f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.740+0000 7fa05f400640 1 -- 172.21.15.5:0/1928758355 --> [v2:172.21.15.5:6816/37127,v1:172.21.15.5:6818/37127] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa04806ff70 con 0x7fa04806d4b0 2024-08-17T02:23:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.740+0000 7fa05f400640 1 -- 172.21.15.5:0/1928758355 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa058087220 con 0x7fa0680abe60 2024-08-17T02:23:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.740+0000 7fabbfe00640 1 -- 172.21.15.5:0/251488275 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fabc003b380 con 0x7fabc80ca9c0 2024-08-17T02:23:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.741+0000 7fafe9e00640 1 --2- 172.21.15.5:0/3051878861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafec0cda30 0x7fafec0cf160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fafd800c4c0 tx=0x7fafd8007ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.741+0000 7f4856000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4850154760 0x7f4850154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.741+0000 7fafe2000640 1 -- 172.21.15.5:0/3051878861 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8011590 con 0x7fafec0cda30 2024-08-17T02:23:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.741+0000 7fa06cc00640 1 --2- 172.21.15.5:0/1928758355 >> [v2:172.21.15.5:6816/37127,v1:172.21.15.5:6818/37127] conn(0x7fa04806d4b0 0x7fa04806f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.741+0000 7f4856000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4850152050 con 0x7f48500a4d70 2024-08-17T02:23:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.741+0000 7f4856000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48500a51e0 con 0x7f4850154760 2024-08-17T02:23:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.741+0000 7f4856000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4850155110 con 0x7f4834003a20 2024-08-17T02:23:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.741+0000 7f484f400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4834003a20 0x7f4850170a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:33878/0 (socket says 172.21.15.5:33878) 2024-08-17T02:23:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.741+0000 7f484f400640 1 -- 172.21.15.5:0/2407814374 learned_addr learned my addr 172.21.15.5:0/2407814374 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.741+0000 7fafe2000640 1 -- 172.21.15.5:0/3051878861 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd8011710 con 0x7fafec0cda30 2024-08-17T02:23:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.741+0000 7fafe2000640 1 -- 172.21.15.5:0/3051878861 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8011ad0 con 0x7fafec0cda30 2024-08-17T02:23:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.742+0000 7f4846a00640 1 --2- 172.21.15.5:0/2407814374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48500a4d70 0x7f4850147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.741+0000 7faff1400640 1 -- 172.21.15.5:0/3051878861 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafec0b3150 con 0x7fafec0cda30 2024-08-17T02:23:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.741+0000 7faff1400640 1 -- 172.21.15.5:0/3051878861 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafec0b3710 con 0x7fafec0cda30 2024-08-17T02:23:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.742+0000 7fa067400640 1 --2- 172.21.15.5:0/1928758355 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa0480652a0 0x7fa048067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.742+0000 7faff1400640 1 -- 172.21.15.5:0/3051878861 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fafc4000fd0 con 0x7fafec0cda30 2024-08-17T02:23:41.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.742+0000 7f484fe00640 1 --2- 172.21.15.5:0/2407814374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4850154760 0x7f4850154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.743+0000 7fabbfe00640 1 --2- 172.21.15.5:0/251488275 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7faba40652d0 0x7faba4067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.743+0000 7fabbfe00640 1 -- 172.21.15.5:0/251488275 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fabc00a30c0 con 0x7fabc80ca9c0 2024-08-17T02:23:41.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.743+0000 7f484fe00640 1 -- 172.21.15.5:0/2407814374 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4834003a20 msgr2=0x7f4850170a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.743+0000 7f484fe00640 1 --2- 172.21.15.5:0/2407814374 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4834003a20 0x7f4850170a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.743+0000 7fabbfe00640 1 --2- 172.21.15.5:0/251488275 >> [v2:172.21.15.87:6808/37667,v1:172.21.15.87:6809/37667] conn(0x7faba406d4e0 0x7faba406f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.743+0000 7f484fe00640 1 -- 172.21.15.5:0/2407814374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48500a4d70 msgr2=0x7f4850147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.743+0000 7f484fe00640 1 --2- 172.21.15.5:0/2407814374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48500a4d70 0x7f4850147a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.743+0000 7f484fe00640 1 -- 172.21.15.5:0/2407814374 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4850157520 con 0x7f4850154760 2024-08-17T02:23:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.743+0000 7f484f400640 1 --2- 172.21.15.5:0/2407814374 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4834003a20 0x7f4850170a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.743+0000 7f4846a00640 1 --2- 172.21.15.5:0/2407814374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48500a4d70 0x7f4850147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.743+0000 7fabbfe00640 1 -- 172.21.15.5:0/251488275 --> [v2:172.21.15.87:6808/37667,v1:172.21.15.87:6809/37667] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faba406ffa0 con 0x7faba406d4e0 2024-08-17T02:23:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.743+0000 7fabbfe00640 1 -- 172.21.15.5:0/251488275 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabc00a5660 con 0x7fabc80ca9c0 2024-08-17T02:23:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.744+0000 7fabc7e00640 1 --2- 172.21.15.5:0/251488275 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7faba40652d0 0x7faba4067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.744+0000 7f484fe00640 1 --2- 172.21.15.5:0/2407814374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4850154760 0x7f4850154bd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f485006cc20 tx=0x7f4848007c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.744+0000 7fabcd400640 1 --2- 172.21.15.5:0/251488275 >> [v2:172.21.15.87:6808/37667,v1:172.21.15.87:6809/37667] conn(0x7faba406d4e0 0x7faba406f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.744+0000 7f4847400640 1 -- 172.21.15.5:0/2407814374 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848007320 con 0x7f4850154760 2024-08-17T02:23:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.744+0000 7fabcd400640 1 --2- 172.21.15.5:0/251488275 >> [v2:172.21.15.87:6808/37667,v1:172.21.15.87:6809/37667] conn(0x7faba406d4e0 0x7faba406f8f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.744+0000 7f4856000640 1 -- 172.21.15.5:0/2407814374 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48501710d0 con 0x7f4850154760 2024-08-17T02:23:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.744+0000 7f4856000640 1 -- 172.21.15.5:0/2407814374 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4850171690 con 0x7f4850154760 2024-08-17T02:23:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.745+0000 7fabc7e00640 1 --2- 172.21.15.5:0/251488275 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7faba40652d0 0x7faba4067780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fabc8154c70 tx=0x7fabb8006f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.745+0000 7f4847400640 1 -- 172.21.15.5:0/2407814374 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48480074a0 con 0x7f4850154760 2024-08-17T02:23:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.745+0000 7f4847400640 1 -- 172.21.15.5:0/2407814374 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48480059d0 con 0x7f4850154760 2024-08-17T02:23:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.745+0000 7fa06cc00640 1 --2- 172.21.15.5:0/1928758355 >> [v2:172.21.15.5:6816/37127,v1:172.21.15.5:6818/37127] conn(0x7fa04806d4b0 0x7fa04806f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.745+0000 7fa067400640 1 --2- 172.21.15.5:0/1928758355 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa0480652a0 0x7fa048067750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa054037000 tx=0x7fa05403a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.745+0000 7fafe2000640 1 -- 172.21.15.5:0/3051878861 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fafd801b3b0 con 0x7fafec0cda30 2024-08-17T02:23:41.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.745+0000 7fabbfe00640 1 -- 172.21.15.5:0/251488275 <== osd.6 v2:172.21.15.87:6808/37667 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7faba406ffa0 con 0x7faba406d4e0 2024-08-17T02:23:41.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.747+0000 7fafe2000640 1 --2- 172.21.15.5:0/3051878861 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fafcc0652d0 0x7fafcc067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.747+0000 7fafe2000640 1 -- 172.21.15.5:0/3051878861 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fafd8081f70 con 0x7fafec0cda30 2024-08-17T02:23:41.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.747+0000 7fafe2000640 1 --2- 172.21.15.5:0/3051878861 >> [v2:172.21.15.87:6800/37666,v1:172.21.15.87:6801/37666] conn(0x7fafcc06d4e0 0x7fafcc06f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.747+0000 7fafe2000640 1 -- 172.21.15.5:0/3051878861 --> [v2:172.21.15.87:6800/37666,v1:172.21.15.87:6801/37666] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fafcc06ffa0 con 0x7fafcc06d4e0 2024-08-17T02:23:41.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.747+0000 7fafe2000640 1 -- 172.21.15.5:0/3051878861 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafd80822a0 con 0x7fafec0cda30 2024-08-17T02:23:41.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.748+0000 7fafea800640 1 --2- 172.21.15.5:0/3051878861 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fafcc0652d0 0x7fafcc067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.748+0000 7f4847400640 1 -- 172.21.15.5:0/2407814374 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f484800c780 con 0x7f4850154760 2024-08-17T02:23:41.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.748+0000 7fafeb200640 1 --2- 172.21.15.5:0/3051878861 >> [v2:172.21.15.87:6800/37666,v1:172.21.15.87:6801/37666] conn(0x7fafcc06d4e0 0x7fafcc06f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.749+0000 7f4856000640 1 -- 172.21.15.5:0/2407814374 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4828000fd0 con 0x7f4850154760 2024-08-17T02:23:41.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.749+0000 7f4847400640 1 --2- 172.21.15.5:0/2407814374 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f482c065220 0x7f482c0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.749+0000 7f4847400640 1 -- 172.21.15.5:0/2407814374 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f48480811a0 con 0x7f4850154760 2024-08-17T02:23:41.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.749+0000 7f4847400640 1 --2- 172.21.15.5:0/2407814374 >> [v2:172.21.15.87:6816/37679,v1:172.21.15.87:6817/37679] conn(0x7f482c06d3b0 0x7f482c06f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:41.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.749+0000 7f4847400640 1 -- 172.21.15.5:0/2407814374 --> [v2:172.21.15.87:6816/37679,v1:172.21.15.87:6817/37679] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f482c06fe70 con 0x7f482c06d3b0 2024-08-17T02:23:41.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.749+0000 7f4847400640 1 -- 172.21.15.5:0/2407814374 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4848007610 con 0x7f4850154760 2024-08-17T02:23:41.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.750+0000 7f484f400640 1 --2- 172.21.15.5:0/2407814374 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f482c065220 0x7f482c0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.750+0000 7f4846a00640 1 --2- 172.21.15.5:0/2407814374 >> [v2:172.21.15.87:6816/37679,v1:172.21.15.87:6817/37679] conn(0x7f482c06d3b0 0x7f482c06f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:41.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.751+0000 7f4846a00640 1 --2- 172.21.15.5:0/2407814374 >> [v2:172.21.15.87:6816/37679,v1:172.21.15.87:6817/37679] conn(0x7f482c06d3b0 0x7f482c06f7c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.751+0000 7fa05f400640 1 -- 172.21.15.5:0/1928758355 <== osd.3 v2:172.21.15.5:6816/37127 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fa04806ff70 con 0x7fa04806d4b0 2024-08-17T02:23:41.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.751+0000 7f484f400640 1 --2- 172.21.15.5:0/2407814374 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f482c065220 0x7f482c0676d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4840001350 tx=0x7f4840034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.751+0000 7fafea800640 1 --2- 172.21.15.5:0/3051878861 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fafcc0652d0 0x7fafcc067780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fafdc034000 tx=0x7fafdc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.751+0000 7fafeb200640 1 --2- 172.21.15.5:0/3051878861 >> [v2:172.21.15.87:6800/37666,v1:172.21.15.87:6801/37666] conn(0x7fafcc06d4e0 0x7fafcc06f8f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:41.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.752+0000 7f4847400640 1 -- 172.21.15.5:0/2407814374 <== osd.7 v2:172.21.15.87:6816/37679 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f482c06fe70 con 0x7f482c06d3b0 2024-08-17T02:23:41.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.755+0000 7f4c32200640 1 -- 172.21.15.5:0/2810478161 --> [v2:172.21.15.5:6817/37117,v1:172.21.15.5:6819/37117] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4c2c0a7380 con 0x7f4c0c06d360 2024-08-17T02:23:41.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.752+0000 7fafe2000640 1 -- 172.21.15.5:0/3051878861 <== osd.5 v2:172.21.15.87:6800/37666 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fafcc06ffa0 con 0x7fafcc06d4e0 2024-08-17T02:23:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.756+0000 7f4c22a00640 1 -- 172.21.15.5:0/2810478161 <== osd.0 v2:172.21.15.5:6817/37117 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4c2c0a7380 con 0x7f4c0c06d360 2024-08-17T02:23:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.756+0000 7f4c17e00640 1 -- 172.21.15.5:0/2810478161 >> [v2:172.21.15.5:6817/37117,v1:172.21.15.5:6819/37117] conn(0x7f4c0c06d360 msgr2=0x7f4c0c06f770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.756+0000 7f4c17e00640 1 --2- 172.21.15.5:0/2810478161 >> [v2:172.21.15.5:6817/37117,v1:172.21.15.5:6819/37117] conn(0x7f4c0c06d360 0x7f4c0c06f770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.757+0000 7f4c17e00640 1 -- 172.21.15.5:0/2810478161 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4c0c065150 msgr2=0x7f4c0c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.757+0000 7f4c17e00640 1 --2- 172.21.15.5:0/2810478161 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4c0c065150 0x7f4c0c067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c034000 tx=0x7f4c1c032000 comp rx=0 tx=0).stop 2024-08-17T02:23:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.757+0000 7f4c17e00640 1 -- 172.21.15.5:0/2810478161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c2c0b0900 msgr2=0x7f4c2c156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.757+0000 7f4c17e00640 1 --2- 172.21.15.5:0/2810478161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c2c0b0900 0x7f4c2c156020 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800d890 tx=0x7f4c18008040 comp rx=0 tx=0).stop 2024-08-17T02:23:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.757+0000 7f4c2be00640 1 -- 172.21.15.5:0/2810478161 reap_dead start 2024-08-17T02:23:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.757+0000 7f4c17e00640 1 -- 172.21.15.5:0/2810478161 shutdown_connections 2024-08-17T02:23:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.757+0000 7f4c17e00640 1 -- 172.21.15.5:0/2810478161 >> 172.21.15.5:0/2810478161 conn(0x7f4c2c066e60 msgr2=0x7f4c2c06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.758+0000 7f4c17e00640 1 -- 172.21.15.5:0/2810478161 shutdown_connections 2024-08-17T02:23:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.758+0000 7f4c17e00640 1 -- 172.21.15.5:0/2810478161 wait complete. 2024-08-17T02:23:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.761+0000 7f8159400640 1 -- 172.21.15.5:0/618811373 --> [v2:172.21.15.87:6824/37668,v1:172.21.15.87:6825/37668] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f814c03ed90 con 0x7f813406d3e0 2024-08-17T02:23:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.763+0000 7f8147400640 1 -- 172.21.15.5:0/618811373 <== osd.4 v2:172.21.15.87:6824/37668 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f814c03ed90 con 0x7f813406d3e0 2024-08-17T02:23:41.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.767+0000 7f8159400640 1 -- 172.21.15.5:0/618811373 >> [v2:172.21.15.87:6824/37668,v1:172.21.15.87:6825/37668] conn(0x7f813406d3e0 msgr2=0x7f813406f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.767+0000 7f8159400640 1 --2- 172.21.15.5:0/618811373 >> [v2:172.21.15.87:6824/37668,v1:172.21.15.87:6825/37668] conn(0x7f813406d3e0 0x7f813406f7f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.767+0000 7f8159400640 1 -- 172.21.15.5:0/618811373 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f81340651d0 msgr2=0x7f8134067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.767+0000 7f8159400640 1 --2- 172.21.15.5:0/618811373 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f81340651d0 0x7f8134067680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f814c006460 tx=0x7f81540ab000 comp rx=0 tx=0).stop 2024-08-17T02:23:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.767+0000 7f8159400640 1 -- 172.21.15.5:0/618811373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f814c0ea1f0 msgr2=0x7f814c0f7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.767+0000 7f8159400640 1 --2- 172.21.15.5:0/618811373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f814c0ea1f0 0x7f814c0f7c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f814800d860 tx=0x7f8148008040 comp rx=0 tx=0).stop 2024-08-17T02:23:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.767+0000 7f8158a00640 1 -- 172.21.15.5:0/618811373 reap_dead start 2024-08-17T02:23:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.767+0000 7f8159400640 1 -- 172.21.15.5:0/618811373 shutdown_connections 2024-08-17T02:23:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.767+0000 7f8159400640 1 -- 172.21.15.5:0/618811373 >> 172.21.15.5:0/618811373 conn(0x7f814c055a10 msgr2=0x7f814c04f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.768+0000 7f8159400640 1 -- 172.21.15.5:0/618811373 shutdown_connections 2024-08-17T02:23:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.768+0000 7f8159400640 1 -- 172.21.15.5:0/618811373 wait complete. 2024-08-17T02:23:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.772+0000 7f1f69400640 1 -- 172.21.15.5:0/193123060 --> [v2:172.21.15.5:6800/37114,v1:172.21.15.5:6801/37114] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1f64141f90 con 0x7f1f4006d430 2024-08-17T02:23:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.772+0000 7f1f5a000640 1 -- 172.21.15.5:0/193123060 <== osd.2 v2:172.21.15.5:6800/37114 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1f64141f90 con 0x7f1f4006d430 2024-08-17T02:23:41.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.774+0000 7f1f69400640 1 -- 172.21.15.5:0/193123060 >> [v2:172.21.15.5:6800/37114,v1:172.21.15.5:6801/37114] conn(0x7f1f4006d430 msgr2=0x7f1f4006f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.774+0000 7f1f69400640 1 --2- 172.21.15.5:0/193123060 >> [v2:172.21.15.5:6800/37114,v1:172.21.15.5:6801/37114] conn(0x7f1f4006d430 0x7f1f4006f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.775+0000 7f1f69400640 1 -- 172.21.15.5:0/193123060 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1f400652a0 msgr2=0x7f1f40067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.775+0000 7f1f69400640 1 --2- 172.21.15.5:0/193123060 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1f400652a0 0x7f1f40067750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c034000 tx=0x7f1f5c032000 comp rx=0 tx=0).stop 2024-08-17T02:23:41.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.775+0000 7f1f69400640 1 -- 172.21.15.5:0/193123060 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f64146890 msgr2=0x7f1f640cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.775+0000 7fabcf400640 1 -- 172.21.15.5:0/251488275 --> [v2:172.21.15.87:6808/37667,v1:172.21.15.87:6809/37667] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fabc8067620 con 0x7faba406d4e0 2024-08-17T02:23:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.775+0000 7f1f69400640 1 --2- 172.21.15.5:0/193123060 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f64146890 0x7f1f640cc6e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009e50 tx=0x7f1f5400b040 comp rx=0 tx=0).stop 2024-08-17T02:23:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.775+0000 7f1f63200640 1 -- 172.21.15.5:0/193123060 reap_dead start 2024-08-17T02:23:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.775+0000 7f1f69400640 1 -- 172.21.15.5:0/193123060 shutdown_connections 2024-08-17T02:23:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.775+0000 7f1f69400640 1 -- 172.21.15.5:0/193123060 >> 172.21.15.5:0/193123060 conn(0x7f1f6406e590 msgr2=0x7f1f641428b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.776+0000 7f1f69400640 1 -- 172.21.15.5:0/193123060 shutdown_connections 2024-08-17T02:23:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.776+0000 7f1f69400640 1 -- 172.21.15.5:0/193123060 wait complete. 2024-08-17T02:23:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.776+0000 7fa06ec00640 1 -- 172.21.15.5:0/1928758355 --> [v2:172.21.15.5:6816/37127,v1:172.21.15.5:6818/37127] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa068070720 con 0x7fa04806d4b0 2024-08-17T02:23:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.776+0000 7fabbfe00640 1 -- 172.21.15.5:0/251488275 <== osd.6 v2:172.21.15.87:6808/37667 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fabc8067620 con 0x7faba406d4e0 2024-08-17T02:23:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.776+0000 7fa05f400640 1 -- 172.21.15.5:0/1928758355 <== osd.3 v2:172.21.15.5:6816/37127 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa068070720 con 0x7fa04806d4b0 2024-08-17T02:23:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.777+0000 7fef27000640 1 -- 172.21.15.5:0/3137432404 --> [v2:172.21.15.5:6808/37123,v1:172.21.15.5:6809/37123] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feef8002ca0 con 0x7fef0006d440 2024-08-17T02:23:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.777+0000 7fa06ec00640 1 -- 172.21.15.5:0/1928758355 >> [v2:172.21.15.5:6816/37127,v1:172.21.15.5:6818/37127] conn(0x7fa04806d4b0 msgr2=0x7fa04806f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.778+0000 7fa06ec00640 1 --2- 172.21.15.5:0/1928758355 >> [v2:172.21.15.5:6816/37127,v1:172.21.15.5:6818/37127] conn(0x7fa04806d4b0 0x7fa04806f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.778+0000 7fabcf400640 1 -- 172.21.15.5:0/251488275 >> [v2:172.21.15.87:6808/37667,v1:172.21.15.87:6809/37667] conn(0x7faba406d4e0 msgr2=0x7faba406f8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.778+0000 7fabcf400640 1 --2- 172.21.15.5:0/251488275 >> [v2:172.21.15.87:6808/37667,v1:172.21.15.87:6809/37667] conn(0x7faba406d4e0 0x7faba406f8f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.778+0000 7fabcf400640 1 -- 172.21.15.5:0/251488275 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7faba40652d0 msgr2=0x7faba4067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.778+0000 7fabcf400640 1 --2- 172.21.15.5:0/251488275 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7faba40652d0 0x7faba4067780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fabc8154c70 tx=0x7fabb8006f30 comp rx=0 tx=0).stop 2024-08-17T02:23:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.778+0000 7fabcf400640 1 -- 172.21.15.5:0/251488275 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabc80ca9c0 msgr2=0x7fabc814d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.778+0000 7fabcf400640 1 --2- 172.21.15.5:0/251488275 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabc80ca9c0 0x7fabc814d310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009ab0 tx=0x7fabc0036000 comp rx=0 tx=0).stop 2024-08-17T02:23:41.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.778+0000 7fabcd400640 1 -- 172.21.15.5:0/251488275 reap_dead start 2024-08-17T02:23:41.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.778+0000 7fabcf400640 1 -- 172.21.15.5:0/251488275 shutdown_connections 2024-08-17T02:23:41.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.778+0000 7fa06ec00640 1 -- 172.21.15.5:0/1928758355 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa0480652a0 msgr2=0x7fa048067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.778+0000 7fa06ec00640 1 --2- 172.21.15.5:0/1928758355 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa0480652a0 0x7fa048067750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa054037000 tx=0x7fa05403a000 comp rx=0 tx=0).stop 2024-08-17T02:23:41.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.778+0000 7fabcf400640 1 -- 172.21.15.5:0/251488275 >> 172.21.15.5:0/251488275 conn(0x7fabc806e590 msgr2=0x7fabc8155d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.778+0000 7fa06ec00640 1 -- 172.21.15.5:0/1928758355 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0680abe60 msgr2=0x7fa06816db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.778+0000 7fa06ec00640 1 --2- 172.21.15.5:0/1928758355 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0680abe60 0x7fa06816db00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa05800d890 tx=0x7fa058008040 comp rx=0 tx=0).stop 2024-08-17T02:23:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.779+0000 7fa06cc00640 1 -- 172.21.15.5:0/1928758355 reap_dead start 2024-08-17T02:23:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.779+0000 7fabcf400640 1 -- 172.21.15.5:0/251488275 shutdown_connections 2024-08-17T02:23:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.779+0000 7fabcf400640 1 -- 172.21.15.5:0/251488275 wait complete. 2024-08-17T02:23:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.779+0000 7fef17400640 1 -- 172.21.15.5:0/3137432404 <== osd.1 v2:172.21.15.5:6808/37123 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feef8002ca0 con 0x7fef0006d440 2024-08-17T02:23:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.779+0000 7fa06ec00640 1 -- 172.21.15.5:0/1928758355 shutdown_connections 2024-08-17T02:23:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.779+0000 7fa06ec00640 1 -- 172.21.15.5:0/1928758355 >> 172.21.15.5:0/1928758355 conn(0x7fa0680c8260 msgr2=0x7fa0680cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.811 INFO:teuthology.orchestra.run.smithi005.stdout:60129542149 2024-08-17T02:23:41.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:23:41.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.780+0000 7fa06ec00640 1 -- 172.21.15.5:0/1928758355 shutdown_connections 2024-08-17T02:23:41.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.780+0000 7fa06ec00640 1 -- 172.21.15.5:0/1928758355 wait complete. 2024-08-17T02:23:41.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.780+0000 7fef27000640 1 -- 172.21.15.5:0/3137432404 >> [v2:172.21.15.5:6808/37123,v1:172.21.15.5:6809/37123] conn(0x7fef0006d440 msgr2=0x7fef0006f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.780+0000 7fef27000640 1 --2- 172.21.15.5:0/3137432404 >> [v2:172.21.15.5:6808/37123,v1:172.21.15.5:6809/37123] conn(0x7fef0006d440 0x7fef0006f850 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.781+0000 7fef27000640 1 -- 172.21.15.5:0/3137432404 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fef00065230 msgr2=0x7fef000676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.781+0000 7fef27000640 1 --2- 172.21.15.5:0/3137432404 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fef00065230 0x7fef000676e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fef10034000 tx=0x7fef10035000 comp rx=0 tx=0).stop 2024-08-17T02:23:41.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.781+0000 7fef27000640 1 -- 172.21.15.5:0/3137432404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef04004780 msgr2=0x7fef2016dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.781+0000 7fef27000640 1 --2- 172.21.15.5:0/3137432404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef04004780 0x7fef2016dec0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef18005f20 tx=0x7fef180051e0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.781+0000 7fef25000640 1 -- 172.21.15.5:0/3137432404 reap_dead start 2024-08-17T02:23:41.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.781+0000 7fef27000640 1 -- 172.21.15.5:0/3137432404 shutdown_connections 2024-08-17T02:23:41.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.781+0000 7fef27000640 1 -- 172.21.15.5:0/3137432404 >> 172.21.15.5:0/3137432404 conn(0x7fef200ce5a0 msgr2=0x7fef2015b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.782+0000 7f4856000640 1 -- 172.21.15.5:0/2407814374 --> [v2:172.21.15.87:6816/37679,v1:172.21.15.87:6817/37679] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4828002ca0 con 0x7f482c06d3b0 2024-08-17T02:23:41.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.782+0000 7fef27000640 1 -- 172.21.15.5:0/3137432404 shutdown_connections 2024-08-17T02:23:41.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.782+0000 7fef27000640 1 -- 172.21.15.5:0/3137432404 wait complete. 2024-08-17T02:23:41.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.784+0000 7f4847400640 1 -- 172.21.15.5:0/2407814374 <== osd.7 v2:172.21.15.87:6816/37679 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4828002ca0 con 0x7f482c06d3b0 2024-08-17T02:23:41.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.784+0000 7f4856000640 1 -- 172.21.15.5:0/2407814374 >> [v2:172.21.15.87:6816/37679,v1:172.21.15.87:6817/37679] conn(0x7f482c06d3b0 msgr2=0x7f482c06f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.784+0000 7f4856000640 1 --2- 172.21.15.5:0/2407814374 >> [v2:172.21.15.87:6816/37679,v1:172.21.15.87:6817/37679] conn(0x7f482c06d3b0 0x7f482c06f7c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.786+0000 7faff1400640 1 -- 172.21.15.5:0/3051878861 --> [v2:172.21.15.87:6800/37666,v1:172.21.15.87:6801/37666] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fafc4002ca0 con 0x7fafcc06d4e0 2024-08-17T02:23:41.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.786+0000 7f4856000640 1 -- 172.21.15.5:0/2407814374 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f482c065220 msgr2=0x7f482c0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.786+0000 7f4856000640 1 --2- 172.21.15.5:0/2407814374 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f482c065220 0x7f482c0676d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4840001350 tx=0x7f4840034000 comp rx=0 tx=0).stop 2024-08-17T02:23:41.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.786+0000 7f4856000640 1 -- 172.21.15.5:0/2407814374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4850154760 msgr2=0x7f4850154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.786+0000 7f4856000640 1 --2- 172.21.15.5:0/2407814374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4850154760 0x7f4850154bd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f485006cc20 tx=0x7f4848007c80 comp rx=0 tx=0).stop 2024-08-17T02:23:41.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.786+0000 7f484fe00640 1 -- 172.21.15.5:0/2407814374 reap_dead start 2024-08-17T02:23:41.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.786+0000 7f4856000640 1 -- 172.21.15.5:0/2407814374 shutdown_connections 2024-08-17T02:23:41.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.786+0000 7f4856000640 1 -- 172.21.15.5:0/2407814374 >> 172.21.15.5:0/2407814374 conn(0x7f4850066e60 msgr2=0x7f485015b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.786+0000 7f4856000640 1 -- 172.21.15.5:0/2407814374 shutdown_connections 2024-08-17T02:23:41.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.786+0000 7f4856000640 1 -- 172.21.15.5:0/2407814374 wait complete. 2024-08-17T02:23:41.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.787+0000 7fafe2000640 1 -- 172.21.15.5:0/3051878861 <== osd.5 v2:172.21.15.87:6800/37666 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fafc4002ca0 con 0x7fafcc06d4e0 2024-08-17T02:23:41.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.788+0000 7faff1400640 1 -- 172.21.15.5:0/3051878861 >> [v2:172.21.15.87:6800/37666,v1:172.21.15.87:6801/37666] conn(0x7fafcc06d4e0 msgr2=0x7fafcc06f8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.788+0000 7faff1400640 1 --2- 172.21.15.5:0/3051878861 >> [v2:172.21.15.87:6800/37666,v1:172.21.15.87:6801/37666] conn(0x7fafcc06d4e0 0x7fafcc06f8f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.788+0000 7faff1400640 1 -- 172.21.15.5:0/3051878861 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fafcc0652d0 msgr2=0x7fafcc067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.788+0000 7faff1400640 1 --2- 172.21.15.5:0/3051878861 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fafcc0652d0 0x7fafcc067780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fafdc034000 tx=0x7fafdc032000 comp rx=0 tx=0).stop 2024-08-17T02:23:41.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.788+0000 7faff1400640 1 -- 172.21.15.5:0/3051878861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafec0cda30 msgr2=0x7fafec0cf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:41.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.788+0000 7faff1400640 1 --2- 172.21.15.5:0/3051878861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafec0cda30 0x7fafec0cf160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fafd800c4c0 tx=0x7fafd8007ef0 comp rx=0 tx=0).stop 2024-08-17T02:23:41.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.788+0000 7fafeb200640 1 -- 172.21.15.5:0/3051878861 reap_dead start 2024-08-17T02:23:41.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.790+0000 7faff1400640 1 -- 172.21.15.5:0/3051878861 shutdown_connections 2024-08-17T02:23:41.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.790+0000 7faff1400640 1 -- 172.21.15.5:0/3051878861 >> 172.21.15.5:0/3051878861 conn(0x7fafec06e590 msgr2=0x7fafec0b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:41.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.790+0000 7faff1400640 1 -- 172.21.15.5:0/3051878861 shutdown_connections 2024-08-17T02:23:41.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:41.790+0000 7faff1400640 1 -- 172.21.15.5:0/3051878861 wait complete. 2024-08-17T02:23:41.819 INFO:teuthology.orchestra.run.smithi005.stdout:60129542149 2024-08-17T02:23:41.820 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:23:41.820 INFO:teuthology.orchestra.run.smithi005.stdout:60129542148 2024-08-17T02:23:41.821 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:23:41.821 INFO:teuthology.orchestra.run.smithi005.stdout:60129542149 2024-08-17T02:23:41.822 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:23:41.822 INFO:teuthology.orchestra.run.smithi005.stdout:60129542150 2024-08-17T02:23:41.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:23:41.823 INFO:teuthology.orchestra.run.smithi005.stdout:60129542149 2024-08-17T02:23:41.824 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:23:41.824 INFO:teuthology.orchestra.run.smithi005.stdout:60129542149 2024-08-17T02:23:41.825 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:23:41.825 INFO:teuthology.orchestra.run.smithi005.stdout:60129542149 2024-08-17T02:23:41.826 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:23:42.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.126+0000 7f264de00640 1 Processor -- start 2024-08-17T02:23:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.126+0000 7f264de00640 1 -- start start 2024-08-17T02:23:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.128+0000 7f264de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26400e6c70 0x7f26400e7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.128+0000 7f264de00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2640006d00 con 0x7f2640033f70 2024-08-17T02:23:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.128+0000 7f264de00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2640006fb0 con 0x7f2640006880 2024-08-17T02:23:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.128+0000 7f264de00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2640007850 con 0x7f26400e6c70 2024-08-17T02:23:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.129+0000 7f2647e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2640006880 0x7f2640033860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:45068/0 (socket says 172.21.15.5:45068) 2024-08-17T02:23:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.130+0000 7f2647e00640 1 -- 172.21.15.5:0/2840224391 learned_addr learned my addr 172.21.15.5:0/2840224391 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.130+0000 7f264ca00640 1 --2- 172.21.15.5:0/2840224391 >> v2:172.21.15.5:3300/0 conn(0x7f26400e6c70 0x7f26400e7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.131+0000 7f264ca00640 1 -- 172.21.15.5:0/2840224391 >> v1:172.21.15.87:6789/0 conn(0x7f2640006880 legacy=0x7f2640033860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.131+0000 7f264ca00640 1 -- 172.21.15.5:0/2840224391 >> v1:172.21.15.5:6789/0 conn(0x7f2640033f70 legacy=0x7f2640053540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.131+0000 7f264ca00640 1 -- 172.21.15.5:0/2840224391 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2640007290 con 0x7f26400e6c70 2024-08-17T02:23:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.131+0000 7f2582a00640 1 Processor -- start 2024-08-17T02:23:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.132+0000 7f2582a00640 1 -- start start 2024-08-17T02:23:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.133+0000 7f264ca00640 1 --2- 172.21.15.5:0/2840224391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26400e6c70 0x7f26400e7040 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2634009880 tx=0x7f26340090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883cfb4796389075 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.133+0000 7f2647400640 1 -- 172.21.15.5:0/2840224391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263402ad50 con 0x7f26400e6c70 2024-08-17T02:23:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.133+0000 7f2647400640 1 -- 172.21.15.5:0/2840224391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2634032440 con 0x7f26400e6c70 2024-08-17T02:23:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.133+0000 7f2647400640 1 -- 172.21.15.5:0/2840224391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26340327e0 con 0x7f26400e6c70 2024-08-17T02:23:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.134+0000 7f2582a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f257c06eca0 0x7f257c1638c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.135+0000 7f2582a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f257c0cbc50 con 0x7f257c158a00 2024-08-17T02:23:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.135+0000 7f2582a00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f257c0cbf30 con 0x7f257c158dd0 2024-08-17T02:23:42.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.134+0000 7fc31f200640 1 Processor -- start 2024-08-17T02:23:42.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.134+0000 7fc31f200640 1 -- start start 2024-08-17T02:23:42.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.135+0000 7f2582a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257c159230 con 0x7f257c06eca0 2024-08-17T02:23:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.135+0000 7f2582000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f257c06eca0 0x7f257c1638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.135+0000 7f2582000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f257c06eca0 0x7f257c1638c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43942/0 (socket says 172.21.15.5:43942) 2024-08-17T02:23:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.136+0000 7f2581600640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f257c158a00 0x7f257c0cb190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49284/0 (socket says 172.21.15.5:49284) 2024-08-17T02:23:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.136+0000 7f2581600640 1 -- 172.21.15.5:0/1586724470 learned_addr learned my addr 172.21.15.5:0/1586724470 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.136+0000 7f264de00640 1 -- 172.21.15.5:0/2840224391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26400e6c70 msgr2=0x7f26400e7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.136+0000 7fc31f200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc3180ae7d0 0x7fc3180aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.136+0000 7fc31f200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3180b0540 0x7fc3181530a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.136+0000 7f264de00640 1 --2- 172.21.15.5:0/2840224391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26400e6c70 0x7f26400e7040 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2634009880 tx=0x7f26340090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.136+0000 7f2582000640 1 -- 172.21.15.5:0/1586724470 >> v1:172.21.15.87:6789/0 conn(0x7f257c158dd0 legacy=0x7f257c06e590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:23:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.137+0000 7f2582000640 1 -- 172.21.15.5:0/1586724470 >> v1:172.21.15.5:6789/0 conn(0x7f257c158a00 legacy=0x7f257c0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.137+0000 7fc31f200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc318153a60 con 0x7fc3181535e0 2024-08-17T02:23:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.137+0000 7f2582000640 1 -- 172.21.15.5:0/1586724470 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c0cc210 con 0x7f257c06eca0 2024-08-17T02:23:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.137+0000 7fc31f200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3180b09b0 con 0x7fc3180ae7d0 2024-08-17T02:23:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.137+0000 7fc31f200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc318156fa0 con 0x7fc3180b0540 2024-08-17T02:23:42.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.137+0000 7fc317400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3180b0540 0x7fc3181530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.137+0000 7fc31d200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc3181535e0 0x7fc318155f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49290/0 (socket says 172.21.15.5:49290) 2024-08-17T02:23:42.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.137+0000 7fc31d200640 1 -- 172.21.15.5:0/811522717 learned_addr learned my addr 172.21.15.5:0/811522717 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:42.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.138+0000 7fc317e00640 1 --2- 172.21.15.5:0/811522717 >> v2:172.21.15.87:3300/0 conn(0x7fc3180ae7d0 0x7fc3180aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.138+0000 7f264de00640 1 -- 172.21.15.5:0/2840224391 shutdown_connections 2024-08-17T02:23:42.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.138+0000 7f264de00640 1 --2- 172.21.15.5:0/2840224391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26400e6c70 0x7f26400e7040 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.138+0000 7fc317e00640 1 -- 172.21.15.5:0/811522717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3180b0540 msgr2=0x7fc3181530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.138+0000 7f264de00640 1 -- 172.21.15.5:0/2840224391 >> 172.21.15.5:0/2840224391 conn(0x7f2640054b90 msgr2=0x7f2640054f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.138+0000 7f2582000640 1 --2- 172.21.15.5:0/1586724470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c06eca0 0x7f257c1638c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2574009e60 tx=0x7f2574009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328e15e8d2494782 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.139+0000 7f257be00640 1 -- 172.21.15.5:0/1586724470 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574007550 con 0x7f257c06eca0 2024-08-17T02:23:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.139+0000 7f264de00640 1 -- 172.21.15.5:0/2840224391 shutdown_connections 2024-08-17T02:23:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.139+0000 7f257be00640 1 -- 172.21.15.5:0/1586724470 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257402d050 con 0x7f257c06eca0 2024-08-17T02:23:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.139+0000 7f257be00640 1 -- 172.21.15.5:0/1586724470 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25740078e0 con 0x7f257c06eca0 2024-08-17T02:23:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.139+0000 7f264de00640 1 -- 172.21.15.5:0/2840224391 wait complete. 2024-08-17T02:23:42.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.138+0000 7fc317e00640 1 --2- 172.21.15.5:0/811522717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3180b0540 0x7fc3181530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.138+0000 7fc317e00640 1 -- 172.21.15.5:0/811522717 >> v1:172.21.15.5:6789/0 conn(0x7fc3181535e0 legacy=0x7fc318155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.138+0000 7fc317e00640 1 -- 172.21.15.5:0/811522717 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3180b00b0 con 0x7fc3180ae7d0 2024-08-17T02:23:42.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.138+0000 7fc317400640 1 --2- 172.21.15.5:0/811522717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3180b0540 0x7fc3181530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:42.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.140+0000 7fc317e00640 1 --2- 172.21.15.5:0/811522717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3180ae7d0 0x7fc3180aeba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc31000baf0 tx=0x7fc31000b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=928869ae29884da server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.140+0000 7f2582a00640 1 -- 172.21.15.5:0/1586724470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c06eca0 msgr2=0x7f257c1638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.140+0000 7f2582a00640 1 --2- 172.21.15.5:0/1586724470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c06eca0 0x7f257c1638c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2574009e60 tx=0x7f2574009780 comp rx=0 tx=0).stop 2024-08-17T02:23:42.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.138+0000 7f5341e00640 1 Processor -- start 2024-08-17T02:23:42.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.141+0000 7f2582a00640 1 -- 172.21.15.5:0/1586724470 shutdown_connections 2024-08-17T02:23:42.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.141+0000 7f2582a00640 1 --2- 172.21.15.5:0/1586724470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c06eca0 0x7f257c1638c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.141+0000 7f2582a00640 1 -- 172.21.15.5:0/1586724470 >> 172.21.15.5:0/1586724470 conn(0x7f257c0cfb80 msgr2=0x7f257c0cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.139+0000 7f5341e00640 1 -- start start 2024-08-17T02:23:42.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.141+0000 7f5341e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53340cfb40 0x7f53340535e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.141+0000 7f5341e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5334007a80 con 0x7f5334006890 2024-08-17T02:23:42.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.141+0000 7f5341e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5334006e70 con 0x7f5334053b20 2024-08-17T02:23:42.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.141+0000 7f5341e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5334007150 con 0x7f53340cfb40 2024-08-17T02:23:42.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.141+0000 7f533b400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5334006890 0x7f5334056db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49304/0 (socket says 172.21.15.5:49304) 2024-08-17T02:23:42.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.141+0000 7f533b400640 1 -- 172.21.15.5:0/1850484274 learned_addr learned my addr 172.21.15.5:0/1850484274 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:42.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.141+0000 7f533aa00640 1 --2- 172.21.15.5:0/1850484274 >> v2:172.21.15.5:3300/0 conn(0x7f53340cfb40 0x7f53340535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.141+0000 7f264de00640 1 Processor -- start 2024-08-17T02:23:42.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.142+0000 7f533aa00640 1 -- 172.21.15.5:0/1850484274 >> v1:172.21.15.87:6789/0 conn(0x7f5334053b20 legacy=0x7f5334006180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:42.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.142+0000 7f5339600640 1 -- 172.21.15.5:0/1850484274 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661236240 0 0) 0x7f5334007a80 con 0x7f5334006890 2024-08-17T02:23:42.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.142+0000 7f264de00640 1 -- start start 2024-08-17T02:23:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.142+0000 7fc316a00640 1 -- 172.21.15.5:0/811522717 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310031510 con 0x7fc3180ae7d0 2024-08-17T02:23:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.142+0000 7fc316a00640 1 -- 172.21.15.5:0/811522717 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31002f050 con 0x7fc3180ae7d0 2024-08-17T02:23:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.142+0000 7fc316a00640 1 -- 172.21.15.5:0/811522717 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3100318a0 con 0x7fc3180ae7d0 2024-08-17T02:23:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.143+0000 7f2582a00640 1 -- 172.21.15.5:0/1586724470 shutdown_connections 2024-08-17T02:23:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.143+0000 7f2582a00640 1 -- 172.21.15.5:0/1586724470 wait complete. 2024-08-17T02:23:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.143+0000 7fc31f200640 1 -- 172.21.15.5:0/811522717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3180ae7d0 msgr2=0x7fc3180aeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.143+0000 7fc31f200640 1 --2- 172.21.15.5:0/811522717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3180ae7d0 0x7fc3180aeba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc31000baf0 tx=0x7fc31000b3b0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.143+0000 7f264de00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2640006880 0x7f26400f7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.142+0000 7f533aa00640 1 -- 172.21.15.5:0/1850484274 >> v1:172.21.15.5:6789/0 conn(0x7f5334006890 legacy=0x7f5334056db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.142+0000 7f533aa00640 1 -- 172.21.15.5:0/1850484274 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5334007430 con 0x7f53340cfb40 2024-08-17T02:23:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.143+0000 7f264de00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2640033f70 0x7f264002be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.144+0000 7f264de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26400e6c70 0x7f264002cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.144+0000 7f264de00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264002c880 con 0x7f26400e6c70 2024-08-17T02:23:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.144+0000 7f264de00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264004c6a0 con 0x7f2640006880 2024-08-17T02:23:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.144+0000 7f264de00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26400f8260 con 0x7f2640033f70 2024-08-17T02:23:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.144+0000 7f264ca00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2640006880 0x7f26400f7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.144+0000 7f264ca00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2640006880 0x7f26400f7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:56512/0 (socket says 172.21.15.5:56512) 2024-08-17T02:23:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.144+0000 7f533aa00640 1 --2- 172.21.15.5:0/1850484274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53340cfb40 0x7f53340535e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5324009840 tx=0x7f53240090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde5d97622bba1cc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.144+0000 7f264ca00640 1 -- 172.21.15.5:0/1050704746 learned_addr learned my addr 172.21.15.5:0/1050704746 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.145+0000 7f2647e00640 1 --2- 172.21.15.5:0/1050704746 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2640033f70 0x7f264002be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.145+0000 7f5339600640 1 -- 172.21.15.5:0/1850484274 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532402adb0 con 0x7f53340cfb40 2024-08-17T02:23:42.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.144+0000 7fc31f200640 1 -- 172.21.15.5:0/811522717 shutdown_connections 2024-08-17T02:23:42.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.144+0000 7fc31f200640 1 --2- 172.21.15.5:0/811522717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3180b0540 0x7fc3181530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.144+0000 7fc31f200640 1 --2- 172.21.15.5:0/811522717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3180ae7d0 0x7fc3180aeba0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc31000baf0 tx=0x7fc31000b3b0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.144+0000 7fc31f200640 1 -- 172.21.15.5:0/811522717 >> 172.21.15.5:0/811522717 conn(0x7fc318067f70 msgr2=0x7fc318068370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.144+0000 7fc31f200640 1 -- 172.21.15.5:0/811522717 shutdown_connections 2024-08-17T02:23:42.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.144+0000 7fc31f200640 1 -- 172.21.15.5:0/811522717 wait complete. 2024-08-17T02:23:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.145+0000 7f5339600640 1 -- 172.21.15.5:0/1850484274 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5324032440 con 0x7f53340cfb40 2024-08-17T02:23:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.145+0000 7f264ca00640 1 -- 172.21.15.5:0/1050704746 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2640033f70 msgr2=0x7f264002be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.145+0000 7f264ca00640 1 --2- 172.21.15.5:0/1050704746 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2640033f70 0x7f264002be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.145+0000 7f264ca00640 1 -- 172.21.15.5:0/1050704746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26400e6c70 msgr2=0x7f264002cb40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:23:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.146+0000 7f264d400640 1 --2- 172.21.15.5:0/1050704746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26400e6c70 0x7f264002cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.146+0000 7f264ca00640 1 --2- 172.21.15.5:0/1050704746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26400e6c70 0x7f264002cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.146+0000 7f264ca00640 1 -- 172.21.15.5:0/1050704746 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2634009390 con 0x7f2640006880 2024-08-17T02:23:42.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.145+0000 7f2582a00640 1 Processor -- start 2024-08-17T02:23:42.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.145+0000 7f5339600640 1 -- 172.21.15.5:0/1850484274 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532402adb0 con 0x7f53340cfb40 2024-08-17T02:23:42.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.146+0000 7f2582a00640 1 -- start start 2024-08-17T02:23:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.146+0000 7f5341e00640 1 -- 172.21.15.5:0/1850484274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53340cfb40 msgr2=0x7f53340535e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.146+0000 7f5341e00640 1 --2- 172.21.15.5:0/1850484274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53340cfb40 0x7f53340535e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5324009840 tx=0x7f53240090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.147+0000 7f5341e00640 1 -- 172.21.15.5:0/1850484274 shutdown_connections 2024-08-17T02:23:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.147+0000 7f5341e00640 1 --2- 172.21.15.5:0/1850484274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53340cfb40 0x7f53340535e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.147+0000 7f5341e00640 1 -- 172.21.15.5:0/1850484274 >> 172.21.15.5:0/1850484274 conn(0x7f5334055a10 msgr2=0x7f5334055e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.147+0000 7f264ca00640 1 --2- 172.21.15.5:0/1050704746 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2640006880 0x7f26400f7d20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f26340098e0 tx=0x7f2634032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.147+0000 7fc31f200640 1 Processor -- start 2024-08-17T02:23:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.147+0000 7f5341e00640 1 -- 172.21.15.5:0/1850484274 shutdown_connections 2024-08-17T02:23:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.147+0000 7f2582a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c06eca0 0x7f257c155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.147+0000 7f263be00640 1 -- 172.21.15.5:0/1050704746 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2634031a60 con 0x7f2640006880 2024-08-17T02:23:42.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.147+0000 7f263be00640 1 -- 172.21.15.5:0/1050704746 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2634031bc0 con 0x7f2640006880 2024-08-17T02:23:42.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.147+0000 7f263be00640 1 -- 172.21.15.5:0/1050704746 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263403c410 con 0x7f2640006880 2024-08-17T02:23:42.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.147+0000 7f5341e00640 1 -- 172.21.15.5:0/1850484274 wait complete. 2024-08-17T02:23:42.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.147+0000 7f2582a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f257c158a00 0x7f257c0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.148+0000 7f2582a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f257c158dd0 0x7f257c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.148+0000 7fc31f200640 1 -- start start 2024-08-17T02:23:42.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.148+0000 7f2582a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c0b06e0 con 0x7f257c06eca0 2024-08-17T02:23:42.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.148+0000 7f2582a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c16d0b0 con 0x7f257c158dd0 2024-08-17T02:23:42.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.148+0000 7f2582a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c15a930 con 0x7f257c158a00 2024-08-17T02:23:42.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.148+0000 7f2581600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c06eca0 0x7f257c155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.148+0000 7f77a4e00640 1 Processor -- start 2024-08-17T02:23:42.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.149+0000 7f77a4e00640 1 -- start start 2024-08-17T02:23:42.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.148+0000 7f2581600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c06eca0 0x7f257c155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43964/0 (socket says 172.21.15.5:43964) 2024-08-17T02:23:42.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.148+0000 7f2581600640 1 -- 172.21.15.5:0/4032722370 learned_addr learned my addr 172.21.15.5:0/4032722370 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:42.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.149+0000 7f2580c00640 1 --2- 172.21.15.5:0/4032722370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f257c158a00 0x7f257c0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.150+0000 7f2582000640 1 --2- 172.21.15.5:0/4032722370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f257c158dd0 0x7f257c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.148+0000 7f264de00640 1 -- 172.21.15.5:0/1050704746 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264004bd70 con 0x7f2640006880 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.148+0000 7f264de00640 1 -- 172.21.15.5:0/1050704746 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264004c330 con 0x7f2640006880 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.149+0000 7f264de00640 1 -- 172.21.15.5:0/1050704746 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2640005250 con 0x7f2640006880 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.150+0000 7f2580c00640 1 -- 172.21.15.5:0/4032722370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f257c158dd0 msgr2=0x7f257c0c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.150+0000 7f2580c00640 1 --2- 172.21.15.5:0/4032722370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f257c158dd0 0x7f257c0c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.150+0000 7f2580c00640 1 -- 172.21.15.5:0/4032722370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c06eca0 msgr2=0x7f257c155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.150+0000 7fc31f200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3180b0540 0x7fc31813d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.150+0000 7fc31f200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3181535e0 0x7fc3180c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.150+0000 7fc31f200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3180c8850 0x7fc3180c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.151+0000 7fc31f200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3180c9210 con 0x7fc3181535e0 2024-08-17T02:23:42.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.151+0000 7fc31f200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3181572b0 con 0x7fc3180c8850 2024-08-17T02:23:42.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.151+0000 7fc31f200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3180c3b50 con 0x7fc3180b0540 2024-08-17T02:23:42.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.151+0000 7f2580c00640 1 --2- 172.21.15.5:0/4032722370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c06eca0 0x7f257c155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.151+0000 7f77a4e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77a00b03c0 0x7f77a00b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.151+0000 7f77a4e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f77a006d7d0 0x7f77a006dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.151+0000 7f77a4e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a00aff30 con 0x7f77a015cdc0 2024-08-17T02:23:42.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.151+0000 7f77a4e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a006e150 con 0x7f77a00b03c0 2024-08-17T02:23:42.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.151+0000 7f77a4e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a00af320 con 0x7f77a006d7d0 2024-08-17T02:23:42.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.151+0000 7f5341e00640 1 Processor -- start 2024-08-17T02:23:42.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.151+0000 7fc317e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3180b0540 0x7fc31813d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.151+0000 7fc31d200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3180c8850 0x7fc3180c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.151+0000 7fc317e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3180b0540 0x7fc31813d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:33902/0 (socket says 172.21.15.5:33902) 2024-08-17T02:23:42.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.151+0000 7fc317e00640 1 -- 172.21.15.5:0/482119928 learned_addr learned my addr 172.21.15.5:0/482119928 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:42.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.151+0000 7f5341e00640 1 -- start start 2024-08-17T02:23:42.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.151+0000 7f2580c00640 1 -- 172.21.15.5:0/4032722370 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2574009a20 con 0x7f257c158a00 2024-08-17T02:23:42.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.152+0000 7f779e800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f77a006d7d0 0x7f77a006dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.152+0000 7f7795400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77a00b03c0 0x7f77a00b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.152+0000 7f779e800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f77a006d7d0 0x7f77a006dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:56542/0 (socket says 172.21.15.5:56542) 2024-08-17T02:23:42.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.152+0000 7f779e800640 1 -- 172.21.15.5:0/3145634931 learned_addr learned my addr 172.21.15.5:0/3145634931 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:42.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.152+0000 7f6f89200640 1 Processor -- start 2024-08-17T02:23:42.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.152+0000 7f2581600640 1 --2- 172.21.15.5:0/4032722370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c06eca0 0x7f257c155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:42.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.153+0000 7f6f89200640 1 -- start start 2024-08-17T02:23:42.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.153+0000 7f2580c00640 1 --2- 172.21.15.5:0/4032722370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f257c158a00 0x7f257c0c6b90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2570009fd0 tx=0x7f2570009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.152+0000 7fc317400640 1 --2- 172.21.15.5:0/482119928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3181535e0 0x7fc3180c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.153+0000 7fc31d200640 1 -- 172.21.15.5:0/482119928 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3180b0540 msgr2=0x7fc31813d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.153+0000 7fc31d200640 1 --2- 172.21.15.5:0/482119928 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3180b0540 0x7fc31813d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.153+0000 7fc31d200640 1 -- 172.21.15.5:0/482119928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3181535e0 msgr2=0x7fc3180c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.153+0000 7fc31d200640 1 --2- 172.21.15.5:0/482119928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3181535e0 0x7fc3180c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.153+0000 7fc31d200640 1 -- 172.21.15.5:0/482119928 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31000b630 con 0x7fc3180c8850 2024-08-17T02:23:42.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.152+0000 7f263be00640 1 -- 172.21.15.5:0/1050704746 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2634039050 con 0x7f2640006880 2024-08-17T02:23:42.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.153+0000 7f2578c00640 1 -- 172.21.15.5:0/4032722370 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257000f510 con 0x7f257c158a00 2024-08-17T02:23:42.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.153+0000 7f263be00640 1 --2- 172.21.15.5:0/1050704746 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2628065220 0x7f26280676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.153+0000 7f263be00640 1 -- 172.21.15.5:0/1050704746 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f26340a2280 con 0x7f2640006880 2024-08-17T02:23:42.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.153+0000 7f2578c00640 1 -- 172.21.15.5:0/4032722370 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257000f690 con 0x7f257c158a00 2024-08-17T02:23:42.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.154+0000 7f2578c00640 1 -- 172.21.15.5:0/4032722370 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257000fa50 con 0x7f257c158a00 2024-08-17T02:23:42.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.154+0000 7fc31d200640 1 --2- 172.21.15.5:0/482119928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3180c8850 0x7fc3180c8cd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc30000c590 tx=0x7fc300007dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.152+0000 7f779e800640 1 -- 172.21.15.5:0/3145634931 >> v2:172.21.15.5:3300/0 conn(0x7f77a00b03c0 msgr2=0x7f77a00b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:42.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.152+0000 7f779e800640 1 --2- 172.21.15.5:0/3145634931 >> v2:172.21.15.5:3300/0 conn(0x7f77a00b03c0 0x7f77a00b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.152+0000 7f779e800640 1 -- 172.21.15.5:0/3145634931 >> v1:172.21.15.87:6789/0 conn(0x7f77a015cdc0 legacy=0x7f77a00ae860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:23:42.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.152+0000 7f779e800640 1 -- 172.21.15.5:0/3145634931 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a00af600 con 0x7f77a006d7d0 2024-08-17T02:23:42.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.155+0000 7f66d7600640 1 Processor -- start 2024-08-17T02:23:42.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.155+0000 7f2582a00640 1 -- 172.21.15.5:0/4032722370 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257c156140 con 0x7f257c158a00 2024-08-17T02:23:42.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.155+0000 7f2582a00640 1 -- 172.21.15.5:0/4032722370 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257c15a2e0 con 0x7f257c158a00 2024-08-17T02:23:42.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.155+0000 7f6f89200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f8415cdc0 0x7f6f840ae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.155+0000 7f6f89200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6f840aeda0 0x7f6f840b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.155+0000 7f2647e00640 1 --2- 172.21.15.5:0/1050704746 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2628065220 0x7f26280676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.155+0000 7f6f89200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f840aff30 con 0x7f6f840b0900 2024-08-17T02:23:42.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.155+0000 7f6f89200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f840af320 con 0x7f6f840aeda0 2024-08-17T02:23:42.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.155+0000 7f6f89200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840af600 con 0x7f6f8415cdc0 2024-08-17T02:23:42.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.155+0000 7f66d7600640 1 -- start start 2024-08-17T02:23:42.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.155+0000 7f5341e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5334006890 0x7f53340e5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.155+0000 7f5341e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5334053b20 0x7f53340e8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.155+0000 7f6f82800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6f840b0900 0x7f6f8406d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49316/0 (socket says 172.21.15.5:49316) 2024-08-17T02:23:42.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.155+0000 7f6f82800640 1 -- 172.21.15.5:0/3558219675 learned_addr learned my addr 172.21.15.5:0/3558219675 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:42.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.155+0000 7f6f81e00640 1 --2- 172.21.15.5:0/3558219675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f8415cdc0 0x7f6f840ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f533a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5334053b20 0x7f53340e8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f7c7c600640 1 Processor -- start 2024-08-17T02:23:42.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f533aa00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5334006890 0x7f53340e5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f533aa00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5334006890 0x7f53340e5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:33928/0 (socket says 172.21.15.5:33928) 2024-08-17T02:23:42.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f6f80a00640 1 -- 172.21.15.5:0/3558219675 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790124615 0 0) 0x7f6f840aff30 con 0x7f6f840b0900 2024-08-17T02:23:42.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f6f80a00640 1 -- 172.21.15.5:0/3558219675 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f680034e0 con 0x7f6f840b0900 2024-08-17T02:23:42.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f533a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5334053b20 0x7f53340e8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43994/0 (socket says 172.21.15.5:43994) 2024-08-17T02:23:42.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f5341e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53340cfb40 0x7f53340e8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f5341e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5334101000 con 0x7f5334053b20 2024-08-17T02:23:42.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f779e800640 1 --2- 172.21.15.5:0/3145634931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77a006d7d0 0x7f77a006dc10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f77a00afea0 tx=0x7f7798009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9d402edf4cc12b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f2582a00640 1 -- 172.21.15.5:0/4032722370 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257c070720 con 0x7f257c158a00 2024-08-17T02:23:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f5341e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53340c51e0 con 0x7f53340cfb40 2024-08-17T02:23:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f5341e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53341006d0 con 0x7f5334006890 2024-08-17T02:23:42.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f6f80a00640 1 -- 172.21.15.5:0/3558219675 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3517404282 0 0) 0x7f6f680034e0 con 0x7f6f840b0900 2024-08-17T02:23:42.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f6f80a00640 1 -- 172.21.15.5:0/3558219675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f8415cdc0 msgr2=0x7f6f840ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:42.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f6f80a00640 1 --2- 172.21.15.5:0/3558219675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f8415cdc0 0x7f6f840ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f6f80a00640 1 -- 172.21.15.5:0/3558219675 >> v2:172.21.15.87:3300/0 conn(0x7f6f840aeda0 msgr2=0x7f6f840b03c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:23:42.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f6f80a00640 1 --2- 172.21.15.5:0/3558219675 >> v2:172.21.15.87:3300/0 conn(0x7f6f840aeda0 0x7f6f840b03c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.157+0000 7f6f80a00640 1 -- 172.21.15.5:0/3558219675 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f840af8e0 con 0x7f6f840b0900 2024-08-17T02:23:42.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.157+0000 7f6f80a00640 1 -- 172.21.15.5:0/3558219675 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2658686246 0 0) 0x7f6f74001470 con 0x7f6f840b0900 2024-08-17T02:23:42.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.157+0000 7f6f80a00640 1 -- 172.21.15.5:0/3558219675 >> v1:172.21.15.5:6789/0 conn(0x7f6f840b0900 legacy=0x7f6f8406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.157+0000 7f6f80a00640 1 --2- 172.21.15.5:0/3558219675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f68003a50 0x7f6f68003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.157+0000 7f6f80a00640 1 --2- 172.21.15.5:0/3558219675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f68004780 0x7f6f68004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.157+0000 7f6f80a00640 1 --2- 172.21.15.5:0/3558219675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f68005130 0x7f6f6800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.157+0000 7f6f80a00640 1 -- 172.21.15.5:0/3558219675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840af320 con 0x7f6f68003a50 2024-08-17T02:23:42.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.157+0000 7f6f80a00640 1 -- 172.21.15.5:0/3558219675 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840af600 con 0x7f6f68005130 2024-08-17T02:23:42.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.157+0000 7f6f80a00640 1 -- 172.21.15.5:0/3558219675 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6800c120 con 0x7f6f68004780 2024-08-17T02:23:42.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f533b400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53340cfb40 0x7f53340e8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.157+0000 7f6f82800640 1 --2- 172.21.15.5:0/3558219675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f68005130 0x7f6f6800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f533b400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53340cfb40 0x7f53340e8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:56546/0 (socket says 172.21.15.5:56546) 2024-08-17T02:23:42.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.157+0000 7f2647e00640 1 --2- 172.21.15.5:0/1050704746 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2628065220 0x7f26280676d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f26400336a0 tx=0x7f263c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.157+0000 7f533b400640 1 -- 172.21.15.5:0/584468281 learned_addr learned my addr 172.21.15.5:0/584468281 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:42.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.157+0000 7f533b400640 1 -- 172.21.15.5:0/584468281 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5334006890 msgr2=0x7f53340e5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.157+0000 7f533b400640 1 --2- 172.21.15.5:0/584468281 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5334006890 0x7f53340e5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.157+0000 7f533b400640 1 -- 172.21.15.5:0/584468281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5334053b20 msgr2=0x7f53340e8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.156+0000 7f7c7c600640 1 -- start start 2024-08-17T02:23:42.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f533b400640 1 --2- 172.21.15.5:0/584468281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5334053b20 0x7f53340e8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f533b400640 1 -- 172.21.15.5:0/584468281 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5324009330 con 0x7f53340cfb40 2024-08-17T02:23:42.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f533a000640 1 --2- 172.21.15.5:0/584468281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5334053b20 0x7f53340e8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:42.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.157+0000 7f66d7600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66d0146890 0x7f66d00cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.157+0000 7f66d7600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f66d00d0150 0x7f66d00cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f66d7600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d00d05b0 con 0x7f66d00ce1f0 2024-08-17T02:23:42.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f66d7600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d00b2ad0 con 0x7f66d0146890 2024-08-17T02:23:42.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f66d7600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d00cea00 con 0x7f66d00d0150 2024-08-17T02:23:42.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f6f81400640 1 --2- 172.21.15.5:0/3558219675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f68004780 0x7f6f68004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f6f82800640 1 -- 172.21.15.5:0/3558219675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f68004780 msgr2=0x7f6f68004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:42.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f6f82800640 1 --2- 172.21.15.5:0/3558219675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f68004780 0x7f6f68004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f6f82800640 1 -- 172.21.15.5:0/3558219675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f68003a50 msgr2=0x7f6f68003e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:23:42.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f6f82800640 1 --2- 172.21.15.5:0/3558219675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f68003a50 0x7f6f68003e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f6f82800640 1 -- 172.21.15.5:0/3558219675 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f840af8e0 con 0x7f6f68005130 2024-08-17T02:23:42.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f66cfe00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f66d00d0150 0x7f66d00cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f66d4c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66d0146890 0x7f66d00cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f533b400640 1 --2- 172.21.15.5:0/584468281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53340cfb40 0x7f53340e8f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f533c066b80 tx=0x7f533c064990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f66d4c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66d0146890 0x7f66d00cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43998/0 (socket says 172.21.15.5:43998) 2024-08-17T02:23:42.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f66d4c00640 1 -- 172.21.15.5:0/1403253851 learned_addr learned my addr 172.21.15.5:0/1403253851 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:42.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f66cfe00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f66d00d0150 0x7f66d00cdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:56582/0 (socket says 172.21.15.5:56582) 2024-08-17T02:23:42.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f7c7c600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7c7415cfc0 0x7f7c740b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.158+0000 7f2578c00640 1 -- 172.21.15.5:0/4032722370 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f257001a400 con 0x7f257c158a00 2024-08-17T02:23:42.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.160+0000 7f263be00640 1 -- 172.21.15.5:0/1050704746 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f26340a7060 con 0x7f2640006880 2024-08-17T02:23:42.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.159+0000 7fc30f400640 1 -- 172.21.15.5:0/482119928 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc300005b70 con 0x7fc3180c8850 2024-08-17T02:23:42.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.159+0000 7fc31f200640 1 -- 172.21.15.5:0/482119928 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31813de20 con 0x7fc3180c8850 2024-08-17T02:23:42.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.159+0000 7fc30f400640 1 -- 172.21.15.5:0/482119928 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc300005cd0 con 0x7fc3180c8850 2024-08-17T02:23:42.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.159+0000 7fc30f400640 1 -- 172.21.15.5:0/482119928 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc300007320 con 0x7fc3180c8850 2024-08-17T02:23:42.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.159+0000 7fc31f200640 1 -- 172.21.15.5:0/482119928 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3180c3220 con 0x7fc3180c8850 2024-08-17T02:23:42.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.159+0000 7f5332000640 1 -- 172.21.15.5:0/584468281 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c06f1c0 con 0x7f53340cfb40 2024-08-17T02:23:42.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.160+0000 7f5332000640 1 -- 172.21.15.5:0/584468281 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c06f340 con 0x7f53340cfb40 2024-08-17T02:23:42.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.160+0000 7f5332000640 1 -- 172.21.15.5:0/584468281 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c08e570 con 0x7f53340cfb40 2024-08-17T02:23:42.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.159+0000 7f6f82800640 1 --2- 172.21.15.5:0/3558219675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f68005130 0x7f6f6800b9d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400c410 tx=0x7f6f740078b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b88cabb8548bd753 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.159+0000 7f779d400640 1 -- 172.21.15.5:0/3145634931 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7798031400 con 0x7f77a006d7d0 2024-08-17T02:23:42.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.160+0000 7f779d400640 1 -- 172.21.15.5:0/3145634931 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779802d050 con 0x7f77a006d7d0 2024-08-17T02:23:42.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.160+0000 7f779d400640 1 -- 172.21.15.5:0/3145634931 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980317d0 con 0x7f77a006d7d0 2024-08-17T02:23:42.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.159+0000 7f66d4c00640 1 -- 172.21.15.5:0/1403253851 >> v2:172.21.15.87:3300/0 conn(0x7f66d00d0150 msgr2=0x7f66d00cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:42.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.159+0000 7f66d4c00640 1 --2- 172.21.15.5:0/1403253851 >> v2:172.21.15.87:3300/0 conn(0x7f66d00d0150 0x7f66d00cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.159+0000 7f7c79c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7c7415cfc0 0x7f7c740b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.159+0000 7f7c79c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7c7415cfc0 0x7f7c740b8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:56594/0 (socket says 172.21.15.5:56594) 2024-08-17T02:23:42.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.159+0000 7f7c79c00640 1 -- 172.21.15.5:0/2370350971 learned_addr learned my addr 172.21.15.5:0/2370350971 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:42.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.159+0000 7f7c7c600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c740b7c80 con 0x7f7c740b76f0 2024-08-17T02:23:42.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.159+0000 7f7c7c600640 1 -- 172.21.15.5:0/2370350971 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c740b7f60 con 0x7f7c740b4600 2024-08-17T02:23:42.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.159+0000 7f7c7c600640 1 -- 172.21.15.5:0/2370350971 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c740d50c0 con 0x7f7c7415cfc0 2024-08-17T02:23:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.160+0000 7f7c73e00640 1 -- 172.21.15.5:0/2370350971 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341890198 0 0) 0x7f7c740b7f60 con 0x7f7c740b4600 2024-08-17T02:23:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.160+0000 7f7c73e00640 1 -- 172.21.15.5:0/2370350971 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c5c0034e0 con 0x7f7c740b4600 2024-08-17T02:23:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.160+0000 7f7c73e00640 1 -- 172.21.15.5:0/2370350971 <== mon.1 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4130440742 0 0) 0x7f7c5c0034e0 con 0x7f7c740b4600 2024-08-17T02:23:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.160+0000 7f7c73e00640 1 -- 172.21.15.5:0/2370350971 >> v2:172.21.15.87:3300/0 conn(0x7f7c7415cfc0 msgr2=0x7f7c740b8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.160+0000 7f7c73e00640 1 --2- 172.21.15.5:0/2370350971 >> v2:172.21.15.87:3300/0 conn(0x7f7c7415cfc0 0x7f7c740b8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.160+0000 7f7c73e00640 1 -- 172.21.15.5:0/2370350971 >> v1:172.21.15.5:6789/0 conn(0x7f7c740b76f0 legacy=0x7f7c7415d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.160+0000 7f7c73e00640 1 -- 172.21.15.5:0/2370350971 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c740b8240 con 0x7f7c740b4600 2024-08-17T02:23:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f77a4e00640 1 -- 172.21.15.5:0/3145634931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77a006d7d0 msgr2=0x7f77a006dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f77a4e00640 1 --2- 172.21.15.5:0/3145634931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77a006d7d0 0x7f77a006dc10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f77a00afea0 tx=0x7f7798009840 comp rx=0 tx=0).stop 2024-08-17T02:23:42.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.160+0000 7f2578c00640 1 --2- 172.21.15.5:0/4032722370 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f25600651d0 0x7f2560067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.160+0000 7f2578c00640 1 -- 172.21.15.5:0/4032722370 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2570081ea0 con 0x7f257c158a00 2024-08-17T02:23:42.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f2581600640 1 --2- 172.21.15.5:0/4032722370 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f25600651d0 0x7f2560067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f6f80a00640 1 -- 172.21.15.5:0/3558219675 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7402d070 con 0x7f6f68005130 2024-08-17T02:23:42.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.160+0000 7f7c73e00640 1 -- 172.21.15.5:0/2370350971 <== mon.1 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2658686246 0 0) 0x7f7c60001470 con 0x7f7c740b4600 2024-08-17T02:23:42.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.160+0000 7f7c79c00640 1 --2- 172.21.15.5:0/2370350971 >> v2:172.21.15.87:3300/0 conn(0x7f7c7415cfc0 0x7f7c740b8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:42.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7fc31f200640 1 -- 172.21.15.5:0/482119928 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3180c3ce0 con 0x7fc3180c8850 2024-08-17T02:23:42.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.160+0000 7f7c73e00640 1 -- 172.21.15.5:0/2370350971 >> v1:172.21.15.87:6789/0 conn(0x7f7c740b4600 legacy=0x7f7c740b6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f7c73e00640 1 --2- 172.21.15.5:0/2370350971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c5c003aa0 0x7f7c5c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f7c73e00640 1 --2- 172.21.15.5:0/2370350971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c5c004780 0x7f7c5c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f7c73e00640 1 --2- 172.21.15.5:0/2370350971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c5c005330 0x7f7c5c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f7c73e00640 1 -- 172.21.15.5:0/2370350971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c740d50c0 con 0x7f7c5c004780 2024-08-17T02:23:42.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f7c73e00640 1 -- 172.21.15.5:0/2370350971 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c00c240 con 0x7f7c5c005330 2024-08-17T02:23:42.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f7c73e00640 1 -- 172.21.15.5:0/2370350971 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c00c400 con 0x7f7c5c003aa0 2024-08-17T02:23:42.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f7c79200640 1 --2- 172.21.15.5:0/2370350971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c5c004780 0x7f7c5c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f5341e00640 1 -- 172.21.15.5:0/584468281 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53341009b0 con 0x7f53340cfb40 2024-08-17T02:23:42.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.159+0000 7f66d4c00640 1 -- 172.21.15.5:0/1403253851 >> v1:172.21.15.87:6789/0 conn(0x7f66d00ce1f0 legacy=0x7f66d00cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:42.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.159+0000 7f66d4c00640 1 -- 172.21.15.5:0/1403253851 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d00cece0 con 0x7f66d0146890 2024-08-17T02:23:42.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f7c7a600640 1 --2- 172.21.15.5:0/2370350971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c5c005330 0x7f7c5c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f7c79c00640 1 --2- 172.21.15.5:0/2370350971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c5c003aa0 0x7f7c5c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f77a4e00640 1 -- 172.21.15.5:0/3145634931 shutdown_connections 2024-08-17T02:23:42.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f77a4e00640 1 --2- 172.21.15.5:0/3145634931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77a006d7d0 0x7f77a006dc10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f77a4e00640 1 --2- 172.21.15.5:0/3145634931 >> v2:172.21.15.5:3300/0 conn(0x7f77a00b03c0 0x7f77a00b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f77a4e00640 1 -- 172.21.15.5:0/3145634931 >> 172.21.15.5:0/3145634931 conn(0x7f77a0066e60 msgr2=0x7f77a0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.161+0000 7f6f80a00640 1 -- 172.21.15.5:0/3558219675 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f74005890 con 0x7f6f68005130 2024-08-17T02:23:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.162+0000 7f2581600640 1 --2- 172.21.15.5:0/4032722370 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f25600651d0 0x7f2560067680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f256c007fd0 tx=0x7f256c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.162+0000 7f6f89200640 1 -- 172.21.15.5:0/3558219675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f68005130 msgr2=0x7f6f6800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.162+0000 7f6f89200640 1 --2- 172.21.15.5:0/3558219675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f68005130 0x7f6f6800b9d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400c410 tx=0x7f6f740078b0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.162+0000 7f6f82800640 1 -- 172.21.15.5:0/3558219675 reap_dead start 2024-08-17T02:23:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.162+0000 7f6f89200640 1 -- 172.21.15.5:0/3558219675 shutdown_connections 2024-08-17T02:23:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.162+0000 7f6f89200640 1 -- 172.21.15.5:0/3558219675 >> 172.21.15.5:0/3558219675 conn(0x7f6f84066e60 msgr2=0x7f6f84067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.162+0000 7f77a4e00640 1 -- 172.21.15.5:0/3145634931 shutdown_connections 2024-08-17T02:23:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.162+0000 7f77a4e00640 1 -- 172.21.15.5:0/3145634931 wait complete. 2024-08-17T02:23:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.162+0000 7f7c79c00640 1 -- 172.21.15.5:0/2370350971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c5c005330 msgr2=0x7f7c5c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.162+0000 7f7c79c00640 1 --2- 172.21.15.5:0/2370350971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c5c005330 0x7f7c5c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.162+0000 7f7c79c00640 1 -- 172.21.15.5:0/2370350971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c5c004780 msgr2=0x7f7c5c004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.162+0000 7f7c79c00640 1 --2- 172.21.15.5:0/2370350971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c5c004780 0x7f7c5c004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.162+0000 7f7c79c00640 1 -- 172.21.15.5:0/2370350971 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c0034e0 con 0x7f7c5c003aa0 2024-08-17T02:23:42.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.162+0000 7f7c7a600640 1 --2- 172.21.15.5:0/2370350971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c5c005330 0x7f7c5c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:42.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.162+0000 7f5341e00640 1 -- 172.21.15.5:0/584468281 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53340e64a0 con 0x7f53340cfb40 2024-08-17T02:23:42.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.162+0000 7f7c79200640 1 --2- 172.21.15.5:0/2370350971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c5c004780 0x7f7c5c004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:42.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.163+0000 7f66d4c00640 1 --2- 172.21.15.5:0/1403253851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d0146890 0x7f66d00cfc10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f66d00af4f0 tx=0x7f66c40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76235b9c3e47f10 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.162+0000 7f7c7a600640 1 -- 172.21.15.5:0/2370350971 reap_dead start 2024-08-17T02:23:42.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.163+0000 7f5341e00640 1 -- 172.21.15.5:0/584468281 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5334101170 con 0x7f53340cfb40 2024-08-17T02:23:42.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.163+0000 7f6f89200640 1 -- 172.21.15.5:0/3558219675 shutdown_connections 2024-08-17T02:23:42.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.163+0000 7f6f89200640 1 -- 172.21.15.5:0/3558219675 wait complete. 2024-08-17T02:23:42.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.163+0000 7f66cf400640 1 -- 172.21.15.5:0/1403253851 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c402add0 con 0x7f66d0146890 2024-08-17T02:23:42.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.164+0000 7f66cf400640 1 -- 172.21.15.5:0/1403253851 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c4032440 con 0x7f66d0146890 2024-08-17T02:23:42.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.164+0000 7f66cf400640 1 -- 172.21.15.5:0/1403253851 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4032820 con 0x7f66d0146890 2024-08-17T02:23:42.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.164+0000 7f7c79c00640 1 --2- 172.21.15.5:0/2370350971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c5c003aa0 0x7f7c5c003e90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7c68009bc0 tx=0x7f7c68008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46ee0869cf1dba59 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.164+0000 7f66d7600640 1 -- 172.21.15.5:0/1403253851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d0146890 msgr2=0x7f66d00cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.164+0000 7f66d7600640 1 --2- 172.21.15.5:0/1403253851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d0146890 0x7f66d00cfc10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f66d00af4f0 tx=0x7f66c40091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.164+0000 7f77a4e00640 1 Processor -- start 2024-08-17T02:23:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.164+0000 7f66d7600640 1 -- 172.21.15.5:0/1403253851 shutdown_connections 2024-08-17T02:23:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.165+0000 7f66d7600640 1 --2- 172.21.15.5:0/1403253851 >> v2:172.21.15.87:3300/0 conn(0x7f66d00d0150 0x7f66d00cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.165+0000 7f66d7600640 1 --2- 172.21.15.5:0/1403253851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d0146890 0x7f66d00cfc10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.165+0000 7f66d7600640 1 -- 172.21.15.5:0/1403253851 >> 172.21.15.5:0/1403253851 conn(0x7f66d006e590 msgr2=0x7f66d006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.165+0000 7fc30f400640 1 -- 172.21.15.5:0/482119928 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc30001b400 con 0x7fc3180c8850 2024-08-17T02:23:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.165+0000 7f77a4e00640 1 -- start start 2024-08-17T02:23:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.165+0000 7f5332000640 1 -- 172.21.15.5:0/584468281 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f533c08e9a0 con 0x7f53340cfb40 2024-08-17T02:23:42.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.165+0000 7f7c73e00640 1 -- 172.21.15.5:0/2370350971 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6802acf0 con 0x7f7c5c003aa0 2024-08-17T02:23:42.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.165+0000 7f2578c00640 1 -- 172.21.15.5:0/4032722370 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f257004ff40 con 0x7f257c158a00 2024-08-17T02:23:42.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.165+0000 7f7c73e00640 1 -- 172.21.15.5:0/2370350971 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6802ae50 con 0x7f7c5c003aa0 2024-08-17T02:23:42.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.165+0000 7f7c73e00640 1 -- 172.21.15.5:0/2370350971 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68032650 con 0x7f7c5c003aa0 2024-08-17T02:23:42.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.166+0000 7fc30f400640 1 --2- 172.21.15.5:0/482119928 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc2f40651d0 0x7fc2f4067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.166+0000 7fc30f400640 1 -- 172.21.15.5:0/482119928 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc300081e20 con 0x7fc3180c8850 2024-08-17T02:23:42.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.166+0000 7f6f89200640 1 Processor -- start 2024-08-17T02:23:42.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.166+0000 7f6f89200640 1 -- start start 2024-08-17T02:23:42.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.166+0000 7f7c7c600640 1 -- 172.21.15.5:0/2370350971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c5c003aa0 msgr2=0x7f7c5c003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.166+0000 7f7c7c600640 1 --2- 172.21.15.5:0/2370350971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c5c003aa0 0x7f7c5c003e90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7c68009bc0 tx=0x7f7c68008040 comp rx=0 tx=0).stop 2024-08-17T02:23:42.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.166+0000 7f66d7600640 1 -- 172.21.15.5:0/1403253851 shutdown_connections 2024-08-17T02:23:42.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.167+0000 7f66d7600640 1 -- 172.21.15.5:0/1403253851 wait complete. 2024-08-17T02:23:42.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.167+0000 7f77a4e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77a006d7d0 0x7f77a00cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.167+0000 7fc317e00640 1 --2- 172.21.15.5:0/482119928 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc2f40651d0 0x7fc2f4067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.167+0000 7f7c7c600640 1 -- 172.21.15.5:0/2370350971 shutdown_connections 2024-08-17T02:23:42.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.167+0000 7f7c7c600640 1 --2- 172.21.15.5:0/2370350971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c5c003aa0 0x7f7c5c003e90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.167+0000 7f7c7c600640 1 -- 172.21.15.5:0/2370350971 >> 172.21.15.5:0/2370350971 conn(0x7f7c740d4100 msgr2=0x7f7c740d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.166+0000 7f5332000640 1 --2- 172.21.15.5:0/584468281 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f53180652a0 0x7f5318067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.167+0000 7f5332000640 1 -- 172.21.15.5:0/584468281 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f533c0f9000 con 0x7f53340cfb40 2024-08-17T02:23:42.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.167+0000 7f533aa00640 1 --2- 172.21.15.5:0/584468281 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f53180652a0 0x7f5318067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.167+0000 7f77a4e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77a00b03c0 0x7f77a00abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.167+0000 7f77a4e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a015cdc0 0x7f77a00a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.167+0000 7f7c7c600640 1 -- 172.21.15.5:0/2370350971 shutdown_connections 2024-08-17T02:23:42.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.168+0000 7f7c7c600640 1 -- 172.21.15.5:0/2370350971 wait complete. 2024-08-17T02:23:42.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.168+0000 7fc317e00640 1 --2- 172.21.15.5:0/482119928 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc2f40651d0 0x7fc2f4067680 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc31000b3f0 tx=0x7fc310039000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.168+0000 7f533aa00640 1 --2- 172.21.15.5:0/584468281 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f53180652a0 0x7f5318067750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5324034000 tx=0x7f5324032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.168+0000 7f6f89200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f68005130 0x7f6f841554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.168+0000 7f6f89200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f840a8560 0x7f6f8415e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.169+0000 7f5332000640 1 -- 172.21.15.5:0/584468281 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f533c0c7090 con 0x7f53340cfb40 2024-08-17T02:23:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.168+0000 7f779de00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77a006d7d0 0x7f77a00cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.168+0000 7f6f89200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f840a89b0 0x7f6f8415e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.169+0000 7f6f89200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840a94e0 con 0x7f6f840a8560 2024-08-17T02:23:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.169+0000 7f6f89200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840a9d50 con 0x7f6f840a89b0 2024-08-17T02:23:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.169+0000 7f779de00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77a006d7d0 0x7f77a00cc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:56626/0 (socket says 172.21.15.5:56626) 2024-08-17T02:23:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.169+0000 7f77a4e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00a68f0 con 0x7f77a015cdc0 2024-08-17T02:23:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.169+0000 7f77a4e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00a44d0 con 0x7f77a006d7d0 2024-08-17T02:23:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.169+0000 7f77a4e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00a47b0 con 0x7f77a00b03c0 2024-08-17T02:23:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.169+0000 7f779de00640 1 -- 172.21.15.5:0/787522809 learned_addr learned my addr 172.21.15.5:0/787522809 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.169+0000 7f66d7600640 1 Processor -- start 2024-08-17T02:23:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.169+0000 7f66d7600640 1 -- start start 2024-08-17T02:23:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.170+0000 7f7c7c600640 1 Processor -- start 2024-08-17T02:23:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.170+0000 7f7795400640 1 --2- 172.21.15.5:0/787522809 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77a00b03c0 0x7f77a00abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.169+0000 7f6f82800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f840a89b0 0x7f6f8415e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.170+0000 7f6f82800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f840a89b0 0x7f6f8415e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:56630/0 (socket says 172.21.15.5:56630) 2024-08-17T02:23:42.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.170+0000 7f6f82800640 1 -- 172.21.15.5:0/1936638451 learned_addr learned my addr 172.21.15.5:0/1936638451 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:42.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.169+0000 7f6f81e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f68005130 0x7f6f841554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.170+0000 7f6f89200640 1 -- 172.21.15.5:0/1936638451 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840a8f20 con 0x7f6f68005130 2024-08-17T02:23:42.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.170+0000 7f779e800640 1 --2- 172.21.15.5:0/787522809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a015cdc0 0x7f77a00a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.170+0000 7f7c7c600640 1 -- start start 2024-08-17T02:23:42.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.170+0000 7f6f81400640 1 --2- 172.21.15.5:0/1936638451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f840a8560 0x7f6f8415e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f779de00640 1 -- 172.21.15.5:0/787522809 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77a00b03c0 msgr2=0x7f77a00abb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f779de00640 1 --2- 172.21.15.5:0/787522809 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77a00b03c0 0x7f77a00abb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f66d7600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d00ce1f0 0x7f66d00c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f779de00640 1 -- 172.21.15.5:0/787522809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a015cdc0 msgr2=0x7f77a00a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f779de00640 1 --2- 172.21.15.5:0/787522809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a015cdc0 0x7f77a00a5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f66d7600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66d00d0150 0x7f66d00c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f6f82800640 1 -- 172.21.15.5:0/1936638451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f68005130 msgr2=0x7f6f841554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f6f82800640 1 --2- 172.21.15.5:0/1936638451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f68005130 0x7f6f841554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f6f82800640 1 -- 172.21.15.5:0/1936638451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f840a8560 msgr2=0x7f6f8415e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f6f82800640 1 --2- 172.21.15.5:0/1936638451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f840a8560 0x7f6f8415e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f6f82800640 1 -- 172.21.15.5:0/1936638451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f840a9200 con 0x7f6f840a89b0 2024-08-17T02:23:42.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f779de00640 1 -- 172.21.15.5:0/787522809 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7798009ae0 con 0x7f77a006d7d0 2024-08-17T02:23:42.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f7795400640 1 --2- 172.21.15.5:0/787522809 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77a00b03c0 0x7f77a00abb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:42.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f66d7600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d0146890 0x7f66d00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f66d7600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00c8df0 con 0x7f66d00ce1f0 2024-08-17T02:23:42.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f66d7600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00c81e0 con 0x7f66d0146890 2024-08-17T02:23:42.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f66d7600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00c84c0 con 0x7f66d00d0150 2024-08-17T02:23:42.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f6f81e00640 1 --2- 172.21.15.5:0/1936638451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f68005130 0x7f6f841554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:42.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f6f81400640 1 --2- 172.21.15.5:0/1936638451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f840a8560 0x7f6f8415e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:42.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f6f82800640 1 --2- 172.21.15.5:0/1936638451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f840a89b0 0x7f6f8415e6c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400c470 tx=0x7f6f74034000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f66d5600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d0146890 0x7f66d00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.171+0000 7f779de00640 1 --2- 172.21.15.5:0/787522809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77a006d7d0 0x7f77a00cc050 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f779000b5e0 tx=0x7f7790009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f66d5600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d0146890 0x7f66d00c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:56632/0 (socket says 172.21.15.5:56632) 2024-08-17T02:23:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f66d5600640 1 -- 172.21.15.5:0/2017475385 learned_addr learned my addr 172.21.15.5:0/2017475385 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f7c7c600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c5c003aa0 0x7f7c74150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f7c7c600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c741630f0 0x7f7c74163560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f7c7c600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c7415f400 0x7f7c7415f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f7c7c600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74171c00 con 0x7f7c7415f400 2024-08-17T02:23:42.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f7c7c600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74163aa0 con 0x7f7c741630f0 2024-08-17T02:23:42.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f7c7c600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74170ff0 con 0x7f7c5c003aa0 2024-08-17T02:23:42.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f66cfe00640 1 --2- 172.21.15.5:0/2017475385 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66d00d0150 0x7f66d00c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f7c79c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c5c003aa0 0x7f7c74150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f7c79c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c5c003aa0 0x7f7c74150ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:33996/0 (socket says 172.21.15.5:33996) 2024-08-17T02:23:42.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f7c79c00640 1 -- 172.21.15.5:0/1972723850 learned_addr learned my addr 172.21.15.5:0/1972723850 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:42.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f7c79200640 1 --2- 172.21.15.5:0/1972723850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c741630f0 0x7f7c74163560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f7c7a600640 1 --2- 172.21.15.5:0/1972723850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c7415f400 0x7f7c7415f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f66d4c00640 1 --2- 172.21.15.5:0/2017475385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d00ce1f0 0x7f66d00c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f66d5600640 1 -- 172.21.15.5:0/2017475385 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66d00d0150 msgr2=0x7f66d00c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f66d5600640 1 --2- 172.21.15.5:0/2017475385 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66d00d0150 0x7f66d00c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f66d5600640 1 -- 172.21.15.5:0/2017475385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d00ce1f0 msgr2=0x7f66d00c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f66d5600640 1 --2- 172.21.15.5:0/2017475385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d00ce1f0 0x7f66d00c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.172+0000 7f66d5600640 1 -- 172.21.15.5:0/2017475385 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c4009450 con 0x7f66d0146890 2024-08-17T02:23:42.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.173+0000 7f66d5600640 1 --2- 172.21.15.5:0/2017475385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d0146890 0x7f66d00c7760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f66c800b8c0 tx=0x7f66c80093e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.173+0000 7f7c79c00640 1 -- 172.21.15.5:0/1972723850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c741630f0 msgr2=0x7f7c74163560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.173+0000 7f7c79c00640 1 --2- 172.21.15.5:0/1972723850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c741630f0 0x7f7c74163560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.173+0000 7f7c79c00640 1 -- 172.21.15.5:0/1972723850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c7415f400 msgr2=0x7f7c7415f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.173+0000 7f7c79c00640 1 --2- 172.21.15.5:0/1972723850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c7415f400 0x7f7c7415f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.173+0000 7f7c79c00640 1 -- 172.21.15.5:0/1972723850 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c741712d0 con 0x7f7c5c003aa0 2024-08-17T02:23:42.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.173+0000 7f7c7a600640 1 --2- 172.21.15.5:0/1972723850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c7415f400 0x7f7c7415f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:42.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.173+0000 7f7c79c00640 1 --2- 172.21.15.5:0/1972723850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c5c003aa0 0x7f7c74150ad0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7c6802bfd0 tx=0x7f7c68035000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.173+0000 7f6f79600640 1 -- 172.21.15.5:0/1936638451 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f74001440 con 0x7f6f840a89b0 2024-08-17T02:23:42.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.174+0000 7f6f79600640 1 -- 172.21.15.5:0/1936638451 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f74000c30 con 0x7f6f840a89b0 2024-08-17T02:23:42.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.174+0000 7f6f79600640 1 -- 172.21.15.5:0/1936638451 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7403d680 con 0x7f6f840a89b0 2024-08-17T02:23:42.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.174+0000 7f66c3e00640 1 -- 172.21.15.5:0/2017475385 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c800c860 con 0x7f66d0146890 2024-08-17T02:23:42.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.174+0000 7f66c3e00640 1 -- 172.21.15.5:0/2017475385 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c800c040 con 0x7f66d0146890 2024-08-17T02:23:42.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.174+0000 7f66c3e00640 1 -- 172.21.15.5:0/2017475385 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c800cc10 con 0x7f66d0146890 2024-08-17T02:23:42.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.174+0000 7f7796000640 1 -- 172.21.15.5:0/787522809 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779000f590 con 0x7f77a006d7d0 2024-08-17T02:23:42.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.174+0000 7f7796000640 1 -- 172.21.15.5:0/787522809 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779000f710 con 0x7f77a006d7d0 2024-08-17T02:23:42.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.174+0000 7f7796000640 1 -- 172.21.15.5:0/787522809 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779000fad0 con 0x7f77a006d7d0 2024-08-17T02:23:42.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.174+0000 7fc30f400640 1 -- 172.21.15.5:0/482119928 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc300050030 con 0x7fc3180c8850 2024-08-17T02:23:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.174+0000 7f66d7600640 1 -- 172.21.15.5:0/2017475385 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d00c87a0 con 0x7f66d0146890 2024-08-17T02:23:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.174+0000 7f66d7600640 1 -- 172.21.15.5:0/2017475385 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d00c74b0 con 0x7f66d0146890 2024-08-17T02:23:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.175+0000 7f7c70c00640 1 -- 172.21.15.5:0/1972723850 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6803c620 con 0x7f7c5c003aa0 2024-08-17T02:23:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.175+0000 7f7c70c00640 1 -- 172.21.15.5:0/1972723850 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6803c780 con 0x7f7c5c003aa0 2024-08-17T02:23:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.175+0000 7f7c70c00640 1 -- 172.21.15.5:0/1972723850 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6803cb00 con 0x7f7c5c003aa0 2024-08-17T02:23:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.175+0000 7f7c7c600640 1 -- 172.21.15.5:0/1972723850 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c741715b0 con 0x7f7c5c003aa0 2024-08-17T02:23:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.175+0000 7f7c7c600640 1 -- 172.21.15.5:0/1972723850 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c74151010 con 0x7f7c5c003aa0 2024-08-17T02:23:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.174+0000 7f6f89200640 1 -- 172.21.15.5:0/1936638451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f840a99e0 con 0x7f6f840a89b0 2024-08-17T02:23:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.174+0000 7f6f89200640 1 -- 172.21.15.5:0/1936638451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f84156860 con 0x7f6f840a89b0 2024-08-17T02:23:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.176+0000 7f66d7600640 1 -- 172.21.15.5:0/2017475385 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d00c8fa0 con 0x7f66d0146890 2024-08-17T02:23:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.177+0000 7f6f89200640 1 -- 172.21.15.5:0/1936638451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5c005210 con 0x7f6f840a89b0 2024-08-17T02:23:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.175+0000 7f77a4e00640 1 -- 172.21.15.5:0/787522809 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a00a4a90 con 0x7f77a006d7d0 2024-08-17T02:23:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.175+0000 7f77a4e00640 1 -- 172.21.15.5:0/787522809 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a00a5050 con 0x7f77a006d7d0 2024-08-17T02:23:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.177+0000 7f7c7c600640 1 -- 172.21.15.5:0/1972723850 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c74063fb0 con 0x7f7c5c003aa0 2024-08-17T02:23:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.179+0000 7f6f79600640 1 -- 172.21.15.5:0/1936638451 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6f7403d9f0 con 0x7f6f840a89b0 2024-08-17T02:23:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.178+0000 7f77a4e00640 1 -- 172.21.15.5:0/787522809 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a0063fb0 con 0x7f77a006d7d0 2024-08-17T02:23:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.177+0000 7f7c70c00640 1 -- 172.21.15.5:0/1972723850 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7c68039050 con 0x7f7c5c003aa0 2024-08-17T02:23:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.178+0000 7f7c70c00640 1 --2- 172.21.15.5:0/1972723850 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7c540652a0 0x7f7c54067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.178+0000 7f7c70c00640 1 -- 172.21.15.5:0/1972723850 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7c680a28c0 con 0x7f7c5c003aa0 2024-08-17T02:23:42.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.180+0000 7f6f79600640 1 --2- 172.21.15.5:0/1936638451 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6f64065180 0x7f6f64067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.180+0000 7f6f79600640 1 -- 172.21.15.5:0/1936638451 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f740a26c0 con 0x7f6f840a89b0 2024-08-17T02:23:42.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.180+0000 7f6f81e00640 1 --2- 172.21.15.5:0/1936638451 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6f64065180 0x7f6f64067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.180+0000 7f66c3e00640 1 -- 172.21.15.5:0/2017475385 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f66c8014620 con 0x7f66d0146890 2024-08-17T02:23:42.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.181+0000 7f7796000640 1 -- 172.21.15.5:0/787522809 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f779001a460 con 0x7f77a006d7d0 2024-08-17T02:23:42.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.181+0000 7f66c3e00640 1 --2- 172.21.15.5:0/2017475385 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f66b00652d0 0x7f66b0067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.181+0000 7f66c3e00640 1 -- 172.21.15.5:0/2017475385 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f66c8081d40 con 0x7f66d0146890 2024-08-17T02:23:42.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.181+0000 7f66d4c00640 1 --2- 172.21.15.5:0/2017475385 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f66b00652d0 0x7f66b0067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.182+0000 7f7796000640 1 --2- 172.21.15.5:0/787522809 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f777c065220 0x7f777c0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:42.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.182+0000 7f66d4c00640 1 --2- 172.21.15.5:0/2017475385 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f66b00652d0 0x7f66b0067780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f66c4034000 tx=0x7f66c4032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.183+0000 7f6f81e00640 1 --2- 172.21.15.5:0/1936638451 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6f64065180 0x7f6f64067630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6f840cc910 tx=0x7f6f7c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.182+0000 7f7c79200640 1 --2- 172.21.15.5:0/1972723850 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7c540652a0 0x7f7c54067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.182+0000 7f7c70c00640 1 -- 172.21.15.5:0/1972723850 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7c68070960 con 0x7f7c5c003aa0 2024-08-17T02:23:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.182+0000 7f7796000640 1 -- 172.21.15.5:0/787522809 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f77900820d0 con 0x7f77a006d7d0 2024-08-17T02:23:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.184+0000 7f6f79600640 1 -- 172.21.15.5:0/1936638451 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6f740706e0 con 0x7f6f840a89b0 2024-08-17T02:23:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.183+0000 7f7c79200640 1 --2- 172.21.15.5:0/1972723850 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7c540652a0 0x7f7c54067750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c60000e10 tx=0x7f7c60009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.183+0000 7f7795400640 1 --2- 172.21.15.5:0/787522809 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f777c065220 0x7f777c0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.185+0000 7f7795400640 1 --2- 172.21.15.5:0/787522809 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f777c065220 0x7f777c0676d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f77a015c750 tx=0x7f77880090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.188+0000 7f66c3e00640 1 -- 172.21.15.5:0/2017475385 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f66c804ce40 con 0x7f66d0146890 2024-08-17T02:23:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.192+0000 7f7796000640 1 -- 172.21.15.5:0/787522809 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f77900501f0 con 0x7f77a006d7d0 2024-08-17T02:23:42.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.592+0000 7f264de00640 1 -- 172.21.15.5:0/1050704746 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f26400529a0 con 0x7f2640006880 2024-08-17T02:23:42.594 INFO:teuthology.orchestra.run.smithi005.stdout:60129542148 2024-08-17T02:23:42.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.592+0000 7f263be00640 1 -- 172.21.15.5:0/1050704746 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f26340703f0 con 0x7f2640006880 2024-08-17T02:23:42.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.593+0000 7f2582a00640 1 -- 172.21.15.5:0/4032722370 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f257c0cf030 con 0x7f257c158a00 2024-08-17T02:23:42.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.594+0000 7f2578c00640 1 -- 172.21.15.5:0/4032722370 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2570053560 con 0x7f257c158a00 2024-08-17T02:23:42.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.596+0000 7f264de00640 1 -- 172.21.15.5:0/1050704746 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2628065220 msgr2=0x7f26280676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.596+0000 7f264de00640 1 --2- 172.21.15.5:0/1050704746 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2628065220 0x7f26280676d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f26400336a0 tx=0x7f263c008040 comp rx=0 tx=0).stop 2024-08-17T02:23:42.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.596+0000 7f264de00640 1 -- 172.21.15.5:0/1050704746 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2640006880 msgr2=0x7f26400f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.596+0000 7f264de00640 1 --2- 172.21.15.5:0/1050704746 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2640006880 0x7f26400f7d20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f26340098e0 tx=0x7f2634032000 comp rx=0 tx=0).stop 2024-08-17T02:23:42.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.597+0000 7f264de00640 1 -- 172.21.15.5:0/1050704746 shutdown_connections 2024-08-17T02:23:42.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.597+0000 7f264de00640 1 --2- 172.21.15.5:0/1050704746 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2628065220 0x7f26280676d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.597+0000 7f264de00640 1 --2- 172.21.15.5:0/1050704746 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2640033f70 0x7f264002be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.597+0000 7f264de00640 1 --2- 172.21.15.5:0/1050704746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26400e6c70 0x7f264002cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.597+0000 7f264de00640 1 --2- 172.21.15.5:0/1050704746 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2640006880 0x7f26400f7d20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.597+0000 7f264de00640 1 -- 172.21.15.5:0/1050704746 >> 172.21.15.5:0/1050704746 conn(0x7f2640054b90 msgr2=0x7f2640054f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.598 INFO:teuthology.orchestra.run.smithi005.stdout:60129542147 2024-08-17T02:23:42.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.596+0000 7f5341e00640 1 -- 172.21.15.5:0/584468281 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f53340056a0 con 0x7f53340cfb40 2024-08-17T02:23:42.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.597+0000 7f264de00640 1 -- 172.21.15.5:0/1050704746 shutdown_connections 2024-08-17T02:23:42.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.597+0000 7f264de00640 1 -- 172.21.15.5:0/1050704746 wait complete. 2024-08-17T02:23:42.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.597+0000 7f2582a00640 1 -- 172.21.15.5:0/4032722370 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f25600651d0 msgr2=0x7f2560067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.597+0000 7f2582a00640 1 --2- 172.21.15.5:0/4032722370 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f25600651d0 0x7f2560067680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f256c007fd0 tx=0x7f256c009040 comp rx=0 tx=0).stop 2024-08-17T02:23:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.597+0000 7f2582a00640 1 -- 172.21.15.5:0/4032722370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f257c158a00 msgr2=0x7f257c0c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.598+0000 7f5332000640 1 -- 172.21.15.5:0/584468281 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f533c066e60 con 0x7f53340cfb40 2024-08-17T02:23:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.597+0000 7f2582a00640 1 --2- 172.21.15.5:0/4032722370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f257c158a00 0x7f257c0c6b90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2570009fd0 tx=0x7f2570009060 comp rx=0 tx=0).stop 2024-08-17T02:23:42.600 INFO:teuthology.orchestra.run.smithi005.stdout:60129542148 2024-08-17T02:23:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.598+0000 7f2582a00640 1 -- 172.21.15.5:0/4032722370 shutdown_connections 2024-08-17T02:23:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.598+0000 7f2582a00640 1 --2- 172.21.15.5:0/4032722370 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f25600651d0 0x7f2560067680 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.598+0000 7f2582a00640 1 --2- 172.21.15.5:0/4032722370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f257c158a00 0x7f257c0c6b90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.598+0000 7f2582a00640 1 --2- 172.21.15.5:0/4032722370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f257c158dd0 0x7f257c0c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.598+0000 7f2582a00640 1 --2- 172.21.15.5:0/4032722370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c06eca0 0x7f257c155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.598+0000 7f2582a00640 1 -- 172.21.15.5:0/4032722370 >> 172.21.15.5:0/4032722370 conn(0x7f257c0cfb80 msgr2=0x7f257c0ca780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.601+0000 7f2582a00640 1 -- 172.21.15.5:0/4032722370 shutdown_connections 2024-08-17T02:23:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.601+0000 7f2582a00640 1 -- 172.21.15.5:0/4032722370 wait complete. 2024-08-17T02:23:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.601+0000 7f5341e00640 1 -- 172.21.15.5:0/584468281 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f53180652a0 msgr2=0x7f5318067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.601+0000 7f5341e00640 1 --2- 172.21.15.5:0/584468281 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f53180652a0 0x7f5318067750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5324034000 tx=0x7f5324032000 comp rx=0 tx=0).stop 2024-08-17T02:23:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.601+0000 7f5341e00640 1 -- 172.21.15.5:0/584468281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53340cfb40 msgr2=0x7f53340e8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.601+0000 7f5341e00640 1 --2- 172.21.15.5:0/584468281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53340cfb40 0x7f53340e8f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f533c066b80 tx=0x7f533c064990 comp rx=0 tx=0).stop 2024-08-17T02:23:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.602+0000 7f5341e00640 1 -- 172.21.15.5:0/584468281 shutdown_connections 2024-08-17T02:23:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.602+0000 7f5341e00640 1 --2- 172.21.15.5:0/584468281 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f53180652a0 0x7f5318067750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.602+0000 7f5341e00640 1 --2- 172.21.15.5:0/584468281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53340cfb40 0x7f53340e8f90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.602+0000 7f5341e00640 1 --2- 172.21.15.5:0/584468281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5334053b20 0x7f53340e8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.602+0000 7f5341e00640 1 --2- 172.21.15.5:0/584468281 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5334006890 0x7f53340e5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.602+0000 7f5341e00640 1 -- 172.21.15.5:0/584468281 >> 172.21.15.5:0/584468281 conn(0x7f5334055a10 msgr2=0x7f53340ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.602+0000 7f5341e00640 1 -- 172.21.15.5:0/584468281 shutdown_connections 2024-08-17T02:23:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.603+0000 7f5341e00640 1 -- 172.21.15.5:0/584468281 wait complete. 2024-08-17T02:23:42.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.606+0000 7fc31f200640 1 -- 172.21.15.5:0/482119928 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc318063fb0 con 0x7fc3180c8850 2024-08-17T02:23:42.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.606+0000 7fc30f400640 1 -- 172.21.15.5:0/482119928 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc300007710 con 0x7fc3180c8850 2024-08-17T02:23:42.607 INFO:teuthology.orchestra.run.smithi005.stdout:60129542148 2024-08-17T02:23:42.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.609+0000 7f6f89200640 1 -- 172.21.15.5:0/1936638451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6f5c0054c0 con 0x7f6f840a89b0 2024-08-17T02:23:42.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.610+0000 7fc31f200640 1 -- 172.21.15.5:0/482119928 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc2f40651d0 msgr2=0x7fc2f4067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.610+0000 7fc31f200640 1 --2- 172.21.15.5:0/482119928 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc2f40651d0 0x7fc2f4067680 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc31000b3f0 tx=0x7fc310039000 comp rx=0 tx=0).stop 2024-08-17T02:23:42.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.610+0000 7f6f79600640 1 -- 172.21.15.5:0/1936638451 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f74036020 con 0x7f6f840a89b0 2024-08-17T02:23:42.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.610+0000 7fc31f200640 1 -- 172.21.15.5:0/482119928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3180c8850 msgr2=0x7fc3180c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.610+0000 7fc31f200640 1 --2- 172.21.15.5:0/482119928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3180c8850 0x7fc3180c8cd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc30000c590 tx=0x7fc300007dd0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.611+0000 7fc31f200640 1 -- 172.21.15.5:0/482119928 shutdown_connections 2024-08-17T02:23:42.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.611+0000 7fc31f200640 1 --2- 172.21.15.5:0/482119928 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc2f40651d0 0x7fc2f4067680 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.611+0000 7fc31f200640 1 --2- 172.21.15.5:0/482119928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3180c8850 0x7fc3180c8cd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.611+0000 7fc31f200640 1 --2- 172.21.15.5:0/482119928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3181535e0 0x7fc3180c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.611+0000 7fc31f200640 1 --2- 172.21.15.5:0/482119928 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3180b0540 0x7fc31813d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.611+0000 7fc31f200640 1 -- 172.21.15.5:0/482119928 >> 172.21.15.5:0/482119928 conn(0x7fc318067f70 msgr2=0x7fc3180c5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.611+0000 7fc31f200640 1 -- 172.21.15.5:0/482119928 shutdown_connections 2024-08-17T02:23:42.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.611+0000 7fc31f200640 1 -- 172.21.15.5:0/482119928 wait complete. 2024-08-17T02:23:42.615 INFO:teuthology.orchestra.run.smithi005.stdout:60129542149 2024-08-17T02:23:42.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.614+0000 7f6f89200640 1 -- 172.21.15.5:0/1936638451 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6f64065180 msgr2=0x7f6f64067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.614+0000 7f6f89200640 1 --2- 172.21.15.5:0/1936638451 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6f64065180 0x7f6f64067630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6f840cc910 tx=0x7f6f7c00b040 comp rx=0 tx=0).stop 2024-08-17T02:23:42.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.614+0000 7f6f89200640 1 -- 172.21.15.5:0/1936638451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f840a89b0 msgr2=0x7f6f8415e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.614+0000 7f6f89200640 1 --2- 172.21.15.5:0/1936638451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f840a89b0 0x7f6f8415e6c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400c470 tx=0x7f6f74034000 comp rx=0 tx=0).stop 2024-08-17T02:23:42.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.614+0000 7f6f89200640 1 -- 172.21.15.5:0/1936638451 shutdown_connections 2024-08-17T02:23:42.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.614+0000 7f6f89200640 1 --2- 172.21.15.5:0/1936638451 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6f64065180 0x7f6f64067630 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.614+0000 7f6f89200640 1 --2- 172.21.15.5:0/1936638451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f840a89b0 0x7f6f8415e6c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.614+0000 7f6f89200640 1 --2- 172.21.15.5:0/1936638451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f840a8560 0x7f6f8415e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.614+0000 7f6f89200640 1 --2- 172.21.15.5:0/1936638451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f68005130 0x7f6f841554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.614+0000 7f6f89200640 1 -- 172.21.15.5:0/1936638451 >> 172.21.15.5:0/1936638451 conn(0x7f6f84066e60 msgr2=0x7f6f840a6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.615+0000 7f6f89200640 1 -- 172.21.15.5:0/1936638451 shutdown_connections 2024-08-17T02:23:42.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.615+0000 7f6f89200640 1 -- 172.21.15.5:0/1936638451 wait complete. 2024-08-17T02:23:42.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.615+0000 7f66d7600640 1 -- 172.21.15.5:0/2017475385 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f66d0063fb0 con 0x7f66d0146890 2024-08-17T02:23:42.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.615+0000 7f77a4e00640 1 -- 172.21.15.5:0/787522809 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f77a006e4c0 con 0x7f77a006d7d0 2024-08-17T02:23:42.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.616+0000 7f66c3e00640 1 -- 172.21.15.5:0/2017475385 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f66d00c8fa0 con 0x7f66d0146890 2024-08-17T02:23:42.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.616+0000 7f7796000640 1 -- 172.21.15.5:0/787522809 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7790053810 con 0x7f77a006d7d0 2024-08-17T02:23:42.617 INFO:teuthology.orchestra.run.smithi005.stdout:60129542148 2024-08-17T02:23:42.619 INFO:teuthology.orchestra.run.smithi005.stdout:60129542148 2024-08-17T02:23:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.619+0000 7f7c7c600640 1 -- 172.21.15.5:0/1972723850 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7c74071010 con 0x7f7c5c003aa0 2024-08-17T02:23:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.620+0000 7f66d7600640 1 -- 172.21.15.5:0/2017475385 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f66b00652d0 msgr2=0x7f66b0067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.620+0000 7f66d7600640 1 --2- 172.21.15.5:0/2017475385 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f66b00652d0 0x7f66b0067780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f66c4034000 tx=0x7f66c4032000 comp rx=0 tx=0).stop 2024-08-17T02:23:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.620+0000 7f66d7600640 1 -- 172.21.15.5:0/2017475385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d0146890 msgr2=0x7f66d00c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.620+0000 7f66d7600640 1 --2- 172.21.15.5:0/2017475385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d0146890 0x7f66d00c7760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f66c800b8c0 tx=0x7f66c80093e0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.620+0000 7f77a4e00640 1 -- 172.21.15.5:0/787522809 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f777c065220 msgr2=0x7f777c0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.620+0000 7f77a4e00640 1 --2- 172.21.15.5:0/787522809 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f777c065220 0x7f777c0676d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f77a015c750 tx=0x7f77880090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.620+0000 7f77a4e00640 1 -- 172.21.15.5:0/787522809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77a006d7d0 msgr2=0x7f77a00cc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.620+0000 7f77a4e00640 1 --2- 172.21.15.5:0/787522809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77a006d7d0 0x7f77a00cc050 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f779000b5e0 tx=0x7f7790009060 comp rx=0 tx=0).stop 2024-08-17T02:23:42.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.620+0000 7f77a4e00640 1 -- 172.21.15.5:0/787522809 shutdown_connections 2024-08-17T02:23:42.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.620+0000 7f77a4e00640 1 --2- 172.21.15.5:0/787522809 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f777c065220 0x7f777c0676d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.620+0000 7f77a4e00640 1 --2- 172.21.15.5:0/787522809 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77a00b03c0 0x7f77a00abb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.621+0000 7f7c70c00640 1 -- 172.21.15.5:0/1972723850 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7c6804a090 con 0x7f7c5c003aa0 2024-08-17T02:23:42.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.621+0000 7f66d7600640 1 -- 172.21.15.5:0/2017475385 shutdown_connections 2024-08-17T02:23:42.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.621+0000 7f66d7600640 1 --2- 172.21.15.5:0/2017475385 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f66b00652d0 0x7f66b0067780 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.621+0000 7f66d7600640 1 --2- 172.21.15.5:0/2017475385 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66d00d0150 0x7f66d00c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.621+0000 7f66d7600640 1 --2- 172.21.15.5:0/2017475385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d0146890 0x7f66d00c7760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.621+0000 7f66d7600640 1 --2- 172.21.15.5:0/2017475385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d00ce1f0 0x7f66d00c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.621+0000 7f66d7600640 1 -- 172.21.15.5:0/2017475385 >> 172.21.15.5:0/2017475385 conn(0x7f66d006e590 msgr2=0x7f66d00b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.620+0000 7f77a4e00640 1 --2- 172.21.15.5:0/787522809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a015cdc0 0x7f77a00a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.621+0000 7f66d7600640 1 -- 172.21.15.5:0/2017475385 shutdown_connections 2024-08-17T02:23:42.624 INFO:teuthology.orchestra.run.smithi005.stdout:60129542148 2024-08-17T02:23:42.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.621+0000 7f66d7600640 1 -- 172.21.15.5:0/2017475385 wait complete. 2024-08-17T02:23:42.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.620+0000 7f77a4e00640 1 --2- 172.21.15.5:0/787522809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77a006d7d0 0x7f77a00cc050 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.620+0000 7f77a4e00640 1 -- 172.21.15.5:0/787522809 >> 172.21.15.5:0/787522809 conn(0x7f77a0066e60 msgr2=0x7f77a015f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.621+0000 7f77a4e00640 1 -- 172.21.15.5:0/787522809 shutdown_connections 2024-08-17T02:23:42.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.622+0000 7f77a4e00640 1 -- 172.21.15.5:0/787522809 wait complete. 2024-08-17T02:23:42.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.0 2024-08-17T02:23:42.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.626+0000 7f7c7c600640 1 -- 172.21.15.5:0/1972723850 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7c540652a0 msgr2=0x7f7c54067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.626+0000 7f7c7c600640 1 --2- 172.21.15.5:0/1972723850 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7c540652a0 0x7f7c54067750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c60000e10 tx=0x7f7c60009040 comp rx=0 tx=0).stop 2024-08-17T02:23:42.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.626+0000 7f7c7c600640 1 -- 172.21.15.5:0/1972723850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c5c003aa0 msgr2=0x7f7c74150ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:42.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.626+0000 7f7c7c600640 1 --2- 172.21.15.5:0/1972723850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c5c003aa0 0x7f7c74150ad0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7c6802bfd0 tx=0x7f7c68035000 comp rx=0 tx=0).stop 2024-08-17T02:23:42.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.627+0000 7f7c7c600640 1 -- 172.21.15.5:0/1972723850 shutdown_connections 2024-08-17T02:23:42.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.627+0000 7f7c7c600640 1 --2- 172.21.15.5:0/1972723850 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7c540652a0 0x7f7c54067750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.627+0000 7f7c7c600640 1 --2- 172.21.15.5:0/1972723850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c7415f400 0x7f7c7415f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.627+0000 7f7c7c600640 1 --2- 172.21.15.5:0/1972723850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c741630f0 0x7f7c74163560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.627+0000 7f7c7c600640 1 --2- 172.21.15.5:0/1972723850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c5c003aa0 0x7f7c74150ad0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:42.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.627+0000 7f7c7c600640 1 -- 172.21.15.5:0/1972723850 >> 172.21.15.5:0/1972723850 conn(0x7f7c740d4100 msgr2=0x7f7c740b6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:42.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.2 2024-08-17T02:23:42.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.628+0000 7f7c7c600640 1 -- 172.21.15.5:0/1972723850 shutdown_connections 2024-08-17T02:23:42.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:42.628+0000 7f7c7c600640 1 -- 172.21.15.5:0/1972723850 wait complete. 2024-08-17T02:23:42.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.1 2024-08-17T02:23:42.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-08-17T02:23:42.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.6 2024-08-17T02:23:42.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.3 2024-08-17T02:23:42.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.7 2024-08-17T02:23:42.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-08-17T02:23:43.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:23:43.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:23:43.635 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:23:43.644 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:23:43.645 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:23:43.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:23:43.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:23:43.650 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:23:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.871+0000 7f66f2200640 1 Processor -- start 2024-08-17T02:23:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.872+0000 7fb9fac00640 1 Processor -- start 2024-08-17T02:23:43.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.872+0000 7fb9fac00640 1 -- start start 2024-08-17T02:23:43.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.872+0000 7f66f2200640 1 -- start start 2024-08-17T02:23:43.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.874+0000 7f66f2200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66e4033f70 0x7f66e40e7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.874+0000 7f66f2200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66e4006880 0x7f66e404fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.874+0000 7fb9fac00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb9ec0e1ef0 0x7fb9ec057420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.874+0000 7f66f2200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e40503c0 con 0x7f66e40e6c70 2024-08-17T02:23:43.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.874+0000 7f66f2200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e4007850 con 0x7f66e4033f70 2024-08-17T02:23:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.874+0000 7fb9fac00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9ec0e6330 0x7fb9ec038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.874+0000 7fb9fac00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ec058860 con 0x7fb9ec0e22c0 2024-08-17T02:23:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.874+0000 7fb9fac00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ec058cf0 con 0x7fb9ec0e1ef0 2024-08-17T02:23:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.874+0000 7fb9fac00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec057c50 con 0x7fb9ec0e6330 2024-08-17T02:23:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.874+0000 7f66f2200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e4006ce0 con 0x7f66e4006880 2024-08-17T02:23:43.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.875+0000 7fb9fa200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9ec0e6330 0x7fb9ec038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.875+0000 7fb9fa200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9ec0e6330 0x7fb9ec038bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:34008/0 (socket says 172.21.15.5:34008) 2024-08-17T02:23:43.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.875+0000 7fb9fa200640 1 -- 172.21.15.5:0/1168815253 learned_addr learned my addr 172.21.15.5:0/1168815253 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:43.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.876+0000 7fb9f3e00640 1 -- 172.21.15.5:0/1168815253 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186974708 0 0) 0x7fb9ec058860 con 0x7fb9ec0e22c0 2024-08-17T02:23:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.876+0000 7f66ebe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66e4033f70 0x7f66e40e7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.876+0000 7f66f1800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66e4006880 0x7f66e404fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.876+0000 7f66f1800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66e4006880 0x7f66e404fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:34020/0 (socket says 172.21.15.5:34020) 2024-08-17T02:23:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.876+0000 7f66f1800640 1 -- 172.21.15.5:0/4041982862 learned_addr learned my addr 172.21.15.5:0/4041982862 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.876+0000 7fb9fa200640 1 -- 172.21.15.5:0/1168815253 >> v2:172.21.15.87:3300/0 conn(0x7fb9ec0e1ef0 msgr2=0x7fb9ec057420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.876+0000 7fb9fa200640 1 --2- 172.21.15.5:0/1168815253 >> v2:172.21.15.87:3300/0 conn(0x7fb9ec0e1ef0 0x7fb9ec057420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.876+0000 7fb9fa200640 1 -- 172.21.15.5:0/1168815253 >> v1:172.21.15.5:6789/0 conn(0x7fb9ec0e22c0 legacy=0x7fb9ec0e5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.876+0000 7fb9fa200640 1 -- 172.21.15.5:0/1168815253 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec057f30 con 0x7fb9ec0e6330 2024-08-17T02:23:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.877+0000 7f66ebe00640 1 -- 172.21.15.5:0/4041982862 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66e4006880 msgr2=0x7f66e404fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.878+0000 7fb9fa200640 1 --2- 172.21.15.5:0/1168815253 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9ec0e6330 0x7fb9ec038bd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009910 tx=0x7fb9e00091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2f6afd05749fd11 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:43.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.877+0000 7f66ebe00640 1 --2- 172.21.15.5:0/4041982862 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66e4006880 0x7f66e404fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.877+0000 7f66ebe00640 1 -- 172.21.15.5:0/4041982862 >> v1:172.21.15.5:6789/0 conn(0x7f66e40e6c70 legacy=0x7f66e4033860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.877+0000 7f66ebe00640 1 -- 172.21.15.5:0/4041982862 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e4006fb0 con 0x7f66e4033f70 2024-08-17T02:23:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.879+0000 7fb9f3e00640 1 -- 172.21.15.5:0/1168815253 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e002ae80 con 0x7fb9ec0e6330 2024-08-17T02:23:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.879+0000 7fb9f3e00640 1 -- 172.21.15.5:0/1168815253 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e0032440 con 0x7fb9ec0e6330 2024-08-17T02:23:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.879+0000 7fb9f3e00640 1 -- 172.21.15.5:0/1168815253 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e00327c0 con 0x7fb9ec0e6330 2024-08-17T02:23:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.879+0000 7f66ebe00640 1 --2- 172.21.15.5:0/4041982862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e4033f70 0x7f66e40e7040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f66ec04c0c0 tx=0x7f66ec064990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ffbe697a5fcedf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.880+0000 7f66eb400640 1 -- 172.21.15.5:0/4041982862 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec0a1df0 con 0x7f66e4033f70 2024-08-17T02:23:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.880+0000 7f66eb400640 1 -- 172.21.15.5:0/4041982862 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec0a93f0 con 0x7f66e4033f70 2024-08-17T02:23:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.880+0000 7f66eb400640 1 -- 172.21.15.5:0/4041982862 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec0a1df0 con 0x7f66e4033f70 2024-08-17T02:23:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.880+0000 7fb9fac00640 1 -- 172.21.15.5:0/1168815253 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9ec0e6330 msgr2=0x7fb9ec038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.880+0000 7fb9fac00640 1 --2- 172.21.15.5:0/1168815253 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9ec0e6330 0x7fb9ec038bd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009910 tx=0x7fb9e00091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.881+0000 7fb9fac00640 1 -- 172.21.15.5:0/1168815253 shutdown_connections 2024-08-17T02:23:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.881+0000 7fb9fac00640 1 --2- 172.21.15.5:0/1168815253 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9ec0e6330 0x7fb9ec038bd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.881+0000 7fb9fac00640 1 --2- 172.21.15.5:0/1168815253 >> v2:172.21.15.87:3300/0 conn(0x7fb9ec0e1ef0 0x7fb9ec057420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.881+0000 7fb9fac00640 1 -- 172.21.15.5:0/1168815253 >> 172.21.15.5:0/1168815253 conn(0x7fb9ec055a10 msgr2=0x7fb9ec055e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:43.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.881+0000 7fb9fac00640 1 -- 172.21.15.5:0/1168815253 shutdown_connections 2024-08-17T02:23:43.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.881+0000 7fb9fac00640 1 -- 172.21.15.5:0/1168815253 wait complete. 2024-08-17T02:23:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.882+0000 7f66f2200640 1 -- 172.21.15.5:0/4041982862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e4033f70 msgr2=0x7f66e40e7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.882+0000 7f66f2200640 1 --2- 172.21.15.5:0/4041982862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e4033f70 0x7f66e40e7040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f66ec04c0c0 tx=0x7f66ec064990 comp rx=0 tx=0).stop 2024-08-17T02:23:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.883+0000 7f66f2200640 1 -- 172.21.15.5:0/4041982862 shutdown_connections 2024-08-17T02:23:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.883+0000 7f66f2200640 1 --2- 172.21.15.5:0/4041982862 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66e4006880 0x7f66e404fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.883+0000 7f66f2200640 1 --2- 172.21.15.5:0/4041982862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e4033f70 0x7f66e40e7040 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.883+0000 7f66f2200640 1 -- 172.21.15.5:0/4041982862 >> 172.21.15.5:0/4041982862 conn(0x7f66e4054b90 msgr2=0x7f66e4054f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.884+0000 7f66f2200640 1 -- 172.21.15.5:0/4041982862 shutdown_connections 2024-08-17T02:23:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.884+0000 7fb9fac00640 1 Processor -- start 2024-08-17T02:23:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.884+0000 7fb9fac00640 1 -- start start 2024-08-17T02:23:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.886+0000 7fb9fac00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9ec0e1ef0 0x7fb9ec039f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.886+0000 7fb9fac00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9ec0e22c0 0x7fb9ec0d49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.884+0000 7f66f2200640 1 -- 172.21.15.5:0/4041982862 wait complete. 2024-08-17T02:23:43.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.886+0000 7f66f2200640 1 Processor -- start 2024-08-17T02:23:43.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.887+0000 7f66f2200640 1 -- start start 2024-08-17T02:23:43.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.887+0000 7fb9f8e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9ec0e22c0 0x7fb9ec0d49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.887+0000 7fb9f8e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9ec0e22c0 0x7fb9ec0d49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44058/0 (socket says 172.21.15.5:44058) 2024-08-17T02:23:43.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.887+0000 7fb9f8e00640 1 -- 172.21.15.5:0/2686630391 learned_addr learned my addr 172.21.15.5:0/2686630391 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:43.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.887+0000 7fb9fac00640 1 --2- 172.21.15.5:0/2686630391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9ec0e6330 0x7fb9ec0daa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.887+0000 7fb9fac00640 1 -- 172.21.15.5:0/2686630391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec03a450 con 0x7fb9ec0e22c0 2024-08-17T02:23:43.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.887+0000 7fb9fac00640 1 -- 172.21.15.5:0/2686630391 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec03b130 con 0x7fb9ec0e6330 2024-08-17T02:23:43.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.887+0000 7fb9fac00640 1 -- 172.21.15.5:0/2686630391 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec0e3310 con 0x7fb9ec0e1ef0 2024-08-17T02:23:43.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.888+0000 7fb9fa200640 1 --2- 172.21.15.5:0/2686630391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9ec0e6330 0x7fb9ec0daa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.888+0000 7fb9f9800640 1 --2- 172.21.15.5:0/2686630391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9ec0e1ef0 0x7fb9ec039f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.888+0000 7fb9fa200640 1 -- 172.21.15.5:0/2686630391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9ec0e1ef0 msgr2=0x7fb9ec039f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.888+0000 7fb9fa200640 1 --2- 172.21.15.5:0/2686630391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9ec0e1ef0 0x7fb9ec039f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.888+0000 7fb9fa200640 1 -- 172.21.15.5:0/2686630391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9ec0e22c0 msgr2=0x7fb9ec0d49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.888+0000 7fb9fa200640 1 --2- 172.21.15.5:0/2686630391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9ec0e22c0 0x7fb9ec0d49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.888+0000 7fb9fa200640 1 -- 172.21.15.5:0/2686630391 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e0009450 con 0x7fb9ec0e6330 2024-08-17T02:23:43.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.888+0000 7fb9f8e00640 1 --2- 172.21.15.5:0/2686630391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9ec0e22c0 0x7fb9ec0d49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:43.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.889+0000 7fb9fa200640 1 --2- 172.21.15.5:0/2686630391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9ec0e6330 0x7fb9ec0daa50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0031000 tx=0x7fb9e0032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:43.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.889+0000 7fb9f0c00640 1 -- 172.21.15.5:0/2686630391 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0006ea0 con 0x7fb9ec0e6330 2024-08-17T02:23:43.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.889+0000 7fb9f0c00640 1 -- 172.21.15.5:0/2686630391 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e0031de0 con 0x7fb9ec0e6330 2024-08-17T02:23:43.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.889+0000 7fb9f0c00640 1 -- 172.21.15.5:0/2686630391 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e003e6a0 con 0x7fb9ec0e6330 2024-08-17T02:23:43.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.889+0000 7f66f2200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e4006880 0x7f66e40eb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.889+0000 7f66f2200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e4033f70 0x7f66e404d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.889+0000 7f66f2200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66e40e6c70 0x7f66e404d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.890+0000 7f66ebe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e4033f70 0x7f66e404d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.890+0000 7f66ebe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e4033f70 0x7f66e404d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:56662/0 (socket says 172.21.15.5:56662) 2024-08-17T02:23:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.890+0000 7f66ebe00640 1 -- 172.21.15.5:0/3658173868 learned_addr learned my addr 172.21.15.5:0/3658173868 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.890+0000 7f66f2200640 1 -- 172.21.15.5:0/3658173868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40ebc20 con 0x7f66e4006880 2024-08-17T02:23:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.890+0000 7f66f2200640 1 -- 172.21.15.5:0/3658173868 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e404e320 con 0x7f66e4033f70 2024-08-17T02:23:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.890+0000 7f66f2200640 1 -- 172.21.15.5:0/3658173868 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e404e600 con 0x7f66e40e6c70 2024-08-17T02:23:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.890+0000 7f66f1800640 1 --2- 172.21.15.5:0/3658173868 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66e40e6c70 0x7f66e404d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.890+0000 7f66f0e00640 1 --2- 172.21.15.5:0/3658173868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e4006880 0x7f66e40eb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.891+0000 7f66f0e00640 1 -- 172.21.15.5:0/3658173868 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66e40e6c70 msgr2=0x7f66e404d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.891+0000 7f66f0e00640 1 --2- 172.21.15.5:0/3658173868 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66e40e6c70 0x7f66e404d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.891+0000 7f66f0e00640 1 -- 172.21.15.5:0/3658173868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e4033f70 msgr2=0x7f66e404d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.891+0000 7f66f0e00640 1 --2- 172.21.15.5:0/3658173868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e4033f70 0x7f66e404d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.891+0000 7f66f0e00640 1 -- 172.21.15.5:0/3658173868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec04c200 con 0x7f66e4006880 2024-08-17T02:23:43.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.892+0000 7f66f0e00640 1 --2- 172.21.15.5:0/3658173868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e4006880 0x7f66e40eb6e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f66d800c4b0 tx=0x7f66d8007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:43.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.889+0000 7fb9fac00640 1 -- 172.21.15.5:0/2686630391 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ec03c1d0 con 0x7fb9ec0e6330 2024-08-17T02:23:43.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.889+0000 7fb9fac00640 1 -- 172.21.15.5:0/2686630391 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ec03c790 con 0x7fb9ec0e6330 2024-08-17T02:23:43.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.891+0000 7fb9fac00640 1 -- 172.21.15.5:0/2686630391 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ec0e34d0 con 0x7fb9ec0e6330 2024-08-17T02:23:43.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.892+0000 7f66dfe00640 1 -- 172.21.15.5:0/3658173868 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8011590 con 0x7f66e4006880 2024-08-17T02:23:43.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.895+0000 7f66f2200640 1 -- 172.21.15.5:0/3658173868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e404e8e0 con 0x7f66e4006880 2024-08-17T02:23:43.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.895+0000 7f66f2200640 1 -- 172.21.15.5:0/3658173868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e404df10 con 0x7f66e4006880 2024-08-17T02:23:43.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.895+0000 7f66dfe00640 1 -- 172.21.15.5:0/3658173868 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d80116f0 con 0x7f66e4006880 2024-08-17T02:23:43.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.895+0000 7f66dfe00640 1 -- 172.21.15.5:0/3658173868 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8011ab0 con 0x7f66e4006880 2024-08-17T02:23:43.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.898+0000 7f66f2200640 1 -- 172.21.15.5:0/3658173868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c8005210 con 0x7f66e4006880 2024-08-17T02:23:43.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.898+0000 7fb9f0c00640 1 -- 172.21.15.5:0/2686630391 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb9e003ead0 con 0x7fb9ec0e6330 2024-08-17T02:23:43.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.900+0000 7fb9f0c00640 1 --2- 172.21.15.5:0/2686630391 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb9d40652a0 0x7fb9d4067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.900+0000 7fb9f0c00640 1 -- 172.21.15.5:0/2686630391 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb9e00a3290 con 0x7fb9ec0e6330 2024-08-17T02:23:43.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.899+0000 7f66dfe00640 1 -- 172.21.15.5:0/3658173868 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f66d801b3b0 con 0x7f66e4006880 2024-08-17T02:23:43.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.901+0000 7f66dfe00640 1 --2- 172.21.15.5:0/3658173868 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f66cc0652d0 0x7f66cc067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.901+0000 7f66dfe00640 1 -- 172.21.15.5:0/3658173868 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f66d80816d0 con 0x7f66e4006880 2024-08-17T02:23:43.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.903+0000 7fb9f0c00640 1 -- 172.21.15.5:0/2686630391 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb9e0071460 con 0x7fb9ec0e6330 2024-08-17T02:23:43.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.903+0000 7fb9f9800640 1 --2- 172.21.15.5:0/2686630391 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb9d40652a0 0x7fb9d4067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.905+0000 7f66ebe00640 1 --2- 172.21.15.5:0/3658173868 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f66cc0652d0 0x7f66cc067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.910+0000 7f66dfe00640 1 -- 172.21.15.5:0/3658173868 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f66d804f820 con 0x7f66e4006880 2024-08-17T02:23:43.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.910+0000 7f66ebe00640 1 --2- 172.21.15.5:0/3658173868 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f66cc0652d0 0x7f66cc067780 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f66ec071a20 tx=0x7f66ec0ab000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.911+0000 7fb9f9800640 1 --2- 172.21.15.5:0/2686630391 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb9d40652a0 0x7fb9d4067750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4060af0 tx=0x7fb9f4064990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:43.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.961+0000 7f95e6000640 1 Processor -- start 2024-08-17T02:23:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.961+0000 7f7a80200640 1 Processor -- start 2024-08-17T02:23:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.961+0000 7f7a80200640 1 -- start start 2024-08-17T02:23:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.961+0000 7f95e6000640 1 -- start start 2024-08-17T02:23:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.963+0000 7f95e6000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95d80e6c70 0x7f95d80e7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.963+0000 7f95e6000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95d8033f70 0x7f95d804fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.963+0000 7f95e6000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d80503c0 con 0x7f95d8006880 2024-08-17T02:23:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.963+0000 7f95e6000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d8007850 con 0x7f95d80e6c70 2024-08-17T02:23:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.963+0000 7f95e6000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d8006d00 con 0x7f95d8033f70 2024-08-17T02:23:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.963+0000 7f7a80200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a780ac620 0x7f7a780c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.964+0000 7f7a80200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7806e400 con 0x7f7a7815cf40 2024-08-17T02:23:43.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.964+0000 7f7a80200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a780af5a0 con 0x7f7a7815d310 2024-08-17T02:23:43.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.964+0000 7f7a80200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780ae990 con 0x7f7a780ac620 2024-08-17T02:23:43.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.964+0000 7fe59a800640 1 Processor -- start 2024-08-17T02:23:43.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.963+0000 7f14d5c00640 1 Processor -- start 2024-08-17T02:23:43.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.963+0000 7f14d5c00640 1 -- start start 2024-08-17T02:23:43.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.965+0000 7f7a7d800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7a7815cf40 0x7f7a780abf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49342/0 (socket says 172.21.15.5:49342) 2024-08-17T02:23:43.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.965+0000 7f7a7d800640 1 -- 172.21.15.5:0/2753795700 learned_addr learned my addr 172.21.15.5:0/2753795700 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:43.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.965+0000 7fe59a800640 1 -- start start 2024-08-17T02:23:43.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.965+0000 7f7a7ce00640 1 --2- 172.21.15.5:0/2753795700 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a780ac620 0x7f7a780c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.966+0000 7f14d5c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d015d200 0x7f14d00cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.965+0000 7f95dfe00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f95d8006880 0x7f95d8033860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:45118/0 (socket says 172.21.15.5:45118) 2024-08-17T02:23:43.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.966+0000 7f14d5c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14d00d03b0 0x7f14d00cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.966+0000 7f14d5c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d00cc8d0 con 0x7f14d015d5d0 2024-08-17T02:23:43.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.966+0000 7f14d5c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d00cd550 con 0x7f14d00d03b0 2024-08-17T02:23:43.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.966+0000 7f7a77e00640 1 -- 172.21.15.5:0/2753795700 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000927043 0 0) 0x7f7a780af5a0 con 0x7f7a7815d310 2024-08-17T02:23:43.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.966+0000 7f14d5c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d00ccbb0 con 0x7f14d015d200 2024-08-17T02:23:43.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.966+0000 7f7a77e00640 1 -- 172.21.15.5:0/2753795700 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a5c0034e0 con 0x7f7a7815d310 2024-08-17T02:23:43.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.966+0000 7f14cea00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d015d200 0x7f14d00cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.966+0000 7f14cea00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d015d200 0x7f14d00cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:34066/0 (socket says 172.21.15.5:34066) 2024-08-17T02:23:43.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.966+0000 7f14cea00640 1 -- 172.21.15.5:0/2018256776 learned_addr learned my addr 172.21.15.5:0/2018256776 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:43.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.966+0000 7f14cf400640 1 --2- 172.21.15.5:0/2018256776 >> v2:172.21.15.5:3300/0 conn(0x7f14d00d03b0 0x7f14d00cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.966+0000 7f95e4c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95d80e6c70 0x7f95d80e7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.966+0000 7f95dfe00640 1 -- 172.21.15.5:0/353205298 learned_addr learned my addr 172.21.15.5:0/353205298 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:43.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.967+0000 7f95df400640 1 -- 172.21.15.5:0/353205298 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796192473 0 0) 0x7f95cc001110 con 0x7f95d8006880 2024-08-17T02:23:43.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.967+0000 7f95df400640 1 -- 172.21.15.5:0/353205298 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95c80034e0 con 0x7f95d8006880 2024-08-17T02:23:43.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.967+0000 7f95e5600640 1 --2- 172.21.15.5:0/353205298 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95d8033f70 0x7f95d804fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.967+0000 7fe59a800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe59415d200 0x7fe5940cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.967+0000 7fe59a800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe5940d03b0 0x7fe5940cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.967+0000 7f14cea00640 1 -- 172.21.15.5:0/2018256776 >> v2:172.21.15.5:3300/0 conn(0x7f14d00d03b0 msgr2=0x7f14d00cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.967+0000 7f95df400640 1 -- 172.21.15.5:0/353205298 <== mon.1 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3811284718 0 0) 0x7f95c80034e0 con 0x7f95d8006880 2024-08-17T02:23:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.967+0000 7f95df400640 1 -- 172.21.15.5:0/353205298 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95d8033f70 msgr2=0x7f95d804fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.967+0000 7fe592a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe59415d5d0 0x7fe5940cfca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49348/0 (socket says 172.21.15.5:49348) 2024-08-17T02:23:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.967+0000 7f14cea00640 1 --2- 172.21.15.5:0/2018256776 >> v2:172.21.15.5:3300/0 conn(0x7f14d00d03b0 0x7f14d00cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7f6413400640 1 Processor -- start 2024-08-17T02:23:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.966+0000 7f7a7ce00640 1 -- 172.21.15.5:0/2753795700 >> v1:172.21.15.87:6789/0 conn(0x7f7a7815d310 legacy=0x7f7a780afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.966+0000 7f7a7ce00640 1 -- 172.21.15.5:0/2753795700 >> v1:172.21.15.5:6789/0 conn(0x7f7a7815cf40 legacy=0x7f7a780abf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.966+0000 7f7a7ce00640 1 -- 172.21.15.5:0/2753795700 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a780aec70 con 0x7f7a780ac620 2024-08-17T02:23:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7f95df400640 1 --2- 172.21.15.5:0/353205298 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95d8033f70 0x7f95d804fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7f95df400640 1 -- 172.21.15.5:0/353205298 >> v2:172.21.15.5:3300/0 conn(0x7f95d80e6c70 msgr2=0x7f95d80e7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7f95df400640 1 --2- 172.21.15.5:0/353205298 >> v2:172.21.15.5:3300/0 conn(0x7f95d80e6c70 0x7f95d80e7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7f95df400640 1 -- 172.21.15.5:0/353205298 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d8006fb0 con 0x7f95d8006880 2024-08-17T02:23:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7f95df400640 1 -- 172.21.15.5:0/353205298 <== mon.1 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2658686246 0 0) 0x7f95cc001600 con 0x7f95d8006880 2024-08-17T02:23:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7f95df400640 1 -- 172.21.15.5:0/353205298 >> v1:172.21.15.87:6789/0 conn(0x7f95d8006880 legacy=0x7f95d8033860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7f95df400640 1 --2- 172.21.15.5:0/353205298 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95c8003a50 0x7f95c8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7f95df400640 1 --2- 172.21.15.5:0/353205298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c8004780 0x7f95c8004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7f95df400640 1 --2- 172.21.15.5:0/353205298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95c80051a0 0x7f95c800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7f95df400640 1 -- 172.21.15.5:0/353205298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d8007850 con 0x7f95c8004780 2024-08-17T02:23:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7f95df400640 1 -- 172.21.15.5:0/353205298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d8006d00 con 0x7f95c80051a0 2024-08-17T02:23:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7f95df400640 1 -- 172.21.15.5:0/353205298 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c800c1d0 con 0x7f95c8003a50 2024-08-17T02:23:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.967+0000 7f14cea00640 1 -- 172.21.15.5:0/2018256776 >> v1:172.21.15.87:6789/0 conn(0x7f14d015d5d0 legacy=0x7f14d00cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:43.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.967+0000 7f14cea00640 1 -- 172.21.15.5:0/2018256776 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d00cce90 con 0x7f14d015d200 2024-08-17T02:23:43.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7fe592a00640 1 -- 172.21.15.5:0/2284602546 learned_addr learned my addr 172.21.15.5:0/2284602546 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:43.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7fe59a800640 1 -- 172.21.15.5:0/2284602546 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5940cc8d0 con 0x7fe59415d5d0 2024-08-17T02:23:43.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7fe59a800640 1 -- 172.21.15.5:0/2284602546 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5940cd550 con 0x7fe5940d03b0 2024-08-17T02:23:43.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7fe59a800640 1 -- 172.21.15.5:0/2284602546 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940ccbb0 con 0x7fe59415d200 2024-08-17T02:23:43.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7fe593e00640 1 --2- 172.21.15.5:0/2284602546 >> v2:172.21.15.5:3300/0 conn(0x7fe5940d03b0 0x7fe5940cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7f95dfe00640 1 --2- 172.21.15.5:0/353205298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c8004780 0x7f95c8004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7f95e4c00640 1 --2- 172.21.15.5:0/353205298 >> v2:172.21.15.5:3300/0 conn(0x7f95d80e6c70 0x7f95d80e7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.969+0000 7f95e4c00640 1 --2- 172.21.15.5:0/353205298 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95c8003a50 0x7f95c8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.969+0000 7fe593400640 1 --2- 172.21.15.5:0/2284602546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe59415d200 0x7fe5940cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.969+0000 7f7a7ce00640 1 --2- 172.21.15.5:0/2753795700 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a780ac620 0x7f7a780c7fc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7a70009e90 tx=0x7f7a70009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73466253d6ab26c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:43.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.969+0000 7fe593e00640 1 -- 172.21.15.5:0/2284602546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe59415d200 msgr2=0x7fe5940cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:43.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.970+0000 7fe593e00640 1 --2- 172.21.15.5:0/2284602546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe59415d200 0x7fe5940cc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.970+0000 7fe593e00640 1 -- 172.21.15.5:0/2284602546 >> v1:172.21.15.5:6789/0 conn(0x7fe59415d5d0 legacy=0x7fe5940cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.970+0000 7f7a77e00640 1 -- 172.21.15.5:0/2753795700 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70007550 con 0x7f7a780ac620 2024-08-17T02:23:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.970+0000 7fe593e00640 1 -- 172.21.15.5:0/2284602546 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5940cce90 con 0x7fe5940d03b0 2024-08-17T02:23:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.970+0000 7f7a77e00640 1 -- 172.21.15.5:0/2753795700 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7002d050 con 0x7f7a780ac620 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.968+0000 7f6413400640 1 -- start start 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.970+0000 7f6413400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f640c14fe00 0x7f640c0cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.970+0000 7f6413400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c0cdef0 con 0x7f640c0d0320 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.970+0000 7f6413400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c0ccf10 con 0x7f640c0cca30 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.970+0000 7f6413400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640c0af8e0 con 0x7f640c14fe00 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.970+0000 7f7a77e00640 1 -- 172.21.15.5:0/2753795700 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a700078e0 con 0x7f7a780ac620 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.970+0000 7f7a80200640 1 -- 172.21.15.5:0/2753795700 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a780ac620 msgr2=0x7f7a780c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.970+0000 7f7a80200640 1 --2- 172.21.15.5:0/2753795700 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a780ac620 0x7f7a780c7fc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7a70009e90 tx=0x7f7a70009780 comp rx=0 tx=0).stop 2024-08-17T02:23:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.969+0000 7f95e5600640 1 --2- 172.21.15.5:0/353205298 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95d8033f70 0x7f95d804fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.969+0000 7f95dfe00640 1 -- 172.21.15.5:0/353205298 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95c8003a50 msgr2=0x7f95c8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.969+0000 7f95dfe00640 1 --2- 172.21.15.5:0/353205298 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95c8003a50 0x7f95c8003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.969+0000 7f95dfe00640 1 -- 172.21.15.5:0/353205298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95c80051a0 msgr2=0x7f95c800b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:23:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.969+0000 7f95dfe00640 1 --2- 172.21.15.5:0/353205298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95c80051a0 0x7f95c800b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.969+0000 7f95dfe00640 1 -- 172.21.15.5:0/353205298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d8006fb0 con 0x7f95c8004780 2024-08-17T02:23:43.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.971+0000 7f640be00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f640c0cca30 0x7f640c0cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:45144/0 (socket says 172.21.15.5:45144) 2024-08-17T02:23:43.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.971+0000 7f640be00640 1 -- 172.21.15.5:0/3716540709 learned_addr learned my addr 172.21.15.5:0/3716540709 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:43.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.971+0000 7f6410a00640 1 --2- 172.21.15.5:0/3716540709 >> v2:172.21.15.5:3300/0 conn(0x7f640c14fe00 0x7f640c0cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.972+0000 7fe593e00640 1 --2- 172.21.15.5:0/2284602546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5940d03b0 0x7fe5940cdfa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe580009850 tx=0x7fe5800090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d3f3bfdb02ce3d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:43.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.972+0000 7f7a80200640 1 -- 172.21.15.5:0/2753795700 shutdown_connections 2024-08-17T02:23:43.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.972+0000 7f7a80200640 1 --2- 172.21.15.5:0/2753795700 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a780ac620 0x7f7a780c7fc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.972+0000 7f7a80200640 1 -- 172.21.15.5:0/2753795700 >> 172.21.15.5:0/2753795700 conn(0x7f7a78066e60 msgr2=0x7f7a78067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:43.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.972+0000 7f95dfe00640 1 --2- 172.21.15.5:0/353205298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c8004780 0x7f95c8004bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c490 tx=0x7f95cc0079c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a326f27c17a41c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:43.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.972+0000 7fe592000640 1 -- 172.21.15.5:0/2284602546 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58002ad90 con 0x7fe5940d03b0 2024-08-17T02:23:43.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.972+0000 7fe592000640 1 -- 172.21.15.5:0/2284602546 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe580032440 con 0x7fe5940d03b0 2024-08-17T02:23:43.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.972+0000 7f640b400640 1 -- 172.21.15.5:0/3716540709 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184318822 0 0) 0x7f640c0ccf10 con 0x7f640c0cca30 2024-08-17T02:23:43.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.972+0000 7f640b400640 1 -- 172.21.15.5:0/3716540709 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63f00034e0 con 0x7f640c0cca30 2024-08-17T02:23:43.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.972+0000 7f640b400640 1 -- 172.21.15.5:0/3716540709 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722604 0 0) 0x7f640c0cdef0 con 0x7f640c0d0320 2024-08-17T02:23:43.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.972+0000 7f640b400640 1 -- 172.21.15.5:0/3716540709 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f640c0ccf10 con 0x7f640c0d0320 2024-08-17T02:23:43.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.973+0000 7f1693400640 1 Processor -- start 2024-08-17T02:23:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.973+0000 7f14cea00640 1 --2- 172.21.15.5:0/2018256776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d015d200 0x7f14d00cc2d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009910 tx=0x7f14c00091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c6cf50398e154f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.973+0000 7f7a80200640 1 -- 172.21.15.5:0/2753795700 shutdown_connections 2024-08-17T02:23:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.973+0000 7f7a80200640 1 -- 172.21.15.5:0/2753795700 wait complete. 2024-08-17T02:23:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.972+0000 7fe592000640 1 -- 172.21.15.5:0/2284602546 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58002ad90 con 0x7fe5940d03b0 2024-08-17T02:23:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.973+0000 7f1693400640 1 -- start start 2024-08-17T02:23:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.972+0000 7f640b400640 1 -- 172.21.15.5:0/3716540709 <== mon.1 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4224994092 0 0) 0x7f63f00034e0 con 0x7f640c0cca30 2024-08-17T02:23:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.972+0000 7f640b400640 1 -- 172.21.15.5:0/3716540709 >> v2:172.21.15.5:3300/0 conn(0x7f640c14fe00 msgr2=0x7f640c0cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.973+0000 7f95df400640 1 -- 172.21.15.5:0/353205298 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc005890 con 0x7f95c8004780 2024-08-17T02:23:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.973+0000 7f95df400640 1 -- 172.21.15.5:0/353205298 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc0059f0 con 0x7f95c8004780 2024-08-17T02:23:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.973+0000 7f95df400640 1 -- 172.21.15.5:0/353205298 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc005df0 con 0x7f95c8004780 2024-08-17T02:23:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.973+0000 7f14cd600640 1 -- 172.21.15.5:0/2018256776 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c002adb0 con 0x7f14d015d200 2024-08-17T02:23:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.973+0000 7f14cd600640 1 -- 172.21.15.5:0/2018256776 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c0032440 con 0x7f14d015d200 2024-08-17T02:23:43.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.973+0000 7f14cd600640 1 -- 172.21.15.5:0/2018256776 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0032820 con 0x7f14d015d200 2024-08-17T02:23:43.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.973+0000 7fe59a800640 1 -- 172.21.15.5:0/2284602546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5940d03b0 msgr2=0x7fe5940cdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.973+0000 7fe59a800640 1 --2- 172.21.15.5:0/2284602546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5940d03b0 0x7fe5940cdfa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe580009850 tx=0x7fe5800090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.974+0000 7fe59a800640 1 -- 172.21.15.5:0/2284602546 shutdown_connections 2024-08-17T02:23:43.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.974+0000 7fe59a800640 1 --2- 172.21.15.5:0/2284602546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5940d03b0 0x7fe5940cdfa0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.974+0000 7fe59a800640 1 --2- 172.21.15.5:0/2284602546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe59415d200 0x7fe5940cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.974+0000 7fe59a800640 1 -- 172.21.15.5:0/2284602546 >> 172.21.15.5:0/2284602546 conn(0x7fe594068680 msgr2=0x7fe594068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.974+0000 7f95e6000640 1 -- 172.21.15.5:0/353205298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c8004780 msgr2=0x7f95c8004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.974+0000 7f14d5c00640 1 -- 172.21.15.5:0/2018256776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d015d200 msgr2=0x7f14d00cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.974+0000 7f14d5c00640 1 --2- 172.21.15.5:0/2018256776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d015d200 0x7f14d00cc2d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009910 tx=0x7f14c00091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.975+0000 7f95e6000640 1 --2- 172.21.15.5:0/353205298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c8004780 0x7f95c8004bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c490 tx=0x7f95cc0079c0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.975+0000 7f14d5c00640 1 -- 172.21.15.5:0/2018256776 shutdown_connections 2024-08-17T02:23:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.975+0000 7f14d5c00640 1 --2- 172.21.15.5:0/2018256776 >> v2:172.21.15.5:3300/0 conn(0x7f14d00d03b0 0x7f14d00cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.975+0000 7f14d5c00640 1 --2- 172.21.15.5:0/2018256776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d015d200 0x7f14d00cc2d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.975+0000 7f14d5c00640 1 -- 172.21.15.5:0/2018256776 >> 172.21.15.5:0/2018256776 conn(0x7f14d0068680 msgr2=0x7f14d0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.975+0000 7f95e5600640 1 -- 172.21.15.5:0/353205298 reap_dead start 2024-08-17T02:23:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.974+0000 7fe59a800640 1 -- 172.21.15.5:0/2284602546 shutdown_connections 2024-08-17T02:23:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.974+0000 7fe59a800640 1 -- 172.21.15.5:0/2284602546 wait complete. 2024-08-17T02:23:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.975+0000 7f95e6000640 1 -- 172.21.15.5:0/353205298 shutdown_connections 2024-08-17T02:23:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.975+0000 7f95e6000640 1 -- 172.21.15.5:0/353205298 >> 172.21.15.5:0/353205298 conn(0x7f95d8054b90 msgr2=0x7f95d8054f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.975+0000 7f1693400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f168c0ae860 0x7f168c06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.975+0000 7f1693400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168c0aed90 con 0x7f168c158a20 2024-08-17T02:23:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.975+0000 7f1693400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168c0af070 con 0x7f168c158df0 2024-08-17T02:23:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.975+0000 7f95e6000640 1 -- 172.21.15.5:0/353205298 shutdown_connections 2024-08-17T02:23:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.975+0000 7f640b400640 1 --2- 172.21.15.5:0/3716540709 >> v2:172.21.15.5:3300/0 conn(0x7f640c14fe00 0x7f640c0cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.976+0000 7f168be00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f168c0ae860 0x7f168c06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.976+0000 7f168be00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f168c0ae860 0x7f168c06d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:34094/0 (socket says 172.21.15.5:34094) 2024-08-17T02:23:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.976+0000 7f168be00640 1 -- 172.21.15.5:0/619383381 learned_addr learned my addr 172.21.15.5:0/619383381 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.975+0000 7f640b400640 1 -- 172.21.15.5:0/3716540709 >> v1:172.21.15.5:6789/0 conn(0x7f640c0d0320 legacy=0x7f640c0ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.975+0000 7f640b400640 1 -- 172.21.15.5:0/3716540709 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c0cdba0 con 0x7f640c0cca30 2024-08-17T02:23:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.976+0000 7f640b400640 1 -- 172.21.15.5:0/3716540709 <== mon.1 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2658686246 0 0) 0x7f63fc001470 con 0x7f640c0cca30 2024-08-17T02:23:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.976+0000 7f640b400640 1 -- 172.21.15.5:0/3716540709 >> v1:172.21.15.87:6789/0 conn(0x7f640c0cca30 legacy=0x7f640c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.976+0000 7f640b400640 1 --2- 172.21.15.5:0/3716540709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63f0004c90 0x7f63f0005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.976+0000 7f640b400640 1 --2- 172.21.15.5:0/3716540709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63f0003720 0x7f63f0003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.976+0000 7f640b400640 1 --2- 172.21.15.5:0/3716540709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63f00042d0 0x7f63f000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.976+0000 7f640b400640 1 -- 172.21.15.5:0/3716540709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6404001460 con 0x7f63f00042d0 2024-08-17T02:23:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.976+0000 7f640b400640 1 -- 172.21.15.5:0/3716540709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c0af8e0 con 0x7f63f0003720 2024-08-17T02:23:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.976+0000 7f640b400640 1 -- 172.21.15.5:0/3716540709 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f0014b80 con 0x7f63f0004c90 2024-08-17T02:23:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.975+0000 7f7a80200640 1 Processor -- start 2024-08-17T02:23:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.976+0000 7f14d5c00640 1 -- 172.21.15.5:0/2018256776 shutdown_connections 2024-08-17T02:23:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.975+0000 7f1693400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0af350 con 0x7f168c0ae860 2024-08-17T02:23:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.977+0000 7f14d5c00640 1 -- 172.21.15.5:0/2018256776 wait complete. 2024-08-17T02:23:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.977+0000 7f7a80200640 1 -- start start 2024-08-17T02:23:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.976+0000 7f95e6000640 1 -- 172.21.15.5:0/353205298 wait complete. 2024-08-17T02:23:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.977+0000 7f168be00640 1 -- 172.21.15.5:0/619383381 >> v1:172.21.15.87:6789/0 conn(0x7f168c158df0 legacy=0x7f168c0afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.977+0000 7f168be00640 1 -- 172.21.15.5:0/619383381 >> v1:172.21.15.5:6789/0 conn(0x7f168c158a20 legacy=0x7f168c0a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.976+0000 7f6410a00640 1 --2- 172.21.15.5:0/3716540709 >> v2:172.21.15.5:3300/0 conn(0x7f640c14fe00 0x7f640c0cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.976+0000 7f640be00640 1 --2- 172.21.15.5:0/3716540709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63f0003720 0x7f63f0003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.977+0000 7f6410a00640 1 --2- 172.21.15.5:0/3716540709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63f0004c90 0x7f63f0005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.977+0000 7f168be00640 1 -- 172.21.15.5:0/619383381 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c0af630 con 0x7f168c0ae860 2024-08-17T02:23:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.977+0000 7fe59a800640 1 Processor -- start 2024-08-17T02:23:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.977+0000 7f6411400640 1 --2- 172.21.15.5:0/3716540709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63f00042d0 0x7f63f000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.978+0000 7f6411400640 1 -- 172.21.15.5:0/3716540709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63f0004c90 msgr2=0x7f63f0005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.978+0000 7f6411400640 1 --2- 172.21.15.5:0/3716540709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63f0004c90 0x7f63f0005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.978+0000 7f6411400640 1 -- 172.21.15.5:0/3716540709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63f0003720 msgr2=0x7f63f0003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.978+0000 7f6411400640 1 --2- 172.21.15.5:0/3716540709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63f0003720 0x7f63f0003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.978+0000 7f6411400640 1 -- 172.21.15.5:0/3716540709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f00034e0 con 0x7f63f00042d0 2024-08-17T02:23:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.977+0000 7fe59a800640 1 -- start start 2024-08-17T02:23:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.979+0000 7f14d5c00640 1 Processor -- start 2024-08-17T02:23:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.979+0000 7f7a80200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a780ac620 0x7f7a7814d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.979+0000 7f7a80200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a7815cf40 0x7f7a780a6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.979+0000 7f7a80200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7815d310 0x7f7a781598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7f7a80200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780a6ff0 con 0x7f7a780ac620 2024-08-17T02:23:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7f7a80200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780a72d0 con 0x7f7a7815d310 2024-08-17T02:23:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7f7a80200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780a75b0 con 0x7f7a7815cf40 2024-08-17T02:23:44.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7f7a7d800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a780ac620 0x7f7a7814d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7f6411400640 1 -- 172.21.15.5:0/3716540709 reap_dead start 2024-08-17T02:23:44.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7fe59a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5940d03b0 0x7fe594157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7fe59a800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe59415d200 0x7fe59414fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7f6411400640 1 --2- 172.21.15.5:0/3716540709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63f00042d0 0x7f63f000ba10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f640400c230 tx=0x7f640402a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749024bdf47998bb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7fe59a800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe59415d5d0 0x7fe594154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7f95e6000640 1 Processor -- start 2024-08-17T02:23:44.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7f640b400640 1 -- 172.21.15.5:0/3716540709 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6404034070 con 0x7f63f00042d0 2024-08-17T02:23:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7f640b400640 1 -- 172.21.15.5:0/3716540709 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6404030420 con 0x7f63f00042d0 2024-08-17T02:23:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7f640b400640 1 -- 172.21.15.5:0/3716540709 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640402c040 con 0x7f63f00042d0 2024-08-17T02:23:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7f14d5c00640 1 -- start start 2024-08-17T02:23:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7fe593400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5940d03b0 0x7fe594157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7fe592a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe59415d200 0x7fe59414fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7fe592a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe59415d200 0x7fe59414fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:34122/0 (socket says 172.21.15.5:34122) 2024-08-17T02:23:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7fe593400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5940d03b0 0x7fe594157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44156/0 (socket says 172.21.15.5:44156) 2024-08-17T02:23:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.981+0000 7f95e6000640 1 -- start start 2024-08-17T02:23:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.981+0000 7fe592a00640 1 -- 172.21.15.5:0/3320578107 learned_addr learned my addr 172.21.15.5:0/3320578107 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7f168be00640 1 --2- 172.21.15.5:0/619383381 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f168c0ae860 0x7f168c06d7d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1678009940 tx=0x7f16780091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7240d1b7b20f42fb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.981+0000 7fe59a800640 1 -- 172.21.15.5:0/3320578107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe594155a00 con 0x7fe5940d03b0 2024-08-17T02:23:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.981+0000 7fe59a800640 1 -- 172.21.15.5:0/3320578107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe594158410 con 0x7fe59415d5d0 2024-08-17T02:23:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.981+0000 7fe593e00640 1 --2- 172.21.15.5:0/3320578107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe59415d5d0 0x7fe594154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.981+0000 7fe59a800640 1 -- 172.21.15.5:0/3320578107 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe594153da0 con 0x7fe59415d200 2024-08-17T02:23:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7f7a7ce00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a7815cf40 0x7f7a780a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7f7a7e200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7815d310 0x7f7a781598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7f7a7ce00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a7815cf40 0x7f7a780a6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:34116/0 (socket says 172.21.15.5:34116) 2024-08-17T02:23:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.980+0000 7f7a7ce00640 1 -- 172.21.15.5:0/3439718716 learned_addr learned my addr 172.21.15.5:0/3439718716 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.981+0000 7f7a7d800640 1 -- 172.21.15.5:0/3439718716 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a7815cf40 msgr2=0x7f7a780a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.981+0000 7f7a7d800640 1 --2- 172.21.15.5:0/3439718716 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a7815cf40 0x7f7a780a6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.981+0000 7f7a7d800640 1 -- 172.21.15.5:0/3439718716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7815d310 msgr2=0x7f7a781598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.981+0000 7f7a7d800640 1 --2- 172.21.15.5:0/3439718716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7815d310 0x7f7a781598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.981+0000 7f7a7d800640 1 -- 172.21.15.5:0/3439718716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a70009a20 con 0x7f7a780ac620 2024-08-17T02:23:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.981+0000 7f7a7d800640 1 --2- 172.21.15.5:0/3439718716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a780ac620 0x7f7a7814d750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7a6400c7e0 tx=0x7f7a64007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.981+0000 7f7a74c00640 1 -- 172.21.15.5:0/3439718716 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64005870 con 0x7f7a780ac620 2024-08-17T02:23:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.982+0000 7f7a74c00640 1 -- 172.21.15.5:0/3439718716 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a640059d0 con 0x7f7a780ac620 2024-08-17T02:23:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.982+0000 7f7a74c00640 1 -- 172.21.15.5:0/3439718716 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64005db0 con 0x7f7a780ac620 2024-08-17T02:23:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.982+0000 7f7a80200640 1 -- 172.21.15.5:0/3439718716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a780a7890 con 0x7f7a780ac620 2024-08-17T02:23:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.981+0000 7f6413400640 1 -- 172.21.15.5:0/3716540709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63f00042d0 msgr2=0x7f63f000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.981+0000 7f6413400640 1 --2- 172.21.15.5:0/3716540709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63f00042d0 0x7f63f000ba10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f640400c230 tx=0x7f640402a900 comp rx=0 tx=0).stop 2024-08-17T02:23:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.982+0000 7f168b400640 1 -- 172.21.15.5:0/619383381 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167802ae40 con 0x7f168c0ae860 2024-08-17T02:23:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.982+0000 7fe593400640 1 -- 172.21.15.5:0/3320578107 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe59415d200 msgr2=0x7fe59414fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.983+0000 7fe593400640 1 --2- 172.21.15.5:0/3320578107 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe59415d200 0x7fe59414fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.982+0000 7f168b400640 1 -- 172.21.15.5:0/619383381 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1678032440 con 0x7f168c0ae860 2024-08-17T02:23:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.982+0000 7f168b400640 1 -- 172.21.15.5:0/619383381 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1678032820 con 0x7f168c0ae860 2024-08-17T02:23:44.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.983+0000 7fe593400640 1 -- 172.21.15.5:0/3320578107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe59415d5d0 msgr2=0x7fe594154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.983+0000 7fe593400640 1 --2- 172.21.15.5:0/3320578107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe59415d5d0 0x7fe594154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.983+0000 7f1693400640 1 -- 172.21.15.5:0/619383381 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f168c0ae860 msgr2=0x7f168c06d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.983+0000 7f1693400640 1 --2- 172.21.15.5:0/619383381 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f168c0ae860 0x7f168c06d7d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1678009940 tx=0x7f16780091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.983+0000 7f6413400640 1 -- 172.21.15.5:0/3716540709 shutdown_connections 2024-08-17T02:23:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.983+0000 7f6413400640 1 --2- 172.21.15.5:0/3716540709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63f00042d0 0x7f63f000ba10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.983+0000 7f6413400640 1 -- 172.21.15.5:0/3716540709 >> 172.21.15.5:0/3716540709 conn(0x7f640c068680 msgr2=0x7f640c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:44.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.982+0000 7f7a80200640 1 -- 172.21.15.5:0/3439718716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a780a6bc0 con 0x7f7a780ac620 2024-08-17T02:23:44.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.983+0000 7fe593400640 1 -- 172.21.15.5:0/3320578107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe580009390 con 0x7fe5940d03b0 2024-08-17T02:23:44.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.983+0000 7f6413400640 1 -- 172.21.15.5:0/3716540709 shutdown_connections 2024-08-17T02:23:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.983+0000 7f14d5c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d00d03b0 0x7f14d016d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f14d5c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d015d200 0x7f14d014c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f95e6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c8004780 0x7f95d8032dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f95e6000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95d8033300 0x7f95d804dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f95e6000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95d804e020 0x7f95d80d7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f95e6000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d80c8130 con 0x7f95c8004780 2024-08-17T02:23:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f95e6000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d804e510 con 0x7f95d804e020 2024-08-17T02:23:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f95e6000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d80c7a70 con 0x7f95d8033300 2024-08-17T02:23:44.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7fe593e00640 1 --2- 172.21.15.5:0/3320578107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe59415d5d0 0x7fe594154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:44.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7fe593400640 1 --2- 172.21.15.5:0/3320578107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5940d03b0 0x7fe594157c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe58c007f60 tx=0x7fe58c009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f14d5c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d015d5d0 0x7f14d0156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f1693400640 1 -- 172.21.15.5:0/619383381 shutdown_connections 2024-08-17T02:23:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f1693400640 1 --2- 172.21.15.5:0/619383381 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f168c0ae860 0x7f168c06d7d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f1693400640 1 -- 172.21.15.5:0/619383381 >> 172.21.15.5:0/619383381 conn(0x7f168c066e60 msgr2=0x7f168c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f95e4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c8004780 0x7f95d8032dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f95e4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c8004780 0x7f95d8032dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44186/0 (socket says 172.21.15.5:44186) 2024-08-17T02:23:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f95e4c00640 1 -- 172.21.15.5:0/3569553540 learned_addr learned my addr 172.21.15.5:0/3569553540 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.985+0000 7f95e5600640 1 --2- 172.21.15.5:0/3569553540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95d804e020 0x7f95d80d7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f14d5c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d016ea10 con 0x7f14d00d03b0 2024-08-17T02:23:44.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f14d5c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d00b3d90 con 0x7f14d015d200 2024-08-17T02:23:44.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f14d5c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d00c9cb0 con 0x7f14d015d5d0 2024-08-17T02:23:44.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f1693400640 1 -- 172.21.15.5:0/619383381 shutdown_connections 2024-08-17T02:23:44.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.985+0000 7f1693400640 1 -- 172.21.15.5:0/619383381 wait complete. 2024-08-17T02:23:44.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.985+0000 7f14cf400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d015d5d0 0x7f14d0156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.985+0000 7f14cf400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d015d5d0 0x7f14d0156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:34134/0 (socket says 172.21.15.5:34134) 2024-08-17T02:23:44.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.985+0000 7f14cf400640 1 -- 172.21.15.5:0/4226585140 learned_addr learned my addr 172.21.15.5:0/4226585140 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:44.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f14cea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d00d03b0 0x7f14d016d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.985+0000 7f95dfe00640 1 --2- 172.21.15.5:0/3569553540 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95d8033300 0x7f95d804dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.986+0000 7f14ce000640 1 --2- 172.21.15.5:0/4226585140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d015d200 0x7f14d014c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.986+0000 7f14cf400640 1 -- 172.21.15.5:0/4226585140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d015d200 msgr2=0x7f14d014c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.985+0000 7f95e4c00640 1 -- 172.21.15.5:0/3569553540 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95d8033300 msgr2=0x7f95d804dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.985+0000 7f95e4c00640 1 --2- 172.21.15.5:0/3569553540 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95d8033300 0x7f95d804dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.985+0000 7f95e4c00640 1 -- 172.21.15.5:0/3569553540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95d804e020 msgr2=0x7f95d80d7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.985+0000 7f95e4c00640 1 --2- 172.21.15.5:0/3569553540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95d804e020 0x7f95d80d7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.985+0000 7f95e4c00640 1 -- 172.21.15.5:0/3569553540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d80c7d50 con 0x7f95c8004780 2024-08-17T02:23:44.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.986+0000 7f14cf400640 1 --2- 172.21.15.5:0/4226585140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d015d200 0x7f14d014c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.986+0000 7f14cf400640 1 -- 172.21.15.5:0/4226585140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d00d03b0 msgr2=0x7f14d016d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.986+0000 7f14cf400640 1 --2- 172.21.15.5:0/4226585140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d00d03b0 0x7f14d016d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.986+0000 7f14cf400640 1 -- 172.21.15.5:0/4226585140 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c0009450 con 0x7f14d015d5d0 2024-08-17T02:23:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.986+0000 7fe58aa00640 1 -- 172.21.15.5:0/3320578107 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c00ee30 con 0x7fe5940d03b0 2024-08-17T02:23:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.986+0000 7fe58aa00640 1 -- 172.21.15.5:0/3320578107 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c014420 con 0x7fe5940d03b0 2024-08-17T02:23:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.986+0000 7fe58aa00640 1 -- 172.21.15.5:0/3320578107 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c0147c0 con 0x7fe5940d03b0 2024-08-17T02:23:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.984+0000 7f6413400640 1 -- 172.21.15.5:0/3716540709 wait complete. 2024-08-17T02:23:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.986+0000 7f14ce000640 1 --2- 172.21.15.5:0/4226585140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d015d200 0x7f14d014c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.986+0000 7f14cf400640 1 --2- 172.21.15.5:0/4226585140 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d015d5d0 0x7f14d0156670 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009ef0 tx=0x7f14c800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.986+0000 7fe59a800640 1 -- 172.21.15.5:0/3320578107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe594158190 con 0x7fe5940d03b0 2024-08-17T02:23:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.986+0000 7f7a74c00640 1 -- 172.21.15.5:0/3439718716 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7a64007300 con 0x7f7a780ac620 2024-08-17T02:23:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.986+0000 7f7a80200640 1 -- 172.21.15.5:0/3439718716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a78063fb0 con 0x7f7a780ac620 2024-08-17T02:23:44.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.987+0000 7f95e4c00640 1 --2- 172.21.15.5:0/3569553540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c8004780 0x7f95d8032dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f95d400f6b0 tx=0x7f95d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.986+0000 7fe59a800640 1 -- 172.21.15.5:0/3320578107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe594154310 con 0x7fe5940d03b0 2024-08-17T02:23:44.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.987+0000 7f6413400640 1 Processor -- start 2024-08-17T02:23:44.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.988+0000 7f14c6000640 1 -- 172.21.15.5:0/4226585140 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c800ce10 con 0x7f14d015d5d0 2024-08-17T02:23:44.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.988+0000 7fe59a800640 1 -- 172.21.15.5:0/3320578107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe594154690 con 0x7fe5940d03b0 2024-08-17T02:23:44.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.988+0000 7f1693400640 1 Processor -- start 2024-08-17T02:23:44.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.988+0000 7f1693400640 1 -- start start 2024-08-17T02:23:44.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.988+0000 7f14c6000640 1 -- 172.21.15.5:0/4226585140 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c800f040 con 0x7f14d015d5d0 2024-08-17T02:23:44.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.988+0000 7f14c6000640 1 -- 172.21.15.5:0/4226585140 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c80146d0 con 0x7f14d015d5d0 2024-08-17T02:23:44.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.988+0000 7f14d5c00640 1 -- 172.21.15.5:0/4226585140 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d016de00 con 0x7f14d015d5d0 2024-08-17T02:23:44.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.988+0000 7f14d5c00640 1 -- 172.21.15.5:0/4226585140 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d016e3c0 con 0x7f14d015d5d0 2024-08-17T02:23:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.987+0000 7f7a74c00640 1 --2- 172.21.15.5:0/3439718716 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7a58065220 0x7f7a580676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.988+0000 7f7a7ce00640 1 --2- 172.21.15.5:0/3439718716 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7a58065220 0x7f7a580676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.989+0000 7f7a74c00640 1 -- 172.21.15.5:0/3439718716 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a64081fc0 con 0x7f7a780ac620 2024-08-17T02:23:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.989+0000 7f7a7ce00640 1 --2- 172.21.15.5:0/3439718716 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7a58065220 0x7f7a580676d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7a7815bbb0 tx=0x7f7a70037000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.988+0000 7f6413400640 1 -- start start 2024-08-17T02:23:44.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.989+0000 7f6413400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63f00042d0 0x7f640c14af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.990+0000 7f14d5c00640 1 -- 172.21.15.5:0/4226585140 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a8005210 con 0x7f14d015d5d0 2024-08-17T02:23:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.989+0000 7f6413400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f640c145050 0x7f640c1447d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.989+0000 7f6413400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f640c14d510 0x7f640c14d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.989+0000 7f6413400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c0b47e0 con 0x7f640c145050 2024-08-17T02:23:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.989+0000 7f6413400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c0b3c10 con 0x7f640c14d510 2024-08-17T02:23:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.989+0000 7f6413400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640c1458e0 con 0x7f63f00042d0 2024-08-17T02:23:44.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.990+0000 7f1693400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f168c0ae860 0x7f168c14fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.990+0000 7f1693400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f168c158a20 0x7f168c0ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.990+0000 7f1693400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f168c158df0 0x7f168c1591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f168be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f168c158a20 0x7f168c0ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f168be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f168c158a20 0x7f168c0ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:56742/0 (socket says 172.21.15.5:56742) 2024-08-17T02:23:44.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f168be00640 1 -- 172.21.15.5:0/1351029406 learned_addr learned my addr 172.21.15.5:0/1351029406 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:44.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f1693400640 1 -- 172.21.15.5:0/1351029406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0ad3c0 con 0x7f168c158df0 2024-08-17T02:23:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f1693400640 1 -- 172.21.15.5:0/1351029406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0ad6a0 con 0x7f168c158a20 2024-08-17T02:23:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f1693400640 1 -- 172.21.15.5:0/1351029406 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c1542b0 con 0x7f168c0ae860 2024-08-17T02:23:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f1690a00640 1 --2- 172.21.15.5:0/1351029406 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f168c0ae860 0x7f168c14fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f1691400640 1 --2- 172.21.15.5:0/1351029406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f168c158df0 0x7f168c1591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f6411400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f640c14d510 0x7f640c14d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f6410a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63f00042d0 0x7f640c14af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f6410a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63f00042d0 0x7f640c14af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:34150/0 (socket says 172.21.15.5:34150) 2024-08-17T02:23:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f6410a00640 1 -- 172.21.15.5:0/3308890901 learned_addr learned my addr 172.21.15.5:0/3308890901 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f640be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f640c145050 0x7f640c1447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f168be00640 1 -- 172.21.15.5:0/1351029406 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f168c0ae860 msgr2=0x7f168c14fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f168be00640 1 --2- 172.21.15.5:0/1351029406 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f168c0ae860 0x7f168c14fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f168be00640 1 -- 172.21.15.5:0/1351029406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f168c158df0 msgr2=0x7f168c1591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f168be00640 1 --2- 172.21.15.5:0/1351029406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f168c158df0 0x7f168c1591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f168be00640 1 -- 172.21.15.5:0/1351029406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1678009450 con 0x7f168c158a20 2024-08-17T02:23:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.992+0000 7f6411400640 1 -- 172.21.15.5:0/3308890901 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63f00042d0 msgr2=0x7f640c14af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.992+0000 7f6411400640 1 --2- 172.21.15.5:0/3308890901 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63f00042d0 0x7f640c14af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.992+0000 7f168be00640 1 --2- 172.21.15.5:0/1351029406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f168c158a20 0x7f168c0ada00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1678009940 tx=0x7f1678032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.992+0000 7f6411400640 1 -- 172.21.15.5:0/3308890901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f640c145050 msgr2=0x7f640c1447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.992+0000 7f6411400640 1 --2- 172.21.15.5:0/3308890901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f640c145050 0x7f640c1447d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.992+0000 7f6411400640 1 -- 172.21.15.5:0/3308890901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c0b3e90 con 0x7f640c14d510 2024-08-17T02:23:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.992+0000 7f6410a00640 1 --2- 172.21.15.5:0/3308890901 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63f00042d0 0x7f640c14af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.992+0000 7f167fe00640 1 -- 172.21.15.5:0/1351029406 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1678031a60 con 0x7f168c158a20 2024-08-17T02:23:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.992+0000 7f167fe00640 1 -- 172.21.15.5:0/1351029406 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1678031be0 con 0x7f168c158a20 2024-08-17T02:23:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.992+0000 7f167fe00640 1 -- 172.21.15.5:0/1351029406 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167803e450 con 0x7f168c158a20 2024-08-17T02:23:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.992+0000 7f1693400640 1 -- 172.21.15.5:0/1351029406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c154590 con 0x7f168c158a20 2024-08-17T02:23:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.991+0000 7f14c6000640 1 -- 172.21.15.5:0/4226585140 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f14c8014a80 con 0x7f14d015d5d0 2024-08-17T02:23:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.992+0000 7f14c6000640 1 --2- 172.21.15.5:0/4226585140 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14ac065220 0x7f14ac0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.993+0000 7f14c6000640 1 -- 172.21.15.5:0/4226585140 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14c80832c0 con 0x7f14d015d5d0 2024-08-17T02:23:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.993+0000 7f1693400640 1 -- 172.21.15.5:0/1351029406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168c0acf90 con 0x7f168c158a20 2024-08-17T02:23:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.993+0000 7f14cea00640 1 --2- 172.21.15.5:0/4226585140 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14ac065220 0x7f14ac0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.993+0000 7f6411400640 1 --2- 172.21.15.5:0/3308890901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f640c14d510 0x7f640c14d940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f640c15ca20 tx=0x7f6404034000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.994+0000 7f14cea00640 1 --2- 172.21.15.5:0/4226585140 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14ac065220 0x7f14ac0676d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14c0034000 tx=0x7f14c0032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.995+0000 7f6403e00640 1 -- 172.21.15.5:0/3308890901 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640402f690 con 0x7f640c14d510 2024-08-17T02:23:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.995+0000 7f6403e00640 1 -- 172.21.15.5:0/3308890901 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640402f7f0 con 0x7f640c14d510 2024-08-17T02:23:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.995+0000 7f6403e00640 1 -- 172.21.15.5:0/3308890901 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640402fb90 con 0x7f640c14d510 2024-08-17T02:23:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.995+0000 7f1693400640 1 -- 172.21.15.5:0/1351029406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168c0ad180 con 0x7f168c158a20 2024-08-17T02:23:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.995+0000 7f6413400640 1 -- 172.21.15.5:0/3308890901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640c0b4470 con 0x7f640c14d510 2024-08-17T02:23:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.995+0000 7f6413400640 1 -- 172.21.15.5:0/3308890901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640c144d10 con 0x7f640c14d510 2024-08-17T02:23:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.996+0000 7f6413400640 1 -- 172.21.15.5:0/3308890901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640c063fb0 con 0x7f640c14d510 2024-08-17T02:23:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.997+0000 7f95d3e00640 1 -- 172.21.15.5:0/3569553540 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d4014670 con 0x7f95c8004780 2024-08-17T02:23:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.997+0000 7f167fe00640 1 -- 172.21.15.5:0/1351029406 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f167803c400 con 0x7f168c158a20 2024-08-17T02:23:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.997+0000 7f95d3e00640 1 -- 172.21.15.5:0/3569553540 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d40147d0 con 0x7f95c8004780 2024-08-17T02:23:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.997+0000 7f95d3e00640 1 -- 172.21.15.5:0/3569553540 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d4014b70 con 0x7f95c8004780 2024-08-17T02:23:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.997+0000 7f95e6000640 1 -- 172.21.15.5:0/3569553540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d804cd60 con 0x7f95c8004780 2024-08-17T02:23:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.998+0000 7f95e6000640 1 -- 172.21.15.5:0/3569553540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d80d8520 con 0x7f95c8004780 2024-08-17T02:23:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.997+0000 7f6403e00640 1 -- 172.21.15.5:0/3308890901 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6404003050 con 0x7f640c14d510 2024-08-17T02:23:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.998+0000 7f14c6000640 1 -- 172.21.15.5:0/4226585140 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f14c8051420 con 0x7f14d015d5d0 2024-08-17T02:23:44.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.998+0000 7f6403e00640 1 --2- 172.21.15.5:0/3308890901 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f63ec0652a0 0x7f63ec067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.999+0000 7f6403e00640 1 -- 172.21.15.5:0/3308890901 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f640402c040 con 0x7f640c14d510 2024-08-17T02:23:44.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.999+0000 7f7a74c00640 1 -- 172.21.15.5:0/3439718716 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7a64050050 con 0x7f7a780ac620 2024-08-17T02:23:44.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.999+0000 7f95e6000640 1 -- 172.21.15.5:0/3569553540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d80c8270 con 0x7f95c8004780 2024-08-17T02:23:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.999+0000 7f167fe00640 1 --2- 172.21.15.5:0/1351029406 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f166c0652a0 0x7f166c067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:43.999+0000 7f167fe00640 1 -- 172.21.15.5:0/1351029406 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f167802ae40 con 0x7f168c158a20 2024-08-17T02:23:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.000+0000 7f6410a00640 1 --2- 172.21.15.5:0/3308890901 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f63ec0652a0 0x7f63ec067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.002+0000 7f6410a00640 1 --2- 172.21.15.5:0/3308890901 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f63ec0652a0 0x7f63ec067750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f63f80124e0 tx=0x7f63f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.001+0000 7f1690a00640 1 --2- 172.21.15.5:0/1351029406 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f166c0652a0 0x7f166c067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.002+0000 7fe58aa00640 1 -- 172.21.15.5:0/3320578107 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe58c014bf0 con 0x7fe5940d03b0 2024-08-17T02:23:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.002+0000 7f167fe00640 1 -- 172.21.15.5:0/1351029406 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f168c0ad180 con 0x7f168c158a20 2024-08-17T02:23:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.003+0000 7f1690a00640 1 --2- 172.21.15.5:0/1351029406 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f166c0652a0 0x7f166c067750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1680007fd0 tx=0x7f1680007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.003+0000 7fe58aa00640 1 --2- 172.21.15.5:0/3320578107 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe5740652a0 0x7fe574067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.004+0000 7fe58aa00640 1 -- 172.21.15.5:0/3320578107 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe58c0835a0 con 0x7fe5940d03b0 2024-08-17T02:23:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.004+0000 7fe592a00640 1 --2- 172.21.15.5:0/3320578107 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe5740652a0 0x7fe574067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.005+0000 7fe58aa00640 1 -- 172.21.15.5:0/3320578107 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe58c055210 con 0x7fe5940d03b0 2024-08-17T02:23:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.006+0000 7fe592a00640 1 --2- 172.21.15.5:0/3320578107 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe5740652a0 0x7fe574067750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe5941709a0 tx=0x7fe584009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.007+0000 7f6403e00640 1 -- 172.21.15.5:0/3308890901 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6404071320 con 0x7f640c14d510 2024-08-17T02:23:44.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.008+0000 7f95d3e00640 1 -- 172.21.15.5:0/3569553540 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f95d4028480 con 0x7f95c8004780 2024-08-17T02:23:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.009+0000 7f95d3e00640 1 --2- 172.21.15.5:0/3569553540 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f95c00652a0 0x7f95c0067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.009+0000 7f95d3e00640 1 -- 172.21.15.5:0/3569553540 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95d4082ca0 con 0x7f95c8004780 2024-08-17T02:23:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.010+0000 7f95dfe00640 1 --2- 172.21.15.5:0/3569553540 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f95c00652a0 0x7f95c0067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.011+0000 7f95dfe00640 1 --2- 172.21.15.5:0/3569553540 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f95c00652a0 0x7f95c0067750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f95cc033000 tx=0x7f95cc034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.017+0000 7f95d3e00640 1 -- 172.21.15.5:0/3569553540 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f95d4050df0 con 0x7f95c8004780 2024-08-17T02:23:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.312+0000 7fb9fac00640 1 -- 172.21.15.5:0/2686630391 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb9ec0056a0 con 0x7fb9ec0e6330 2024-08-17T02:23:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.313+0000 7fb9f0c00640 1 -- 172.21.15.5:0/2686630391 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb9e0074a80 con 0x7fb9ec0e6330 2024-08-17T02:23:44.314 INFO:teuthology.orchestra.run.smithi005.stdout:60129542149 2024-08-17T02:23:44.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.317+0000 7fb9fac00640 1 -- 172.21.15.5:0/2686630391 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb9d40652a0 msgr2=0x7fb9d4067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.317+0000 7fb9fac00640 1 --2- 172.21.15.5:0/2686630391 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb9d40652a0 0x7fb9d4067750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4060af0 tx=0x7fb9f4064990 comp rx=0 tx=0).stop 2024-08-17T02:23:44.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.318+0000 7fb9fac00640 1 -- 172.21.15.5:0/2686630391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9ec0e6330 msgr2=0x7fb9ec0daa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.318+0000 7fb9fac00640 1 --2- 172.21.15.5:0/2686630391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9ec0e6330 0x7fb9ec0daa50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0031000 tx=0x7fb9e0032000 comp rx=0 tx=0).stop 2024-08-17T02:23:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.318+0000 7fb9fac00640 1 -- 172.21.15.5:0/2686630391 shutdown_connections 2024-08-17T02:23:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.318+0000 7fb9fac00640 1 --2- 172.21.15.5:0/2686630391 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb9d40652a0 0x7fb9d4067750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.318+0000 7fb9fac00640 1 --2- 172.21.15.5:0/2686630391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9ec0e6330 0x7fb9ec0daa50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.318+0000 7fb9fac00640 1 --2- 172.21.15.5:0/2686630391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9ec0e22c0 0x7fb9ec0d49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.318+0000 7fb9fac00640 1 --2- 172.21.15.5:0/2686630391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9ec0e1ef0 0x7fb9ec039f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.318+0000 7fb9fac00640 1 -- 172.21.15.5:0/2686630391 >> 172.21.15.5:0/2686630391 conn(0x7fb9ec055a10 msgr2=0x7fb9ec057350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.319+0000 7fb9fac00640 1 -- 172.21.15.5:0/2686630391 shutdown_connections 2024-08-17T02:23:44.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.319+0000 7fb9fac00640 1 -- 172.21.15.5:0/2686630391 wait complete. 2024-08-17T02:23:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.321+0000 7f66f2200640 1 -- 172.21.15.5:0/3658173868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f66c80054c0 con 0x7f66e4006880 2024-08-17T02:23:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.322+0000 7f66dfe00640 1 -- 172.21.15.5:0/3658173868 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f66d8052e40 con 0x7f66e4006880 2024-08-17T02:23:44.323 INFO:teuthology.orchestra.run.smithi005.stdout:60129542148 2024-08-17T02:23:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.327+0000 7f66f2200640 1 -- 172.21.15.5:0/3658173868 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f66cc0652d0 msgr2=0x7f66cc067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.327+0000 7f66f2200640 1 --2- 172.21.15.5:0/3658173868 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f66cc0652d0 0x7f66cc067780 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f66ec071a20 tx=0x7f66ec0ab000 comp rx=0 tx=0).stop 2024-08-17T02:23:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.327+0000 7f66f2200640 1 -- 172.21.15.5:0/3658173868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e4006880 msgr2=0x7f66e40eb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.327+0000 7f66f2200640 1 --2- 172.21.15.5:0/3658173868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e4006880 0x7f66e40eb6e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f66d800c4b0 tx=0x7f66d8007e30 comp rx=0 tx=0).stop 2024-08-17T02:23:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.328+0000 7f66f2200640 1 -- 172.21.15.5:0/3658173868 shutdown_connections 2024-08-17T02:23:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.328+0000 7f66f2200640 1 --2- 172.21.15.5:0/3658173868 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f66cc0652d0 0x7f66cc067780 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.328+0000 7f66f2200640 1 --2- 172.21.15.5:0/3658173868 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66e40e6c70 0x7f66e404d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.328+0000 7f66f2200640 1 --2- 172.21.15.5:0/3658173868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e4033f70 0x7f66e404d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.329+0000 7f66f2200640 1 --2- 172.21.15.5:0/3658173868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e4006880 0x7f66e40eb6e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.329+0000 7f66f2200640 1 -- 172.21.15.5:0/3658173868 >> 172.21.15.5:0/3658173868 conn(0x7f66e4054b90 msgr2=0x7f66e4005670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.329+0000 7f66f2200640 1 -- 172.21.15.5:0/3658173868 shutdown_connections 2024-08-17T02:23:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.329+0000 7f66f2200640 1 -- 172.21.15.5:0/3658173868 wait complete. 2024-08-17T02:23:44.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-08-17T02:23:44.345 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:44.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.2 2024-08-17T02:23:44.357 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:44.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.379+0000 7f6413400640 1 -- 172.21.15.5:0/3308890901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f640c0c6b80 con 0x7f640c14d510 2024-08-17T02:23:44.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.380+0000 7f6403e00640 1 -- 172.21.15.5:0/3308890901 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6404074940 con 0x7f640c14d510 2024-08-17T02:23:44.381 INFO:teuthology.orchestra.run.smithi005.stdout:60129542149 2024-08-17T02:23:44.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.382+0000 7f14d5c00640 1 -- 172.21.15.5:0/4226585140 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f14a80054c0 con 0x7f14d015d5d0 2024-08-17T02:23:44.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.382+0000 7f6413400640 1 -- 172.21.15.5:0/3308890901 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f63ec0652a0 msgr2=0x7f63ec067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.382+0000 7f6413400640 1 --2- 172.21.15.5:0/3308890901 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f63ec0652a0 0x7f63ec067750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f63f80124e0 tx=0x7f63f8008040 comp rx=0 tx=0).stop 2024-08-17T02:23:44.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.382+0000 7f6413400640 1 -- 172.21.15.5:0/3308890901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f640c14d510 msgr2=0x7f640c14d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.382+0000 7f6413400640 1 --2- 172.21.15.5:0/3308890901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f640c14d510 0x7f640c14d940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f640c15ca20 tx=0x7f6404034000 comp rx=0 tx=0).stop 2024-08-17T02:23:44.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.382+0000 7f6413400640 1 -- 172.21.15.5:0/3308890901 shutdown_connections 2024-08-17T02:23:44.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.382+0000 7f6413400640 1 --2- 172.21.15.5:0/3308890901 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f63ec0652a0 0x7f63ec067750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.382+0000 7f6413400640 1 --2- 172.21.15.5:0/3308890901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f640c14d510 0x7f640c14d940 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.382+0000 7f6413400640 1 --2- 172.21.15.5:0/3308890901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f640c145050 0x7f640c1447d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.382+0000 7f6413400640 1 --2- 172.21.15.5:0/3308890901 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63f00042d0 0x7f640c14af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.382+0000 7f6413400640 1 -- 172.21.15.5:0/3308890901 >> 172.21.15.5:0/3308890901 conn(0x7f640c068680 msgr2=0x7f640c0b14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:44.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.382+0000 7f14c6000640 1 -- 172.21.15.5:0/4226585140 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f14c8054a40 con 0x7f14d015d5d0 2024-08-17T02:23:44.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.382+0000 7f6413400640 1 -- 172.21.15.5:0/3308890901 shutdown_connections 2024-08-17T02:23:44.385 INFO:teuthology.orchestra.run.smithi005.stdout:60129542149 2024-08-17T02:23:44.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.382+0000 7f6413400640 1 -- 172.21.15.5:0/3308890901 wait complete. 2024-08-17T02:23:44.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.385+0000 7f14d5c00640 1 -- 172.21.15.5:0/4226585140 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14ac065220 msgr2=0x7f14ac0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.385+0000 7f14d5c00640 1 --2- 172.21.15.5:0/4226585140 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14ac065220 0x7f14ac0676d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14c0034000 tx=0x7f14c0032000 comp rx=0 tx=0).stop 2024-08-17T02:23:44.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.385+0000 7f14d5c00640 1 -- 172.21.15.5:0/4226585140 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d015d5d0 msgr2=0x7f14d0156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.385+0000 7f14d5c00640 1 --2- 172.21.15.5:0/4226585140 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d015d5d0 0x7f14d0156670 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009ef0 tx=0x7f14c800b040 comp rx=0 tx=0).stop 2024-08-17T02:23:44.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.385+0000 7f14d5c00640 1 -- 172.21.15.5:0/4226585140 shutdown_connections 2024-08-17T02:23:44.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.385+0000 7f14d5c00640 1 --2- 172.21.15.5:0/4226585140 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14ac065220 0x7f14ac0676d0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14c0034000 tx=0x7f14c0032000 comp rx=0 tx=0).stop 2024-08-17T02:23:44.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.385+0000 7f14d5c00640 1 --2- 172.21.15.5:0/4226585140 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d015d5d0 0x7f14d0156670 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.385+0000 7f14d5c00640 1 --2- 172.21.15.5:0/4226585140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d015d200 0x7f14d014c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.385+0000 7f14d5c00640 1 --2- 172.21.15.5:0/4226585140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d00d03b0 0x7f14d016d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.385+0000 7f14d5c00640 1 -- 172.21.15.5:0/4226585140 >> 172.21.15.5:0/4226585140 conn(0x7f14d0068680 msgr2=0x7f14d00b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:44.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.385+0000 7f14d5c00640 1 -- 172.21.15.5:0/4226585140 shutdown_connections 2024-08-17T02:23:44.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.385+0000 7f14d5c00640 1 -- 172.21.15.5:0/4226585140 wait complete. 2024-08-17T02:23:44.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2024-08-17T02:23:44.401 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:44.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2024-08-17T02:23:44.402 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:44.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.420+0000 7f7a80200640 1 -- 172.21.15.5:0/3439718716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7a780accb0 con 0x7f7a780ac620 2024-08-17T02:23:44.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.421+0000 7f7a74c00640 1 -- 172.21.15.5:0/3439718716 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7a64053670 con 0x7f7a780ac620 2024-08-17T02:23:44.421 INFO:teuthology.orchestra.run.smithi005.stdout:60129542149 2024-08-17T02:23:44.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.422+0000 7f1693400640 1 -- 172.21.15.5:0/1351029406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f168c0ad180 con 0x7f168c158a20 2024-08-17T02:23:44.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.422+0000 7f167fe00640 1 -- 172.21.15.5:0/1351029406 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f168c0ad180 con 0x7f168c158a20 2024-08-17T02:23:44.423 INFO:teuthology.orchestra.run.smithi005.stdout:60129542149 2024-08-17T02:23:44.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.424+0000 7f7a80200640 1 -- 172.21.15.5:0/3439718716 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7a58065220 msgr2=0x7f7a580676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.424+0000 7f7a80200640 1 --2- 172.21.15.5:0/3439718716 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7a58065220 0x7f7a580676d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7a7815bbb0 tx=0x7f7a70037000 comp rx=0 tx=0).stop 2024-08-17T02:23:44.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.424+0000 7f7a80200640 1 -- 172.21.15.5:0/3439718716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a780ac620 msgr2=0x7f7a7814d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.424+0000 7f7a80200640 1 --2- 172.21.15.5:0/3439718716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a780ac620 0x7f7a7814d750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7a6400c7e0 tx=0x7f7a64007e10 comp rx=0 tx=0).stop 2024-08-17T02:23:44.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.424+0000 7f7a80200640 1 -- 172.21.15.5:0/3439718716 shutdown_connections 2024-08-17T02:23:44.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.424+0000 7f7a80200640 1 --2- 172.21.15.5:0/3439718716 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7a58065220 0x7f7a580676d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.424+0000 7f7a80200640 1 --2- 172.21.15.5:0/3439718716 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a7815cf40 0x7f7a780a6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.424+0000 7f7a80200640 1 --2- 172.21.15.5:0/3439718716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7815d310 0x7f7a781598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.424+0000 7f7a80200640 1 --2- 172.21.15.5:0/3439718716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a780ac620 0x7f7a7814d750 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.424+0000 7f7a80200640 1 -- 172.21.15.5:0/3439718716 >> 172.21.15.5:0/3439718716 conn(0x7f7a78066e60 msgr2=0x7f7a7815c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:44.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.424+0000 7f1693400640 1 -- 172.21.15.5:0/1351029406 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f166c0652a0 msgr2=0x7f166c067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.424+0000 7f1693400640 1 --2- 172.21.15.5:0/1351029406 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f166c0652a0 0x7f166c067750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1680007fd0 tx=0x7f1680007e30 comp rx=0 tx=0).stop 2024-08-17T02:23:44.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.424+0000 7f1693400640 1 -- 172.21.15.5:0/1351029406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f168c158a20 msgr2=0x7f168c0ada00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.424+0000 7f1693400640 1 --2- 172.21.15.5:0/1351029406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f168c158a20 0x7f168c0ada00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1678009940 tx=0x7f1678032000 comp rx=0 tx=0).stop 2024-08-17T02:23:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.425+0000 7f7a80200640 1 -- 172.21.15.5:0/3439718716 shutdown_connections 2024-08-17T02:23:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.425+0000 7f1693400640 1 -- 172.21.15.5:0/1351029406 shutdown_connections 2024-08-17T02:23:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.425+0000 7f1693400640 1 --2- 172.21.15.5:0/1351029406 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f166c0652a0 0x7f166c067750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.425+0000 7f1693400640 1 --2- 172.21.15.5:0/1351029406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f168c158df0 0x7f168c1591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.425+0000 7f1693400640 1 --2- 172.21.15.5:0/1351029406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f168c158a20 0x7f168c0ada00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.425+0000 7f1693400640 1 --2- 172.21.15.5:0/1351029406 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f168c0ae860 0x7f168c14fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.425+0000 7f1693400640 1 -- 172.21.15.5:0/1351029406 >> 172.21.15.5:0/1351029406 conn(0x7f168c066e60 msgr2=0x7f168c06aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:44.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.425+0000 7f7a80200640 1 -- 172.21.15.5:0/3439718716 wait complete. 2024-08-17T02:23:44.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.425+0000 7f1693400640 1 -- 172.21.15.5:0/1351029406 shutdown_connections 2024-08-17T02:23:44.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.425+0000 7f1693400640 1 -- 172.21.15.5:0/1351029406 wait complete. 2024-08-17T02:23:44.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.425+0000 7fe59a800640 1 -- 172.21.15.5:0/3320578107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe594154a00 con 0x7fe5940d03b0 2024-08-17T02:23:44.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.426+0000 7fe58aa00640 1 -- 172.21.15.5:0/3320578107 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe594154a00 con 0x7fe5940d03b0 2024-08-17T02:23:44.429 INFO:teuthology.orchestra.run.smithi005.stdout:60129542149 2024-08-17T02:23:44.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.428+0000 7fe59a800640 1 -- 172.21.15.5:0/3320578107 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe5740652a0 msgr2=0x7fe574067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.428+0000 7fe59a800640 1 --2- 172.21.15.5:0/3320578107 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe5740652a0 0x7fe574067750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe5941709a0 tx=0x7fe584009040 comp rx=0 tx=0).stop 2024-08-17T02:23:44.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.428+0000 7fe59a800640 1 -- 172.21.15.5:0/3320578107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5940d03b0 msgr2=0x7fe594157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.428+0000 7fe59a800640 1 --2- 172.21.15.5:0/3320578107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5940d03b0 0x7fe594157c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe58c007f60 tx=0x7fe58c009880 comp rx=0 tx=0).stop 2024-08-17T02:23:44.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.430+0000 7fe59a800640 1 -- 172.21.15.5:0/3320578107 shutdown_connections 2024-08-17T02:23:44.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.430+0000 7fe59a800640 1 --2- 172.21.15.5:0/3320578107 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe5740652a0 0x7fe574067750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.430+0000 7fe59a800640 1 --2- 172.21.15.5:0/3320578107 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe59415d200 0x7fe59414fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.430+0000 7fe59a800640 1 --2- 172.21.15.5:0/3320578107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe59415d5d0 0x7fe594154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.430+0000 7fe59a800640 1 --2- 172.21.15.5:0/3320578107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5940d03b0 0x7fe594157c50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.430+0000 7fe59a800640 1 -- 172.21.15.5:0/3320578107 >> 172.21.15.5:0/3320578107 conn(0x7fe594068680 msgr2=0x7fe5940af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:44.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.430+0000 7fe59a800640 1 -- 172.21.15.5:0/3320578107 shutdown_connections 2024-08-17T02:23:44.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.430+0000 7fe59a800640 1 -- 172.21.15.5:0/3320578107 wait complete. 2024-08-17T02:23:44.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.442+0000 7f95e6000640 1 -- 172.21.15.5:0/3569553540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f95d80c8270 con 0x7f95c8004780 2024-08-17T02:23:44.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.442+0000 7f95d3e00640 1 -- 172.21.15.5:0/3569553540 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f95d80c8270 con 0x7f95c8004780 2024-08-17T02:23:44.443 INFO:teuthology.orchestra.run.smithi005.stdout:60129542150 2024-08-17T02:23:44.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-08-17T02:23:44.444 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:44.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.445+0000 7f95e6000640 1 -- 172.21.15.5:0/3569553540 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f95c00652a0 msgr2=0x7f95c0067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.445+0000 7f95e6000640 1 --2- 172.21.15.5:0/3569553540 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f95c00652a0 0x7f95c0067750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f95cc033000 tx=0x7f95cc034000 comp rx=0 tx=0).stop 2024-08-17T02:23:44.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.445+0000 7f95e6000640 1 -- 172.21.15.5:0/3569553540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c8004780 msgr2=0x7f95d8032dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.445+0000 7f95e6000640 1 --2- 172.21.15.5:0/3569553540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c8004780 0x7f95d8032dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f95d400f6b0 tx=0x7f95d4008040 comp rx=0 tx=0).stop 2024-08-17T02:23:44.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.445+0000 7f95e6000640 1 -- 172.21.15.5:0/3569553540 shutdown_connections 2024-08-17T02:23:44.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.445+0000 7f95e6000640 1 --2- 172.21.15.5:0/3569553540 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f95c00652a0 0x7f95c0067750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.445+0000 7f95e6000640 1 --2- 172.21.15.5:0/3569553540 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95d8033300 0x7f95d804dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.445+0000 7f95e6000640 1 --2- 172.21.15.5:0/3569553540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95d804e020 0x7f95d80d7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.445+0000 7f95e6000640 1 --2- 172.21.15.5:0/3569553540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c8004780 0x7f95d8032dc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.445+0000 7f95e6000640 1 -- 172.21.15.5:0/3569553540 >> 172.21.15.5:0/3569553540 conn(0x7f95d8054b90 msgr2=0x7f95d804b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:44.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.445+0000 7f95e6000640 1 -- 172.21.15.5:0/3569553540 shutdown_connections 2024-08-17T02:23:44.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.445+0000 7f95e6000640 1 -- 172.21.15.5:0/3569553540 wait complete. 2024-08-17T02:23:44.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-08-17T02:23:44.449 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:44.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2024-08-17T02:23:44.449 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:44.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2024-08-17T02:23:44.462 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:44.462 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:23:44.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:23:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.653+0000 7fbf29a00640 1 Processor -- start 2024-08-17T02:23:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.653+0000 7fbf29a00640 1 -- start start 2024-08-17T02:23:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.654+0000 7fbf29a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbf240ad960 0x7fbf2415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.655+0000 7fbf29a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf2415b5e0 con 0x7fbf240add30 2024-08-17T02:23:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.655+0000 7fbf29a00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf240cb160 con 0x7fbf240ca050 2024-08-17T02:23:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.655+0000 7fbf29a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf240b0d10 con 0x7fbf240ad960 2024-08-17T02:23:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.655+0000 7fbf23400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbf240add30 0x7fbf240aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49380/0 (socket says 172.21.15.5:49380) 2024-08-17T02:23:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.655+0000 7fbf23400640 1 -- 172.21.15.5:0/2676715719 learned_addr learned my addr 172.21.15.5:0/2676715719 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.655+0000 7fbf22a00640 1 --2- 172.21.15.5:0/2676715719 >> v2:172.21.15.87:3300/0 conn(0x7fbf240ad960 0x7fbf2415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.655+0000 7fbf22000640 1 -- 172.21.15.5:0/2676715719 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402451455 0 0) 0x7fbf1c001490 con 0x7fbf240add30 2024-08-17T02:23:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.655+0000 7fbf22000640 1 -- 172.21.15.5:0/2676715719 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf080034e0 con 0x7fbf240add30 2024-08-17T02:23:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.656+0000 7fbf22a00640 1 -- 172.21.15.5:0/2676715719 >> v1:172.21.15.87:6789/0 conn(0x7fbf240ca050 legacy=0x7fbf24156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.656+0000 7fbf22a00640 1 -- 172.21.15.5:0/2676715719 >> v1:172.21.15.5:6789/0 conn(0x7fbf240add30 legacy=0x7fbf240aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.656+0000 7fbf22a00640 1 -- 172.21.15.5:0/2676715719 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf240ca550 con 0x7fbf240ad960 2024-08-17T02:23:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.657+0000 7fbf22a00640 1 --2- 172.21.15.5:0/2676715719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf240ad960 0x7fbf2415b0a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009850 tx=0x7fbf140090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16ba63ed7303c41e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.657+0000 7fbf22000640 1 -- 172.21.15.5:0/2676715719 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf14032440 con 0x7fbf240ad960 2024-08-17T02:23:44.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.657+0000 7fbf22000640 1 -- 172.21.15.5:0/2676715719 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf140325a0 con 0x7fbf240ad960 2024-08-17T02:23:44.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.657+0000 7fbf22000640 1 -- 172.21.15.5:0/2676715719 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf14032940 con 0x7fbf240ad960 2024-08-17T02:23:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.657+0000 7fbf29a00640 1 -- 172.21.15.5:0/2676715719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf240ad960 msgr2=0x7fbf2415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.657+0000 7fbf29a00640 1 --2- 172.21.15.5:0/2676715719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf240ad960 0x7fbf2415b0a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009850 tx=0x7fbf140090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.657+0000 7fbf29a00640 1 -- 172.21.15.5:0/2676715719 shutdown_connections 2024-08-17T02:23:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.657+0000 7fbf29a00640 1 --2- 172.21.15.5:0/2676715719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf240ad960 0x7fbf2415b0a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.657+0000 7fbf29a00640 1 -- 172.21.15.5:0/2676715719 >> 172.21.15.5:0/2676715719 conn(0x7fbf24066e60 msgr2=0x7fbf24067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.657+0000 7fbf29a00640 1 -- 172.21.15.5:0/2676715719 shutdown_connections 2024-08-17T02:23:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.658+0000 7fbf29a00640 1 -- 172.21.15.5:0/2676715719 wait complete. 2024-08-17T02:23:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.659+0000 7fbf29a00640 1 Processor -- start 2024-08-17T02:23:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.659+0000 7fbf29a00640 1 -- start start 2024-08-17T02:23:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.660+0000 7fbf29a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf240ad960 0x7fbf240a77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.660+0000 7fbf29a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf240add30 0x7fbf241433f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.660+0000 7fbf29a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf240ca050 0x7fbf240a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.660+0000 7fbf29a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf24143930 con 0x7fbf240ca050 2024-08-17T02:23:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.660+0000 7fbf29a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf240a46e0 con 0x7fbf240add30 2024-08-17T02:23:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.660+0000 7fbf29a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf240a4ca0 con 0x7fbf240ad960 2024-08-17T02:23:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.660+0000 7fbf23400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf240ca050 0x7fbf240a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.660+0000 7fbf23400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf240ca050 0x7fbf240a9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44212/0 (socket says 172.21.15.5:44212) 2024-08-17T02:23:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.660+0000 7fbf23400640 1 -- 172.21.15.5:0/4274067491 learned_addr learned my addr 172.21.15.5:0/4274067491 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.660+0000 7fbf22a00640 1 --2- 172.21.15.5:0/4274067491 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf240ad960 0x7fbf240a77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.660+0000 7fbf1be00640 1 --2- 172.21.15.5:0/4274067491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf240add30 0x7fbf241433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.660+0000 7fbf23400640 1 -- 172.21.15.5:0/4274067491 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf240ad960 msgr2=0x7fbf240a77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.660+0000 7fbf23400640 1 --2- 172.21.15.5:0/4274067491 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf240ad960 0x7fbf240a77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.660+0000 7fbf23400640 1 -- 172.21.15.5:0/4274067491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf240add30 msgr2=0x7fbf241433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.660+0000 7fbf23400640 1 --2- 172.21.15.5:0/4274067491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf240add30 0x7fbf241433f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.660+0000 7fbf23400640 1 -- 172.21.15.5:0/4274067491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf14009390 con 0x7fbf240ca050 2024-08-17T02:23:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.661+0000 7fbf23400640 1 --2- 172.21.15.5:0/4274067491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf240ca050 0x7fbf240a9b40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c00cd00 tx=0x7fbf1c001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.661+0000 7fbf1a000640 1 -- 172.21.15.5:0/4274067491 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c00a850 con 0x7fbf240ca050 2024-08-17T02:23:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.661+0000 7fbf1a000640 1 -- 172.21.15.5:0/4274067491 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1c00a9b0 con 0x7fbf240ca050 2024-08-17T02:23:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.661+0000 7fbf1a000640 1 -- 172.21.15.5:0/4274067491 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c00ad70 con 0x7fbf240ca050 2024-08-17T02:23:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.661+0000 7fbf29a00640 1 -- 172.21.15.5:0/4274067491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf240aa080 con 0x7fbf240ca050 2024-08-17T02:23:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.661+0000 7fbf29a00640 1 -- 172.21.15.5:0/4274067491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf240aa610 con 0x7fbf240ca050 2024-08-17T02:23:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.662+0000 7fbf29a00640 1 -- 172.21.15.5:0/4274067491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf24063fb0 con 0x7fbf240ca050 2024-08-17T02:23:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.663+0000 7fbf1a000640 1 -- 172.21.15.5:0/4274067491 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbf1c007300 con 0x7fbf240ca050 2024-08-17T02:23:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.664+0000 7fbf1a000640 1 --2- 172.21.15.5:0/4274067491 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fbf00065150 0x7fbf00067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.664+0000 7fbf1a000640 1 -- 172.21.15.5:0/4274067491 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf1c082580 con 0x7fbf240ca050 2024-08-17T02:23:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.664+0000 7fbf22a00640 1 --2- 172.21.15.5:0/4274067491 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fbf00065150 0x7fbf00067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.664+0000 7fbf22a00640 1 --2- 172.21.15.5:0/4274067491 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fbf00065150 0x7fbf00067600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbf14034000 tx=0x7fbf14032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.668+0000 7fbf1a000640 1 -- 172.21.15.5:0/4274067491 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbf1c050590 con 0x7fbf240ca050 2024-08-17T02:23:44.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.846+0000 7fbf29a00640 1 -- 172.21.15.5:0/4274067491 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf2415b5e0 con 0x7fbf00065150 2024-08-17T02:23:44.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.853+0000 7fbf1a000640 1 -- 172.21.15.5:0/4274067491 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264520 (secure 0 0 0) 0x7fbf2415b5e0 con 0x7fbf00065150 2024-08-17T02:23:44.857 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:44.858 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:23:44.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.857+0000 7fbf29a00640 1 -- 172.21.15.5:0/4274067491 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fbf00065150 msgr2=0x7fbf00067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.857+0000 7fbf29a00640 1 --2- 172.21.15.5:0/4274067491 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fbf00065150 0x7fbf00067600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbf14034000 tx=0x7fbf14032000 comp rx=0 tx=0).stop 2024-08-17T02:23:44.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.857+0000 7fbf29a00640 1 -- 172.21.15.5:0/4274067491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf240ca050 msgr2=0x7fbf240a9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:44.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.857+0000 7fbf29a00640 1 --2- 172.21.15.5:0/4274067491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf240ca050 0x7fbf240a9b40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c00cd00 tx=0x7fbf1c001ad0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.857+0000 7fbf29a00640 1 -- 172.21.15.5:0/4274067491 shutdown_connections 2024-08-17T02:23:44.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.857+0000 7fbf29a00640 1 --2- 172.21.15.5:0/4274067491 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fbf00065150 0x7fbf00067600 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.857+0000 7fbf29a00640 1 --2- 172.21.15.5:0/4274067491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf240ca050 0x7fbf240a9b40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.857+0000 7fbf29a00640 1 --2- 172.21.15.5:0/4274067491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf240add30 0x7fbf241433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.857+0000 7fbf29a00640 1 --2- 172.21.15.5:0/4274067491 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf240ad960 0x7fbf240a77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:44.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.857+0000 7fbf29a00640 1 -- 172.21.15.5:0/4274067491 >> 172.21.15.5:0/4274067491 conn(0x7fbf24066e60 msgr2=0x7fbf241523b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:44.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.857+0000 7fbf29a00640 1 -- 172.21.15.5:0/4274067491 shutdown_connections 2024-08-17T02:23:44.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:44.857+0000 7fbf29a00640 1 -- 172.21.15.5:0/4274067491 wait complete. 2024-08-17T02:23:44.872 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-08-17T02:23:44.722279+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398496,"kb_used_data":2984,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576224,"statfs":{"total":773094113280,"available":770638053376,"internally_reserved":0,"allocated":3055616,"data_stored":1814180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.154799"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596396+0000","last_change":"2024-08-17T02:23:35.589709+0000","last_active":"2024-08-17T02:23:35.596396+0000","last_peered":"2024-08-17T02:23:35.596396+0000","last_clean":"2024-08-17T02:23:35.596396+0000","last_became_active":"2024-08-17T02:23:35.589445+0000","last_became_peered":"2024-08-17T02:23:35.589445+0000","last_unstale":"2024-08-17T02:23:35.596396+0000","last_undegraded":"2024-08-17T02:23:35.596396+0000","last_fullsized":"2024-08-17T02:23:35.596396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:40.177968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.597886+0000","last_change":"2024-08-17T02:23:35.596541+0000","last_active":"2024-08-17T02:23:35.597886+0000","last_peered":"2024-08-17T02:23:35.597886+0000","last_clean":"2024-08-17T02:23:35.597886+0000","last_became_active":"2024-08-17T02:23:35.595984+0000","last_became_peered":"2024-08-17T02:23:35.595984+0000","last_unstale":"2024-08-17T02:23:35.597886+0000","last_undegraded":"2024-08-17T02:23:35.597886+0000","last_fullsized":"2024-08-17T02:23:35.597886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.592178+0000","last_change":"2024-08-17T02:23:35.589116+0000","last_active":"2024-08-17T02:23:35.592178+0000","last_peered":"2024-08-17T02:23:35.592178+0000","last_clean":"2024-08-17T02:23:35.592178+0000","last_became_active":"2024-08-17T02:23:35.588776+0000","last_became_peered":"2024-08-17T02:23:35.588776+0000","last_unstale":"2024-08-17T02:23:35.592178+0000","last_undegraded":"2024-08-17T02:23:35.592178+0000","last_fullsized":"2024-08-17T02:23:35.592178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604057+0000","last_change":"2024-08-17T02:23:35.597845+0000","last_active":"2024-08-17T02:23:35.604057+0000","last_peered":"2024-08-17T02:23:35.604057+0000","last_clean":"2024-08-17T02:23:35.604057+0000","last_became_active":"2024-08-17T02:23:35.593974+0000","last_became_peered":"2024-08-17T02:23:35.593974+0000","last_unstale":"2024-08-17T02:23:35.604057+0000","last_undegraded":"2024-08-17T02:23:35.604057+0000","last_fullsized":"2024-08-17T02:23:35.604057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:40.177968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596099+0000","last_change":"2024-08-17T02:23:35.592334+0000","last_active":"2024-08-17T02:23:35.596099+0000","last_peered":"2024-08-17T02:23:35.596099+0000","last_clean":"2024-08-17T02:23:35.596099+0000","last_became_active":"2024-08-17T02:23:35.591936+0000","last_became_peered":"2024-08-17T02:23:35.591936+0000","last_unstale":"2024-08-17T02:23:35.596099+0000","last_undegraded":"2024-08-17T02:23:35.596099+0000","last_fullsized":"2024-08-17T02:23:35.596099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:54:21.053209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605344+0000","last_change":"2024-08-17T02:23:35.601382+0000","last_active":"2024-08-17T02:23:35.605344+0000","last_peered":"2024-08-17T02:23:35.605344+0000","last_clean":"2024-08-17T02:23:35.605344+0000","last_became_active":"2024-08-17T02:23:35.600762+0000","last_became_peered":"2024-08-17T02:23:35.600762+0000","last_unstale":"2024-08-17T02:23:35.605344+0000","last_undegraded":"2024-08-17T02:23:35.605344+0000","last_fullsized":"2024-08-17T02:23:35.605344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:58.699491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.600889+0000","last_change":"2024-08-17T02:23:35.593406+0000","last_active":"2024-08-17T02:23:35.600889+0000","last_peered":"2024-08-17T02:23:35.600889+0000","last_clean":"2024-08-17T02:23:35.600889+0000","last_became_active":"2024-08-17T02:23:35.592939+0000","last_became_peered":"2024-08-17T02:23:35.592939+0000","last_unstale":"2024-08-17T02:23:35.600889+0000","last_undegraded":"2024-08-17T02:23:35.600889+0000","last_fullsized":"2024-08-17T02:23:35.600889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:58.163230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603257+0000","last_change":"2024-08-17T02:23:35.597151+0000","last_active":"2024-08-17T02:23:35.603257+0000","last_peered":"2024-08-17T02:23:35.603257+0000","last_clean":"2024-08-17T02:23:35.603257+0000","last_became_active":"2024-08-17T02:23:35.593461+0000","last_became_peered":"2024-08-17T02:23:35.593461+0000","last_unstale":"2024-08-17T02:23:35.603257+0000","last_undegraded":"2024-08-17T02:23:35.603257+0000","last_fullsized":"2024-08-17T02:23:35.603257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:04:25.119433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.601168+0000","last_change":"2024-08-17T02:23:35.598033+0000","last_active":"2024-08-17T02:23:35.601168+0000","last_peered":"2024-08-17T02:23:35.601168+0000","last_clean":"2024-08-17T02:23:35.601168+0000","last_became_active":"2024-08-17T02:23:35.595752+0000","last_became_peered":"2024-08-17T02:23:35.595752+0000","last_unstale":"2024-08-17T02:23:35.601168+0000","last_undegraded":"2024-08-17T02:23:35.601168+0000","last_fullsized":"2024-08-17T02:23:35.601168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:23:53.610539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.595948+0000","last_change":"2024-08-17T02:23:35.592023+0000","last_active":"2024-08-17T02:23:35.595948+0000","last_peered":"2024-08-17T02:23:35.595948+0000","last_clean":"2024-08-17T02:23:35.595948+0000","last_became_active":"2024-08-17T02:23:35.591200+0000","last_became_peered":"2024-08-17T02:23:35.591200+0000","last_unstale":"2024-08-17T02:23:35.595948+0000","last_undegraded":"2024-08-17T02:23:35.595948+0000","last_fullsized":"2024-08-17T02:23:35.595948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.600098+0000","last_change":"2024-08-17T02:23:35.596390+0000","last_active":"2024-08-17T02:23:35.600098+0000","last_peered":"2024-08-17T02:23:35.600098+0000","last_clean":"2024-08-17T02:23:35.600098+0000","last_became_active":"2024-08-17T02:23:35.596157+0000","last_became_peered":"2024-08-17T02:23:35.596157+0000","last_unstale":"2024-08-17T02:23:35.600098+0000","last_undegraded":"2024-08-17T02:23:35.600098+0000","last_fullsized":"2024-08-17T02:23:35.600098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.592637+0000","last_change":"2024-08-17T02:23:35.582359+0000","last_active":"2024-08-17T02:23:35.592637+0000","last_peered":"2024-08-17T02:23:35.592637+0000","last_clean":"2024-08-17T02:23:35.592637+0000","last_became_active":"2024-08-17T02:23:35.581946+0000","last_became_peered":"2024-08-17T02:23:35.581946+0000","last_unstale":"2024-08-17T02:23:35.592637+0000","last_undegraded":"2024-08-17T02:23:35.592637+0000","last_fullsized":"2024-08-17T02:23:35.592637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:27:42.753023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.590492+0000","last_change":"2024-08-17T02:23:35.587890+0000","last_active":"2024-08-17T02:23:35.590492+0000","last_peered":"2024-08-17T02:23:35.590492+0000","last_clean":"2024-08-17T02:23:35.590492+0000","last_became_active":"2024-08-17T02:23:35.585585+0000","last_became_peered":"2024-08-17T02:23:35.585585+0000","last_unstale":"2024-08-17T02:23:35.590492+0000","last_undegraded":"2024-08-17T02:23:35.590492+0000","last_fullsized":"2024-08-17T02:23:35.590492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603716+0000","last_change":"2024-08-17T02:23:35.596596+0000","last_active":"2024-08-17T02:23:35.603716+0000","last_peered":"2024-08-17T02:23:35.603716+0000","last_clean":"2024-08-17T02:23:35.603716+0000","last_became_active":"2024-08-17T02:23:35.596293+0000","last_became_peered":"2024-08-17T02:23:35.596293+0000","last_unstale":"2024-08-17T02:23:35.603716+0000","last_undegraded":"2024-08-17T02:23:35.603716+0000","last_fullsized":"2024-08-17T02:23:35.603716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:25:10.908502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.580252+0000","last_change":"2024-08-17T02:23:35.576127+0000","last_active":"2024-08-17T02:23:35.580252+0000","last_peered":"2024-08-17T02:23:35.580252+0000","last_clean":"2024-08-17T02:23:35.580252+0000","last_became_active":"2024-08-17T02:23:35.575812+0000","last_became_peered":"2024-08-17T02:23:35.575812+0000","last_unstale":"2024-08-17T02:23:35.580252+0000","last_undegraded":"2024-08-17T02:23:35.580252+0000","last_fullsized":"2024-08-17T02:23:35.580252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604727+0000","last_change":"2024-08-17T02:23:35.598920+0000","last_active":"2024-08-17T02:23:35.604727+0000","last_peered":"2024-08-17T02:23:35.604727+0000","last_clean":"2024-08-17T02:23:35.604727+0000","last_became_active":"2024-08-17T02:23:35.598446+0000","last_became_peered":"2024-08-17T02:23:35.598446+0000","last_unstale":"2024-08-17T02:23:35.604727+0000","last_undegraded":"2024-08-17T02:23:35.604727+0000","last_fullsized":"2024-08-17T02:23:35.604727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:44.471490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603819+0000","last_change":"2024-08-17T02:23:35.597673+0000","last_active":"2024-08-17T02:23:35.603819+0000","last_peered":"2024-08-17T02:23:35.603819+0000","last_clean":"2024-08-17T02:23:35.603819+0000","last_became_active":"2024-08-17T02:23:35.596284+0000","last_became_peered":"2024-08-17T02:23:35.596284+0000","last_unstale":"2024-08-17T02:23:35.603819+0000","last_undegraded":"2024-08-17T02:23:35.603819+0000","last_fullsized":"2024-08-17T02:23:35.603819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.586639+0000","last_change":"2024-08-17T02:23:35.581433+0000","last_active":"2024-08-17T02:23:35.586639+0000","last_peered":"2024-08-17T02:23:35.586639+0000","last_clean":"2024-08-17T02:23:35.586639+0000","last_became_active":"2024-08-17T02:23:35.581150+0000","last_became_peered":"2024-08-17T02:23:35.581150+0000","last_unstale":"2024-08-17T02:23:35.586639+0000","last_undegraded":"2024-08-17T02:23:35.586639+0000","last_fullsized":"2024-08-17T02:23:35.586639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:19:09.314565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596841+0000","last_change":"2024-08-17T02:23:35.590432+0000","last_active":"2024-08-17T02:23:35.596841+0000","last_peered":"2024-08-17T02:23:35.596841+0000","last_clean":"2024-08-17T02:23:35.596841+0000","last_became_active":"2024-08-17T02:23:35.590171+0000","last_became_peered":"2024-08-17T02:23:35.590171+0000","last_unstale":"2024-08-17T02:23:35.596841+0000","last_undegraded":"2024-08-17T02:23:35.596841+0000","last_fullsized":"2024-08-17T02:23:35.596841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:44.471490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.581293+0000","last_change":"2024-08-17T02:23:35.576756+0000","last_active":"2024-08-17T02:23:35.581293+0000","last_peered":"2024-08-17T02:23:35.581293+0000","last_clean":"2024-08-17T02:23:35.581293+0000","last_became_active":"2024-08-17T02:23:35.575447+0000","last_became_peered":"2024-08-17T02:23:35.575447+0000","last_unstale":"2024-08-17T02:23:35.581293+0000","last_undegraded":"2024-08-17T02:23:35.581293+0000","last_fullsized":"2024-08-17T02:23:35.581293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:53.414346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.598137+0000","last_change":"2024-08-17T02:23:35.592931+0000","last_active":"2024-08-17T02:23:35.598137+0000","last_peered":"2024-08-17T02:23:35.598137+0000","last_clean":"2024-08-17T02:23:35.598137+0000","last_became_active":"2024-08-17T02:23:35.592658+0000","last_became_peered":"2024-08-17T02:23:35.592658+0000","last_unstale":"2024-08-17T02:23:35.598137+0000","last_undegraded":"2024-08-17T02:23:35.598137+0000","last_fullsized":"2024-08-17T02:23:35.598137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:53.892837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604091+0000","last_change":"2024-08-17T02:23:35.597950+0000","last_active":"2024-08-17T02:23:35.604091+0000","last_peered":"2024-08-17T02:23:35.604091+0000","last_clean":"2024-08-17T02:23:35.604091+0000","last_became_active":"2024-08-17T02:23:35.597671+0000","last_became_peered":"2024-08-17T02:23:35.597671+0000","last_unstale":"2024-08-17T02:23:35.604091+0000","last_undegraded":"2024-08-17T02:23:35.604091+0000","last_fullsized":"2024-08-17T02:23:35.604091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:47.878023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603319+0000","last_change":"2024-08-17T02:23:35.598952+0000","last_active":"2024-08-17T02:23:35.603319+0000","last_peered":"2024-08-17T02:23:35.603319+0000","last_clean":"2024-08-17T02:23:35.603319+0000","last_became_active":"2024-08-17T02:23:35.598602+0000","last_became_peered":"2024-08-17T02:23:35.598602+0000","last_unstale":"2024-08-17T02:23:35.603319+0000","last_undegraded":"2024-08-17T02:23:35.603319+0000","last_fullsized":"2024-08-17T02:23:35.603319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:16.596695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604477+0000","last_change":"2024-08-17T02:23:35.594022+0000","last_active":"2024-08-17T02:23:35.604477+0000","last_peered":"2024-08-17T02:23:35.604477+0000","last_clean":"2024-08-17T02:23:35.604477+0000","last_became_active":"2024-08-17T02:23:35.593747+0000","last_became_peered":"2024-08-17T02:23:35.593747+0000","last_unstale":"2024-08-17T02:23:35.604477+0000","last_undegraded":"2024-08-17T02:23:35.604477+0000","last_fullsized":"2024-08-17T02:23:35.604477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:30.865202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605226+0000","last_change":"2024-08-17T02:23:35.601823+0000","last_active":"2024-08-17T02:23:35.605226+0000","last_peered":"2024-08-17T02:23:35.605226+0000","last_clean":"2024-08-17T02:23:35.605226+0000","last_became_active":"2024-08-17T02:23:35.594672+0000","last_became_peered":"2024-08-17T02:23:35.594672+0000","last_unstale":"2024-08-17T02:23:35.605226+0000","last_undegraded":"2024-08-17T02:23:35.605226+0000","last_fullsized":"2024-08-17T02:23:35.605226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:30.865202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596800+0000","last_change":"2024-08-17T02:23:35.594464+0000","last_active":"2024-08-17T02:23:35.596800+0000","last_peered":"2024-08-17T02:23:35.596800+0000","last_clean":"2024-08-17T02:23:35.596800+0000","last_became_active":"2024-08-17T02:23:35.594132+0000","last_became_peered":"2024-08-17T02:23:35.594132+0000","last_unstale":"2024-08-17T02:23:35.596800+0000","last_undegraded":"2024-08-17T02:23:35.596800+0000","last_fullsized":"2024-08-17T02:23:35.596800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:16.596695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.587445+0000","last_change":"2024-08-17T02:23:35.584046+0000","last_active":"2024-08-17T02:23:35.587445+0000","last_peered":"2024-08-17T02:23:35.587445+0000","last_clean":"2024-08-17T02:23:35.587445+0000","last_became_active":"2024-08-17T02:23:35.583501+0000","last_became_peered":"2024-08-17T02:23:35.583501+0000","last_unstale":"2024-08-17T02:23:35.587445+0000","last_undegraded":"2024-08-17T02:23:35.587445+0000","last_fullsized":"2024-08-17T02:23:35.587445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603996+0000","last_change":"2024-08-17T02:23:35.601673+0000","last_active":"2024-08-17T02:23:35.603996+0000","last_peered":"2024-08-17T02:23:35.603996+0000","last_clean":"2024-08-17T02:23:35.603996+0000","last_became_active":"2024-08-17T02:23:35.600053+0000","last_became_peered":"2024-08-17T02:23:35.600053+0000","last_unstale":"2024-08-17T02:23:35.603996+0000","last_undegraded":"2024-08-17T02:23:35.603996+0000","last_fullsized":"2024-08-17T02:23:35.603996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603669+0000","last_change":"2024-08-17T02:23:35.596895+0000","last_active":"2024-08-17T02:23:35.603669+0000","last_peered":"2024-08-17T02:23:35.603669+0000","last_clean":"2024-08-17T02:23:35.603669+0000","last_became_active":"2024-08-17T02:23:35.596357+0000","last_became_peered":"2024-08-17T02:23:35.596357+0000","last_unstale":"2024-08-17T02:23:35.603669+0000","last_undegraded":"2024-08-17T02:23:35.603669+0000","last_fullsized":"2024-08-17T02:23:35.603669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:16.596695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604107+0000","last_change":"2024-08-17T02:23:35.598186+0000","last_active":"2024-08-17T02:23:35.604107+0000","last_peered":"2024-08-17T02:23:35.604107+0000","last_clean":"2024-08-17T02:23:35.604107+0000","last_became_active":"2024-08-17T02:23:35.597916+0000","last_became_peered":"2024-08-17T02:23:35.597916+0000","last_unstale":"2024-08-17T02:23:35.604107+0000","last_undegraded":"2024-08-17T02:23:35.604107+0000","last_fullsized":"2024-08-17T02:23:35.604107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:58.163230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.595983+0000","last_change":"2024-08-17T02:23:35.592760+0000","last_active":"2024-08-17T02:23:35.595983+0000","last_peered":"2024-08-17T02:23:35.595983+0000","last_clean":"2024-08-17T02:23:35.595983+0000","last_became_active":"2024-08-17T02:23:35.592422+0000","last_became_peered":"2024-08-17T02:23:35.592422+0000","last_unstale":"2024-08-17T02:23:35.595983+0000","last_undegraded":"2024-08-17T02:23:35.595983+0000","last_fullsized":"2024-08-17T02:23:35.595983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:14.018866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604612+0000","last_change":"2024-08-17T02:23:35.597586+0000","last_active":"2024-08-17T02:23:35.604612+0000","last_peered":"2024-08-17T02:23:35.604612+0000","last_clean":"2024-08-17T02:23:35.604612+0000","last_became_active":"2024-08-17T02:23:35.597307+0000","last_became_peered":"2024-08-17T02:23:35.597307+0000","last_unstale":"2024-08-17T02:23:35.604612+0000","last_undegraded":"2024-08-17T02:23:35.604612+0000","last_fullsized":"2024-08-17T02:23:35.604612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596676+0000","last_change":"2024-08-17T02:23:35.590260+0000","last_active":"2024-08-17T02:23:35.596676+0000","last_peered":"2024-08-17T02:23:35.596676+0000","last_clean":"2024-08-17T02:23:35.596676+0000","last_became_active":"2024-08-17T02:23:35.585495+0000","last_became_peered":"2024-08-17T02:23:35.585495+0000","last_unstale":"2024-08-17T02:23:35.596676+0000","last_undegraded":"2024-08-17T02:23:35.596676+0000","last_fullsized":"2024-08-17T02:23:35.596676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:21.900954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.608774+0000","last_change":"2024-08-17T02:23:34.577323+0000","last_active":"2024-08-17T02:23:35.608774+0000","last_peered":"2024-08-17T02:23:35.608774+0000","last_clean":"2024-08-17T02:23:35.608774+0000","last_became_active":"2024-08-17T02:23:34.577034+0000","last_became_peered":"2024-08-17T02:23:34.577034+0000","last_unstale":"2024-08-17T02:23:35.608774+0000","last_undegraded":"2024-08-17T02:23:35.608774+0000","last_fullsized":"2024-08-17T02:23:35.608774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:29.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603650+0000","last_change":"2024-08-17T02:23:35.596697+0000","last_active":"2024-08-17T02:23:35.603650+0000","last_peered":"2024-08-17T02:23:35.603650+0000","last_clean":"2024-08-17T02:23:35.603650+0000","last_became_active":"2024-08-17T02:23:35.595923+0000","last_became_peered":"2024-08-17T02:23:35.595923+0000","last_unstale":"2024-08-17T02:23:35.603650+0000","last_undegraded":"2024-08-17T02:23:35.603650+0000","last_fullsized":"2024-08-17T02:23:35.603650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:08:23.329877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.613478+0000","last_change":"2024-08-17T02:23:34.572025+0000","last_active":"2024-08-17T02:23:35.613478+0000","last_peered":"2024-08-17T02:23:35.613478+0000","last_clean":"2024-08-17T02:23:35.613478+0000","last_became_active":"2024-08-17T02:23:34.571705+0000","last_became_peered":"2024-08-17T02:23:34.571705+0000","last_unstale":"2024-08-17T02:23:35.613478+0000","last_undegraded":"2024-08-17T02:23:35.613478+0000","last_fullsized":"2024-08-17T02:23:35.613478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.576708+0000","last_change":"2024-08-17T02:23:34.580257+0000","last_active":"2024-08-17T02:23:35.576708+0000","last_peered":"2024-08-17T02:23:35.576708+0000","last_clean":"2024-08-17T02:23:35.576708+0000","last_became_active":"2024-08-17T02:23:34.579936+0000","last_became_peered":"2024-08-17T02:23:34.579936+0000","last_unstale":"2024-08-17T02:23:35.576708+0000","last_undegraded":"2024-08-17T02:23:35.576708+0000","last_fullsized":"2024-08-17T02:23:35.576708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:05:52.667388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603279+0000","last_change":"2024-08-17T02:23:35.597773+0000","last_active":"2024-08-17T02:23:35.603279+0000","last_peered":"2024-08-17T02:23:35.603279+0000","last_clean":"2024-08-17T02:23:35.603279+0000","last_became_active":"2024-08-17T02:23:35.597536+0000","last_became_peered":"2024-08-17T02:23:35.597536+0000","last_unstale":"2024-08-17T02:23:35.603279+0000","last_undegraded":"2024-08-17T02:23:35.603279+0000","last_fullsized":"2024-08-17T02:23:35.603279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:25:10.908502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583113+0000","last_change":"2024-08-17T02:23:34.577723+0000","last_active":"2024-08-17T02:23:35.583113+0000","last_peered":"2024-08-17T02:23:35.583113+0000","last_clean":"2024-08-17T02:23:35.583113+0000","last_became_active":"2024-08-17T02:23:34.577455+0000","last_became_peered":"2024-08-17T02:23:34.577455+0000","last_unstale":"2024-08-17T02:23:35.583113+0000","last_undegraded":"2024-08-17T02:23:35.583113+0000","last_fullsized":"2024-08-17T02:23:35.583113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:29.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.595349+0000","last_change":"2024-08-17T02:23:35.593879+0000","last_active":"2024-08-17T02:23:35.595349+0000","last_peered":"2024-08-17T02:23:35.595349+0000","last_clean":"2024-08-17T02:23:35.595349+0000","last_became_active":"2024-08-17T02:23:35.593445+0000","last_became_peered":"2024-08-17T02:23:35.593445+0000","last_unstale":"2024-08-17T02:23:35.595349+0000","last_undegraded":"2024-08-17T02:23:35.595349+0000","last_fullsized":"2024-08-17T02:23:35.595349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:53.892837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.571971+0000","last_change":"2024-08-17T02:23:34.579703+0000","last_active":"2024-08-17T02:23:35.571971+0000","last_peered":"2024-08-17T02:23:35.571971+0000","last_clean":"2024-08-17T02:23:35.571971+0000","last_became_active":"2024-08-17T02:23:34.579430+0000","last_became_peered":"2024-08-17T02:23:34.579430+0000","last_unstale":"2024-08-17T02:23:35.571971+0000","last_undegraded":"2024-08-17T02:23:35.571971+0000","last_fullsized":"2024-08-17T02:23:35.571971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:00.835021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603795+0000","last_change":"2024-08-17T02:23:35.596266+0000","last_active":"2024-08-17T02:23:35.603795+0000","last_peered":"2024-08-17T02:23:35.603795+0000","last_clean":"2024-08-17T02:23:35.603795+0000","last_became_active":"2024-08-17T02:23:35.593899+0000","last_became_peered":"2024-08-17T02:23:35.593899+0000","last_unstale":"2024-08-17T02:23:35.603795+0000","last_undegraded":"2024-08-17T02:23:35.603795+0000","last_fullsized":"2024-08-17T02:23:35.603795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:10.629891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.585770+0000","last_change":"2024-08-17T02:23:34.579638+0000","last_active":"2024-08-17T02:23:35.585770+0000","last_peered":"2024-08-17T02:23:35.585770+0000","last_clean":"2024-08-17T02:23:35.585770+0000","last_became_active":"2024-08-17T02:23:34.579374+0000","last_became_peered":"2024-08-17T02:23:34.579374+0000","last_unstale":"2024-08-17T02:23:35.585770+0000","last_undegraded":"2024-08-17T02:23:35.585770+0000","last_fullsized":"2024-08-17T02:23:35.585770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:28.453656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603912+0000","last_change":"2024-08-17T02:23:35.599779+0000","last_active":"2024-08-17T02:23:35.603912+0000","last_peered":"2024-08-17T02:23:35.603912+0000","last_clean":"2024-08-17T02:23:35.603912+0000","last_became_active":"2024-08-17T02:23:35.599431+0000","last_became_peered":"2024-08-17T02:23:35.599431+0000","last_unstale":"2024-08-17T02:23:35.603912+0000","last_undegraded":"2024-08-17T02:23:35.603912+0000","last_fullsized":"2024-08-17T02:23:35.603912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.610216+0000","last_change":"2024-08-17T02:23:34.587150+0000","last_active":"2024-08-17T02:23:35.610216+0000","last_peered":"2024-08-17T02:23:35.610216+0000","last_clean":"2024-08-17T02:23:35.610216+0000","last_became_active":"2024-08-17T02:23:34.586406+0000","last_became_peered":"2024-08-17T02:23:34.586406+0000","last_unstale":"2024-08-17T02:23:35.610216+0000","last_undegraded":"2024-08-17T02:23:35.610216+0000","last_fullsized":"2024-08-17T02:23:35.610216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:29:02.697073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.602428+0000","last_change":"2024-08-17T02:23:35.594894+0000","last_active":"2024-08-17T02:23:35.602428+0000","last_peered":"2024-08-17T02:23:35.602428+0000","last_clean":"2024-08-17T02:23:35.602428+0000","last_became_active":"2024-08-17T02:23:35.593967+0000","last_became_peered":"2024-08-17T02:23:35.593967+0000","last_unstale":"2024-08-17T02:23:35.602428+0000","last_undegraded":"2024-08-17T02:23:35.602428+0000","last_fullsized":"2024-08-17T02:23:35.602428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:13.277984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615851+0000","last_change":"2024-08-17T02:23:34.586772+0000","last_active":"2024-08-17T02:23:35.615851+0000","last_peered":"2024-08-17T02:23:35.615851+0000","last_clean":"2024-08-17T02:23:35.615851+0000","last_became_active":"2024-08-17T02:23:34.586079+0000","last_became_peered":"2024-08-17T02:23:34.586079+0000","last_unstale":"2024-08-17T02:23:35.615851+0000","last_undegraded":"2024-08-17T02:23:35.615851+0000","last_fullsized":"2024-08-17T02:23:35.615851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.606223+0000","last_change":"2024-08-17T02:23:35.603795+0000","last_active":"2024-08-17T02:23:35.606223+0000","last_peered":"2024-08-17T02:23:35.606223+0000","last_clean":"2024-08-17T02:23:35.606223+0000","last_became_active":"2024-08-17T02:23:35.603063+0000","last_became_peered":"2024-08-17T02:23:35.603063+0000","last_unstale":"2024-08-17T02:23:35.606223+0000","last_undegraded":"2024-08-17T02:23:35.606223+0000","last_fullsized":"2024-08-17T02:23:35.606223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:04:25.119433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.618735+0000","last_change":"2024-08-17T02:23:34.574467+0000","last_active":"2024-08-17T02:23:35.618735+0000","last_peered":"2024-08-17T02:23:35.618735+0000","last_clean":"2024-08-17T02:23:35.618735+0000","last_became_active":"2024-08-17T02:23:34.569946+0000","last_became_peered":"2024-08-17T02:23:34.569946+0000","last_unstale":"2024-08-17T02:23:35.618735+0000","last_undegraded":"2024-08-17T02:23:35.618735+0000","last_fullsized":"2024-08-17T02:23:35.618735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:20:34.979718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.598102+0000","last_change":"2024-08-17T02:23:35.592294+0000","last_active":"2024-08-17T02:23:35.598102+0000","last_peered":"2024-08-17T02:23:35.598102+0000","last_clean":"2024-08-17T02:23:35.598102+0000","last_became_active":"2024-08-17T02:23:35.591912+0000","last_became_peered":"2024-08-17T02:23:35.591912+0000","last_unstale":"2024-08-17T02:23:35.598102+0000","last_undegraded":"2024-08-17T02:23:35.598102+0000","last_fullsized":"2024-08-17T02:23:35.598102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:53.414346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583563+0000","last_change":"2024-08-17T02:23:34.587458+0000","last_active":"2024-08-17T02:23:35.583563+0000","last_peered":"2024-08-17T02:23:35.583563+0000","last_clean":"2024-08-17T02:23:35.583563+0000","last_became_active":"2024-08-17T02:23:34.587141+0000","last_became_peered":"2024-08-17T02:23:34.587141+0000","last_unstale":"2024-08-17T02:23:35.583563+0000","last_undegraded":"2024-08-17T02:23:35.583563+0000","last_fullsized":"2024-08-17T02:23:35.583563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605470+0000","last_change":"2024-08-17T02:23:35.601716+0000","last_active":"2024-08-17T02:23:35.605470+0000","last_peered":"2024-08-17T02:23:35.605470+0000","last_clean":"2024-08-17T02:23:35.605470+0000","last_became_active":"2024-08-17T02:23:35.600481+0000","last_became_peered":"2024-08-17T02:23:35.600481+0000","last_unstale":"2024-08-17T02:23:35.605470+0000","last_undegraded":"2024-08-17T02:23:35.605470+0000","last_fullsized":"2024-08-17T02:23:35.605470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:57:57.262402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.571127+0000","last_change":"2024-08-17T02:23:34.572877+0000","last_active":"2024-08-17T02:23:35.571127+0000","last_peered":"2024-08-17T02:23:35.571127+0000","last_clean":"2024-08-17T02:23:35.571127+0000","last_became_active":"2024-08-17T02:23:34.572606+0000","last_became_peered":"2024-08-17T02:23:34.572606+0000","last_unstale":"2024-08-17T02:23:35.571127+0000","last_undegraded":"2024-08-17T02:23:35.571127+0000","last_fullsized":"2024-08-17T02:23:35.571127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:28.453656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596192+0000","last_change":"2024-08-17T02:23:35.590217+0000","last_active":"2024-08-17T02:23:35.596192+0000","last_peered":"2024-08-17T02:23:35.596192+0000","last_clean":"2024-08-17T02:23:35.596192+0000","last_became_active":"2024-08-17T02:23:35.589427+0000","last_became_peered":"2024-08-17T02:23:35.589427+0000","last_unstale":"2024-08-17T02:23:35.596192+0000","last_undegraded":"2024-08-17T02:23:35.596192+0000","last_fullsized":"2024-08-17T02:23:35.596192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:53.892837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.612998+0000","last_change":"2024-08-17T02:23:34.580970+0000","last_active":"2024-08-17T02:23:35.612998+0000","last_peered":"2024-08-17T02:23:35.612998+0000","last_clean":"2024-08-17T02:23:35.612998+0000","last_became_active":"2024-08-17T02:23:34.580699+0000","last_became_peered":"2024-08-17T02:23:34.580699+0000","last_unstale":"2024-08-17T02:23:35.612998+0000","last_undegraded":"2024-08-17T02:23:35.612998+0000","last_fullsized":"2024-08-17T02:23:35.612998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605360+0000","last_change":"2024-08-17T02:23:35.600825+0000","last_active":"2024-08-17T02:23:35.605360+0000","last_peered":"2024-08-17T02:23:35.605360+0000","last_clean":"2024-08-17T02:23:35.605360+0000","last_became_active":"2024-08-17T02:23:35.600525+0000","last_became_peered":"2024-08-17T02:23:35.600525+0000","last_unstale":"2024-08-17T02:23:35.605360+0000","last_undegraded":"2024-08-17T02:23:35.605360+0000","last_fullsized":"2024-08-17T02:23:35.605360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:30.865202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615727+0000","last_change":"2024-08-17T02:23:34.568078+0000","last_active":"2024-08-17T02:23:35.615727+0000","last_peered":"2024-08-17T02:23:35.615727+0000","last_clean":"2024-08-17T02:23:35.615727+0000","last_became_active":"2024-08-17T02:23:34.567754+0000","last_became_peered":"2024-08-17T02:23:34.567754+0000","last_unstale":"2024-08-17T02:23:35.615727+0000","last_undegraded":"2024-08-17T02:23:35.615727+0000","last_fullsized":"2024-08-17T02:23:35.615727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:45.647236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605384+0000","last_change":"2024-08-17T02:23:35.600247+0000","last_active":"2024-08-17T02:23:35.605384+0000","last_peered":"2024-08-17T02:23:35.605384+0000","last_clean":"2024-08-17T02:23:35.605384+0000","last_became_active":"2024-08-17T02:23:35.599892+0000","last_became_peered":"2024-08-17T02:23:35.599892+0000","last_unstale":"2024-08-17T02:23:35.605384+0000","last_undegraded":"2024-08-17T02:23:35.605384+0000","last_fullsized":"2024-08-17T02:23:35.605384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.609828+0000","last_change":"2024-08-17T02:23:34.577876+0000","last_active":"2024-08-17T02:23:35.609828+0000","last_peered":"2024-08-17T02:23:35.609828+0000","last_clean":"2024-08-17T02:23:35.609828+0000","last_became_active":"2024-08-17T02:23:34.577501+0000","last_became_peered":"2024-08-17T02:23:34.577501+0000","last_unstale":"2024-08-17T02:23:35.609828+0000","last_undegraded":"2024-08-17T02:23:35.609828+0000","last_fullsized":"2024-08-17T02:23:35.609828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:33.519680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.606464+0000","last_change":"2024-08-17T02:23:35.604376+0000","last_active":"2024-08-17T02:23:35.606464+0000","last_peered":"2024-08-17T02:23:35.606464+0000","last_clean":"2024-08-17T02:23:35.606464+0000","last_became_active":"2024-08-17T02:23:35.604116+0000","last_became_peered":"2024-08-17T02:23:35.604116+0000","last_unstale":"2024-08-17T02:23:35.606464+0000","last_undegraded":"2024-08-17T02:23:35.606464+0000","last_fullsized":"2024-08-17T02:23:35.606464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:58.699491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.613587+0000","last_change":"2024-08-17T02:23:34.585195+0000","last_active":"2024-08-17T02:23:35.613587+0000","last_peered":"2024-08-17T02:23:35.613587+0000","last_clean":"2024-08-17T02:23:35.613587+0000","last_became_active":"2024-08-17T02:23:34.584875+0000","last_became_peered":"2024-08-17T02:23:34.584875+0000","last_unstale":"2024-08-17T02:23:35.613587+0000","last_undegraded":"2024-08-17T02:23:35.613587+0000","last_fullsized":"2024-08-17T02:23:35.613587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:00.835021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.594448+0000","last_change":"2024-08-17T02:23:35.589341+0000","last_active":"2024-08-17T02:23:35.594448+0000","last_peered":"2024-08-17T02:23:35.594448+0000","last_clean":"2024-08-17T02:23:35.594448+0000","last_became_active":"2024-08-17T02:23:35.588957+0000","last_became_peered":"2024-08-17T02:23:35.588957+0000","last_unstale":"2024-08-17T02:23:35.594448+0000","last_undegraded":"2024-08-17T02:23:35.594448+0000","last_fullsized":"2024-08-17T02:23:35.594448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:57:57.262402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.576331+0000","last_change":"2024-08-17T02:23:34.587854+0000","last_active":"2024-08-17T02:23:35.576331+0000","last_peered":"2024-08-17T02:23:35.576331+0000","last_clean":"2024-08-17T02:23:35.576331+0000","last_became_active":"2024-08-17T02:23:34.587549+0000","last_became_peered":"2024-08-17T02:23:34.587549+0000","last_unstale":"2024-08-17T02:23:35.576331+0000","last_undegraded":"2024-08-17T02:23:35.576331+0000","last_fullsized":"2024-08-17T02:23:35.576331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:00.835021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.602005+0000","last_change":"2024-08-17T02:23:35.596727+0000","last_active":"2024-08-17T02:23:35.602005+0000","last_peered":"2024-08-17T02:23:35.602005+0000","last_clean":"2024-08-17T02:23:35.602005+0000","last_became_active":"2024-08-17T02:23:35.596442+0000","last_became_peered":"2024-08-17T02:23:35.596442+0000","last_unstale":"2024-08-17T02:23:35.602005+0000","last_undegraded":"2024-08-17T02:23:35.602005+0000","last_fullsized":"2024-08-17T02:23:35.602005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:53.779150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.580926+0000","last_change":"2024-08-17T02:23:30.651033+0000","last_active":"2024-08-17T02:23:35.580926+0000","last_peered":"2024-08-17T02:23:35.580926+0000","last_clean":"2024-08-17T02:23:35.580926+0000","last_became_active":"2024-08-17T02:23:30.649860+0000","last_became_peered":"2024-08-17T02:23:30.649860+0000","last_unstale":"2024-08-17T02:23:35.580926+0000","last_undegraded":"2024-08-17T02:23:35.580926+0000","last_fullsized":"2024-08-17T02:23:35.580926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.523857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:29:35.288625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583338+0000","last_change":"2024-08-17T02:23:34.574229+0000","last_active":"2024-08-17T02:23:35.583338+0000","last_peered":"2024-08-17T02:23:35.583338+0000","last_clean":"2024-08-17T02:23:35.583338+0000","last_became_active":"2024-08-17T02:23:34.573885+0000","last_became_peered":"2024-08-17T02:23:34.573885+0000","last_unstale":"2024-08-17T02:23:35.583338+0000","last_undegraded":"2024-08-17T02:23:35.583338+0000","last_fullsized":"2024-08-17T02:23:35.583338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:33.519680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.602258+0000","last_change":"2024-08-17T02:23:35.593836+0000","last_active":"2024-08-17T02:23:35.602258+0000","last_peered":"2024-08-17T02:23:35.602258+0000","last_clean":"2024-08-17T02:23:35.602258+0000","last_became_active":"2024-08-17T02:23:35.593564+0000","last_became_peered":"2024-08-17T02:23:35.593564+0000","last_unstale":"2024-08-17T02:23:35.602258+0000","last_undegraded":"2024-08-17T02:23:35.602258+0000","last_fullsized":"2024-08-17T02:23:35.602258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:47.878023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.580838+0000","last_change":"2024-08-17T02:23:34.582041+0000","last_active":"2024-08-17T02:23:35.580838+0000","last_peered":"2024-08-17T02:23:35.580838+0000","last_clean":"2024-08-17T02:23:35.580838+0000","last_became_active":"2024-08-17T02:23:34.581786+0000","last_became_peered":"2024-08-17T02:23:34.581786+0000","last_unstale":"2024-08-17T02:23:35.580838+0000","last_undegraded":"2024-08-17T02:23:35.580838+0000","last_fullsized":"2024-08-17T02:23:35.580838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:53.571063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.598226+0000","last_change":"2024-08-17T02:23:35.593384+0000","last_active":"2024-08-17T02:23:35.598226+0000","last_peered":"2024-08-17T02:23:35.598226+0000","last_clean":"2024-08-17T02:23:35.598226+0000","last_became_active":"2024-08-17T02:23:35.593105+0000","last_became_peered":"2024-08-17T02:23:35.593105+0000","last_unstale":"2024-08-17T02:23:35.598226+0000","last_undegraded":"2024-08-17T02:23:35.598226+0000","last_fullsized":"2024-08-17T02:23:35.598226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:19:09.314565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.576062+0000","last_change":"2024-08-17T02:23:34.577822+0000","last_active":"2024-08-17T02:23:35.576062+0000","last_peered":"2024-08-17T02:23:35.576062+0000","last_clean":"2024-08-17T02:23:35.576062+0000","last_became_active":"2024-08-17T02:23:34.577467+0000","last_became_peered":"2024-08-17T02:23:34.577467+0000","last_unstale":"2024-08-17T02:23:35.576062+0000","last_undegraded":"2024-08-17T02:23:35.576062+0000","last_fullsized":"2024-08-17T02:23:35.576062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.588280+0000","last_change":"2024-08-17T02:23:35.584388+0000","last_active":"2024-08-17T02:23:35.588280+0000","last_peered":"2024-08-17T02:23:35.588280+0000","last_clean":"2024-08-17T02:23:35.588280+0000","last_became_active":"2024-08-17T02:23:35.584056+0000","last_became_peered":"2024-08-17T02:23:35.584056+0000","last_unstale":"2024-08-17T02:23:35.588280+0000","last_undegraded":"2024-08-17T02:23:35.588280+0000","last_fullsized":"2024-08-17T02:23:35.588280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:37.276820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583764+0000","last_change":"2024-08-17T02:23:34.585609+0000","last_active":"2024-08-17T02:23:35.583764+0000","last_peered":"2024-08-17T02:23:35.583764+0000","last_clean":"2024-08-17T02:23:35.583764+0000","last_became_active":"2024-08-17T02:23:34.585328+0000","last_became_peered":"2024-08-17T02:23:34.585328+0000","last_unstale":"2024-08-17T02:23:35.583764+0000","last_undegraded":"2024-08-17T02:23:35.583764+0000","last_fullsized":"2024-08-17T02:23:35.583764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.593219+0000","last_change":"2024-08-17T02:23:35.582716+0000","last_active":"2024-08-17T02:23:35.593219+0000","last_peered":"2024-08-17T02:23:35.593219+0000","last_clean":"2024-08-17T02:23:35.593219+0000","last_became_active":"2024-08-17T02:23:35.582042+0000","last_became_peered":"2024-08-17T02:23:35.582042+0000","last_unstale":"2024-08-17T02:23:35.593219+0000","last_undegraded":"2024-08-17T02:23:35.593219+0000","last_fullsized":"2024-08-17T02:23:35.593219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:19.127243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.570431+0000","last_change":"2024-08-17T02:23:34.579748+0000","last_active":"2024-08-17T02:23:35.570431+0000","last_peered":"2024-08-17T02:23:35.570431+0000","last_clean":"2024-08-17T02:23:35.570431+0000","last_became_active":"2024-08-17T02:23:34.579282+0000","last_became_peered":"2024-08-17T02:23:34.579282+0000","last_unstale":"2024-08-17T02:23:35.570431+0000","last_undegraded":"2024-08-17T02:23:35.570431+0000","last_fullsized":"2024-08-17T02:23:35.570431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:53.571063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604616+0000","last_change":"2024-08-17T02:23:35.599794+0000","last_active":"2024-08-17T02:23:35.604616+0000","last_peered":"2024-08-17T02:23:35.604616+0000","last_clean":"2024-08-17T02:23:35.604616+0000","last_became_active":"2024-08-17T02:23:35.596190+0000","last_became_peered":"2024-08-17T02:23:35.596190+0000","last_unstale":"2024-08-17T02:23:35.604616+0000","last_undegraded":"2024-08-17T02:23:35.604616+0000","last_fullsized":"2024-08-17T02:23:35.604616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583507+0000","last_change":"2024-08-17T02:23:34.585808+0000","last_active":"2024-08-17T02:23:35.583507+0000","last_peered":"2024-08-17T02:23:35.583507+0000","last_clean":"2024-08-17T02:23:35.583507+0000","last_became_active":"2024-08-17T02:23:34.584698+0000","last_became_peered":"2024-08-17T02:23:34.584698+0000","last_unstale":"2024-08-17T02:23:35.583507+0000","last_undegraded":"2024-08-17T02:23:35.583507+0000","last_fullsized":"2024-08-17T02:23:35.583507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:29:02.697073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.588719+0000","last_change":"2024-08-17T02:23:35.584214+0000","last_active":"2024-08-17T02:23:35.588719+0000","last_peered":"2024-08-17T02:23:35.588719+0000","last_clean":"2024-08-17T02:23:35.588719+0000","last_became_active":"2024-08-17T02:23:35.583938+0000","last_became_peered":"2024-08-17T02:23:35.583938+0000","last_unstale":"2024-08-17T02:23:35.588719+0000","last_undegraded":"2024-08-17T02:23:35.588719+0000","last_fullsized":"2024-08-17T02:23:35.588719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:16.596695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:23:36.579851+0000","last_change":"2024-08-17T02:23:34.576832+0000","last_active":"2024-08-17T02:23:36.579851+0000","last_peered":"2024-08-17T02:23:36.579851+0000","last_clean":"2024-08-17T02:23:36.579851+0000","last_became_active":"2024-08-17T02:23:34.576507+0000","last_became_peered":"2024-08-17T02:23:34.576507+0000","last_unstale":"2024-08-17T02:23:36.579851+0000","last_undegraded":"2024-08-17T02:23:36.579851+0000","last_fullsized":"2024-08-17T02:23:36.579851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.591343+0000","last_change":"2024-08-17T02:23:35.590465+0000","last_active":"2024-08-17T02:23:35.591343+0000","last_peered":"2024-08-17T02:23:35.591343+0000","last_clean":"2024-08-17T02:23:35.591343+0000","last_became_active":"2024-08-17T02:23:35.590114+0000","last_became_peered":"2024-08-17T02:23:35.590114+0000","last_unstale":"2024-08-17T02:23:35.591343+0000","last_undegraded":"2024-08-17T02:23:35.591343+0000","last_fullsized":"2024-08-17T02:23:35.591343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:53.892837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615597+0000","last_change":"2024-08-17T02:23:34.579565+0000","last_active":"2024-08-17T02:23:35.615597+0000","last_peered":"2024-08-17T02:23:35.615597+0000","last_clean":"2024-08-17T02:23:35.615597+0000","last_became_active":"2024-08-17T02:23:34.579256+0000","last_became_peered":"2024-08-17T02:23:34.579256+0000","last_unstale":"2024-08-17T02:23:35.615597+0000","last_undegraded":"2024-08-17T02:23:35.615597+0000","last_fullsized":"2024-08-17T02:23:35.615597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:33.519680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.598466+0000","last_change":"2024-08-17T02:23:35.591642+0000","last_active":"2024-08-17T02:23:35.598466+0000","last_peered":"2024-08-17T02:23:35.598466+0000","last_clean":"2024-08-17T02:23:35.598466+0000","last_became_active":"2024-08-17T02:23:35.591364+0000","last_became_peered":"2024-08-17T02:23:35.591364+0000","last_unstale":"2024-08-17T02:23:35.598466+0000","last_undegraded":"2024-08-17T02:23:35.598466+0000","last_fullsized":"2024-08-17T02:23:35.598466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:10.629891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.580732+0000","last_change":"2024-08-17T02:23:34.584710+0000","last_active":"2024-08-17T02:23:35.580732+0000","last_peered":"2024-08-17T02:23:35.580732+0000","last_clean":"2024-08-17T02:23:35.580732+0000","last_became_active":"2024-08-17T02:23:34.584459+0000","last_became_peered":"2024-08-17T02:23:34.584459+0000","last_unstale":"2024-08-17T02:23:35.580732+0000","last_undegraded":"2024-08-17T02:23:35.580732+0000","last_fullsized":"2024-08-17T02:23:35.580732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.592273+0000","last_change":"2024-08-17T02:23:35.579802+0000","last_active":"2024-08-17T02:23:35.592273+0000","last_peered":"2024-08-17T02:23:35.592273+0000","last_clean":"2024-08-17T02:23:35.592273+0000","last_became_active":"2024-08-17T02:23:35.579505+0000","last_became_peered":"2024-08-17T02:23:35.579505+0000","last_unstale":"2024-08-17T02:23:35.592273+0000","last_undegraded":"2024-08-17T02:23:35.592273+0000","last_fullsized":"2024-08-17T02:23:35.592273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:51.900850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.569935+0000","last_change":"2024-08-17T02:23:34.584346+0000","last_active":"2024-08-17T02:23:35.569935+0000","last_peered":"2024-08-17T02:23:35.569935+0000","last_clean":"2024-08-17T02:23:35.569935+0000","last_became_active":"2024-08-17T02:23:34.584030+0000","last_became_peered":"2024-08-17T02:23:34.584030+0000","last_unstale":"2024-08-17T02:23:35.569935+0000","last_undegraded":"2024-08-17T02:23:35.569935+0000","last_fullsized":"2024-08-17T02:23:35.569935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.602212+0000","last_change":"2024-08-17T02:23:35.593165+0000","last_active":"2024-08-17T02:23:35.602212+0000","last_peered":"2024-08-17T02:23:35.602212+0000","last_clean":"2024-08-17T02:23:35.602212+0000","last_became_active":"2024-08-17T02:23:35.585416+0000","last_became_peered":"2024-08-17T02:23:35.585416+0000","last_unstale":"2024-08-17T02:23:35.602212+0000","last_undegraded":"2024-08-17T02:23:35.602212+0000","last_fullsized":"2024-08-17T02:23:35.602212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:10.629891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.569524+0000","last_change":"2024-08-17T02:23:34.586914+0000","last_active":"2024-08-17T02:23:35.569524+0000","last_peered":"2024-08-17T02:23:35.569524+0000","last_clean":"2024-08-17T02:23:35.569524+0000","last_became_active":"2024-08-17T02:23:34.586476+0000","last_became_peered":"2024-08-17T02:23:34.586476+0000","last_unstale":"2024-08-17T02:23:35.569524+0000","last_undegraded":"2024-08-17T02:23:35.569524+0000","last_fullsized":"2024-08-17T02:23:35.569524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:20:34.979718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.589645+0000","last_change":"2024-08-17T02:23:35.585526+0000","last_active":"2024-08-17T02:23:35.589645+0000","last_peered":"2024-08-17T02:23:35.589645+0000","last_clean":"2024-08-17T02:23:35.589645+0000","last_became_active":"2024-08-17T02:23:35.585223+0000","last_became_peered":"2024-08-17T02:23:35.585223+0000","last_unstale":"2024-08-17T02:23:35.589645+0000","last_undegraded":"2024-08-17T02:23:35.589645+0000","last_fullsized":"2024-08-17T02:23:35.589645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:37.276820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615445+0000","last_change":"2024-08-17T02:23:34.583608+0000","last_active":"2024-08-17T02:23:35.615445+0000","last_peered":"2024-08-17T02:23:35.615445+0000","last_clean":"2024-08-17T02:23:35.615445+0000","last_became_active":"2024-08-17T02:23:34.583262+0000","last_became_peered":"2024-08-17T02:23:34.583262+0000","last_unstale":"2024-08-17T02:23:35.615445+0000","last_undegraded":"2024-08-17T02:23:35.615445+0000","last_fullsized":"2024-08-17T02:23:35.615445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.584243+0000","last_change":"2024-08-17T02:23:35.582216+0000","last_active":"2024-08-17T02:23:35.584243+0000","last_peered":"2024-08-17T02:23:35.584243+0000","last_clean":"2024-08-17T02:23:35.584243+0000","last_became_active":"2024-08-17T02:23:35.581896+0000","last_became_peered":"2024-08-17T02:23:35.581896+0000","last_unstale":"2024-08-17T02:23:35.584243+0000","last_undegraded":"2024-08-17T02:23:35.584243+0000","last_fullsized":"2024-08-17T02:23:35.584243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:37.276820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604633+0000","last_change":"2024-08-17T02:23:35.600164+0000","last_active":"2024-08-17T02:23:35.604633+0000","last_peered":"2024-08-17T02:23:35.604633+0000","last_clean":"2024-08-17T02:23:35.604633+0000","last_became_active":"2024-08-17T02:23:35.594009+0000","last_became_peered":"2024-08-17T02:23:35.594009+0000","last_unstale":"2024-08-17T02:23:35.604633+0000","last_undegraded":"2024-08-17T02:23:35.604633+0000","last_fullsized":"2024-08-17T02:23:35.604633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:04:25.119433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615820+0000","last_change":"2024-08-17T02:23:34.586673+0000","last_active":"2024-08-17T02:23:35.615820+0000","last_peered":"2024-08-17T02:23:35.615820+0000","last_clean":"2024-08-17T02:23:35.615820+0000","last_became_active":"2024-08-17T02:23:34.586204+0000","last_became_peered":"2024-08-17T02:23:34.586204+0000","last_unstale":"2024-08-17T02:23:35.615820+0000","last_undegraded":"2024-08-17T02:23:35.615820+0000","last_fullsized":"2024-08-17T02:23:35.615820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:54:12.191670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603990+0000","last_change":"2024-08-17T02:23:35.597722+0000","last_active":"2024-08-17T02:23:35.603990+0000","last_peered":"2024-08-17T02:23:35.603990+0000","last_clean":"2024-08-17T02:23:35.603990+0000","last_became_active":"2024-08-17T02:23:35.593591+0000","last_became_peered":"2024-08-17T02:23:35.593591+0000","last_unstale":"2024-08-17T02:23:35.603990+0000","last_undegraded":"2024-08-17T02:23:35.603990+0000","last_fullsized":"2024-08-17T02:23:35.603990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:54:21.053209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.612181+0000","last_change":"2024-08-17T02:23:34.576713+0000","last_active":"2024-08-17T02:23:35.612181+0000","last_peered":"2024-08-17T02:23:35.612181+0000","last_clean":"2024-08-17T02:23:35.612181+0000","last_became_active":"2024-08-17T02:23:34.576458+0000","last_became_peered":"2024-08-17T02:23:34.576458+0000","last_unstale":"2024-08-17T02:23:35.612181+0000","last_undegraded":"2024-08-17T02:23:35.612181+0000","last_fullsized":"2024-08-17T02:23:35.612181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:00.835021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603641+0000","last_change":"2024-08-17T02:23:35.597367+0000","last_active":"2024-08-17T02:23:35.603641+0000","last_peered":"2024-08-17T02:23:35.603641+0000","last_clean":"2024-08-17T02:23:35.603641+0000","last_became_active":"2024-08-17T02:23:35.597133+0000","last_became_peered":"2024-08-17T02:23:35.597133+0000","last_unstale":"2024-08-17T02:23:35.603641+0000","last_undegraded":"2024-08-17T02:23:35.603641+0000","last_fullsized":"2024-08-17T02:23:35.603641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.610320+0000","last_change":"2024-08-17T02:23:34.573028+0000","last_active":"2024-08-17T02:23:35.610320+0000","last_peered":"2024-08-17T02:23:35.610320+0000","last_clean":"2024-08-17T02:23:35.610320+0000","last_became_active":"2024-08-17T02:23:34.572521+0000","last_became_peered":"2024-08-17T02:23:34.572521+0000","last_unstale":"2024-08-17T02:23:35.610320+0000","last_undegraded":"2024-08-17T02:23:35.610320+0000","last_fullsized":"2024-08-17T02:23:35.610320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:20:34.979718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.590393+0000","last_change":"2024-08-17T02:23:35.587484+0000","last_active":"2024-08-17T02:23:35.590393+0000","last_peered":"2024-08-17T02:23:35.590393+0000","last_clean":"2024-08-17T02:23:35.590393+0000","last_became_active":"2024-08-17T02:23:35.585250+0000","last_became_peered":"2024-08-17T02:23:35.585250+0000","last_unstale":"2024-08-17T02:23:35.590393+0000","last_undegraded":"2024-08-17T02:23:35.590393+0000","last_fullsized":"2024-08-17T02:23:35.590393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.616297+0000","last_change":"2024-08-17T02:23:34.577769+0000","last_active":"2024-08-17T02:23:35.616297+0000","last_peered":"2024-08-17T02:23:35.616297+0000","last_clean":"2024-08-17T02:23:35.616297+0000","last_became_active":"2024-08-17T02:23:34.576757+0000","last_became_peered":"2024-08-17T02:23:34.576757+0000","last_unstale":"2024-08-17T02:23:35.616297+0000","last_undegraded":"2024-08-17T02:23:35.616297+0000","last_fullsized":"2024-08-17T02:23:35.616297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:05:52.667388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":823296,"data_stored":669534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":237568,"data_stored":80148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4009999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2959999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":78686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":237568,"data_stored":78722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301752,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070088,"statfs":{"total":96636764160,"available":96327770112,"internally_reserved":0,"allocated":237568,"data_stored":80148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":225280,"data_stored":78596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301748,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070092,"statfs":{"total":96636764160,"available":96327774208,"internally_reserved":0,"allocated":233472,"data_stored":78756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.968}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7149999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3279999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.544}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302328,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069512,"statfs":{"total":96636764160,"available":96327180288,"internally_reserved":0,"allocated":831488,"data_stored":669590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:23:44.877 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:23:45.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.065+0000 7fce84c00640 1 Processor -- start 2024-08-17T02:23:45.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.066+0000 7fce84c00640 1 -- start start 2024-08-17T02:23:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.067+0000 7fce84c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce801403d0 0x7fce800b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.067+0000 7fce84c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8006d7c0 con 0x7fce800b0e30 2024-08-17T02:23:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.067+0000 7fce84c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8015ab30 con 0x7fce80156f90 2024-08-17T02:23:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.067+0000 7fce84c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8015ae10 con 0x7fce801403d0 2024-08-17T02:23:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.067+0000 7fce7fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce801403d0 0x7fce800b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.067+0000 7fce7fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce801403d0 0x7fce800b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44214/0 (socket says 172.21.15.5:44214) 2024-08-17T02:23:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.067+0000 7fce7fe00640 1 -- 172.21.15.5:0/2265794333 learned_addr learned my addr 172.21.15.5:0/2265794333 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.067+0000 7fce7f400640 1 --1- 172.21.15.5:0/2265794333 >> v1:172.21.15.5:6789/0 conn(0x7fce800b0e30 0x7fce800cb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49390/0 (socket says 172.21.15.5:49390) 2024-08-17T02:23:45.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.067+0000 7fce7fe00640 1 -- 172.21.15.5:0/2265794333 >> v1:172.21.15.87:6789/0 conn(0x7fce80156f90 legacy=0x7fce8013fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:45.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.067+0000 7fce7fe00640 1 -- 172.21.15.5:0/2265794333 >> v1:172.21.15.5:6789/0 conn(0x7fce800b0e30 legacy=0x7fce800cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.067+0000 7fce7fe00640 1 -- 172.21.15.5:0/2265794333 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8015b0f0 con 0x7fce801403d0 2024-08-17T02:23:45.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.068+0000 7fce7fe00640 1 --2- 172.21.15.5:0/2265794333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce801403d0 0x7fce800b1200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fce78009f20 tx=0x7fce78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6380e943baa2a652 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:45.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.069+0000 7fce7e000640 1 -- 172.21.15.5:0/2265794333 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78033430 con 0x7fce801403d0 2024-08-17T02:23:45.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.069+0000 7fce7e000640 1 -- 172.21.15.5:0/2265794333 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce78033590 con 0x7fce801403d0 2024-08-17T02:23:45.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.069+0000 7fce7e000640 1 -- 172.21.15.5:0/2265794333 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78033930 con 0x7fce801403d0 2024-08-17T02:23:45.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.069+0000 7fce84c00640 1 -- 172.21.15.5:0/2265794333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce801403d0 msgr2=0x7fce800b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.069+0000 7fce84c00640 1 --2- 172.21.15.5:0/2265794333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce801403d0 0x7fce800b1200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fce78009f20 tx=0x7fce78009840 comp rx=0 tx=0).stop 2024-08-17T02:23:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.069+0000 7fce84c00640 1 -- 172.21.15.5:0/2265794333 shutdown_connections 2024-08-17T02:23:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.069+0000 7fce84c00640 1 --2- 172.21.15.5:0/2265794333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce801403d0 0x7fce800b1200 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.069+0000 7fce84c00640 1 -- 172.21.15.5:0/2265794333 >> 172.21.15.5:0/2265794333 conn(0x7fce80062af0 msgr2=0x7fce80062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.069+0000 7fce84c00640 1 -- 172.21.15.5:0/2265794333 shutdown_connections 2024-08-17T02:23:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.069+0000 7fce84c00640 1 -- 172.21.15.5:0/2265794333 wait complete. 2024-08-17T02:23:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.071+0000 7fce84c00640 1 Processor -- start 2024-08-17T02:23:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.071+0000 7fce84c00640 1 -- start start 2024-08-17T02:23:45.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.072+0000 7fce84c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce800b0e30 0x7fce800af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.072+0000 7fce84c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce801403d0 0x7fce800c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.072+0000 7fce84c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce80156f90 0x7fce80154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.072+0000 7fce84c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce800c54a0 con 0x7fce800b0e30 2024-08-17T02:23:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.072+0000 7fce84c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce800afc40 con 0x7fce801403d0 2024-08-17T02:23:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.072+0000 7fce84c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce80137b40 con 0x7fce80156f90 2024-08-17T02:23:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.072+0000 7fce7f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce800b0e30 0x7fce800af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.072+0000 7fce7f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce800b0e30 0x7fce800af660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44216/0 (socket says 172.21.15.5:44216) 2024-08-17T02:23:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.072+0000 7fce7f400640 1 -- 172.21.15.5:0/1031894841 learned_addr learned my addr 172.21.15.5:0/1031894841 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.072+0000 7fce7fe00640 1 --2- 172.21.15.5:0/1031894841 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce80156f90 0x7fce80154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.072+0000 7fce7ea00640 1 --2- 172.21.15.5:0/1031894841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce801403d0 0x7fce800c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.072+0000 7fce7f400640 1 -- 172.21.15.5:0/1031894841 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce80156f90 msgr2=0x7fce80154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.072+0000 7fce7f400640 1 --2- 172.21.15.5:0/1031894841 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce80156f90 0x7fce80154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.072+0000 7fce7f400640 1 -- 172.21.15.5:0/1031894841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce801403d0 msgr2=0x7fce800c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.072+0000 7fce7f400640 1 --2- 172.21.15.5:0/1031894841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce801403d0 0x7fce800c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.072+0000 7fce7f400640 1 -- 172.21.15.5:0/1031894841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce78009ae0 con 0x7fce800b0e30 2024-08-17T02:23:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.073+0000 7fce7f400640 1 --2- 172.21.15.5:0/1031894841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce800b0e30 0x7fce800af660 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fce7000c590 tx=0x7fce70007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.073+0000 7fce76a00640 1 -- 172.21.15.5:0/1031894841 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70007300 con 0x7fce800b0e30 2024-08-17T02:23:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.073+0000 7fce76a00640 1 -- 172.21.15.5:0/1031894841 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce700074a0 con 0x7fce800b0e30 2024-08-17T02:23:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.073+0000 7fce84c00640 1 -- 172.21.15.5:0/1031894841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce80137e20 con 0x7fce800b0e30 2024-08-17T02:23:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.073+0000 7fce76a00640 1 -- 172.21.15.5:0/1031894841 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700047a0 con 0x7fce800b0e30 2024-08-17T02:23:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.073+0000 7fce84c00640 1 -- 172.21.15.5:0/1031894841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce80154cb0 con 0x7fce800b0e30 2024-08-17T02:23:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.074+0000 7fce84c00640 1 -- 172.21.15.5:0/1031894841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce80070720 con 0x7fce800b0e30 2024-08-17T02:23:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.075+0000 7fce76a00640 1 -- 172.21.15.5:0/1031894841 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fce70004bd0 con 0x7fce800b0e30 2024-08-17T02:23:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.076+0000 7fce76a00640 1 --2- 172.21.15.5:0/1031894841 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fce60065150 0x7fce60067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.076+0000 7fce76a00640 1 -- 172.21.15.5:0/1031894841 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fce70081800 con 0x7fce800b0e30 2024-08-17T02:23:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.076+0000 7fce7ea00640 1 --2- 172.21.15.5:0/1031894841 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fce60065150 0x7fce60067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.077+0000 7fce7ea00640 1 --2- 172.21.15.5:0/1031894841 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fce60065150 0x7fce60067600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fce80139bf0 tx=0x7fce6c006f50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:45.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.080+0000 7fce76a00640 1 -- 172.21.15.5:0/1031894841 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fce7004f950 con 0x7fce800b0e30 2024-08-17T02:23:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.260+0000 7fce84c00640 1 -- 172.21.15.5:0/1031894841 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce801379c0 con 0x7fce60065150 2024-08-17T02:23:45.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.267+0000 7fce76a00640 1 -- 172.21.15.5:0/1031894841 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264520 (secure 0 0 0) 0x7fce6c00e7c0 con 0x7fce60065150 2024-08-17T02:23:45.270 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:45.271 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:23:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.271+0000 7fce84c00640 1 -- 172.21.15.5:0/1031894841 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fce60065150 msgr2=0x7fce60067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.271+0000 7fce84c00640 1 --2- 172.21.15.5:0/1031894841 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fce60065150 0x7fce60067600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fce80139bf0 tx=0x7fce6c006f50 comp rx=0 tx=0).stop 2024-08-17T02:23:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.271+0000 7fce84c00640 1 -- 172.21.15.5:0/1031894841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce800b0e30 msgr2=0x7fce800af660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.271+0000 7fce84c00640 1 --2- 172.21.15.5:0/1031894841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce800b0e30 0x7fce800af660 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fce7000c590 tx=0x7fce70007ee0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.271+0000 7fce84c00640 1 -- 172.21.15.5:0/1031894841 shutdown_connections 2024-08-17T02:23:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.271+0000 7fce84c00640 1 --2- 172.21.15.5:0/1031894841 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fce60065150 0x7fce60067600 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.271+0000 7fce84c00640 1 --2- 172.21.15.5:0/1031894841 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce80156f90 0x7fce80154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.271+0000 7fce84c00640 1 --2- 172.21.15.5:0/1031894841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce801403d0 0x7fce800c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.271+0000 7fce84c00640 1 --2- 172.21.15.5:0/1031894841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce800b0e30 0x7fce800af660 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.271+0000 7fce84c00640 1 -- 172.21.15.5:0/1031894841 >> 172.21.15.5:0/1031894841 conn(0x7fce80062af0 msgr2=0x7fce8013fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.271+0000 7fce84c00640 1 -- 172.21.15.5:0/1031894841 shutdown_connections 2024-08-17T02:23:45.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.271+0000 7fce84c00640 1 -- 172.21.15.5:0/1031894841 wait complete. 2024-08-17T02:23:45.286 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-08-17T02:23:44.722279+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398496,"kb_used_data":2984,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576224,"statfs":{"total":773094113280,"available":770638053376,"internally_reserved":0,"allocated":3055616,"data_stored":1814180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.154799"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596396+0000","last_change":"2024-08-17T02:23:35.589709+0000","last_active":"2024-08-17T02:23:35.596396+0000","last_peered":"2024-08-17T02:23:35.596396+0000","last_clean":"2024-08-17T02:23:35.596396+0000","last_became_active":"2024-08-17T02:23:35.589445+0000","last_became_peered":"2024-08-17T02:23:35.589445+0000","last_unstale":"2024-08-17T02:23:35.596396+0000","last_undegraded":"2024-08-17T02:23:35.596396+0000","last_fullsized":"2024-08-17T02:23:35.596396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:40.177968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.597886+0000","last_change":"2024-08-17T02:23:35.596541+0000","last_active":"2024-08-17T02:23:35.597886+0000","last_peered":"2024-08-17T02:23:35.597886+0000","last_clean":"2024-08-17T02:23:35.597886+0000","last_became_active":"2024-08-17T02:23:35.595984+0000","last_became_peered":"2024-08-17T02:23:35.595984+0000","last_unstale":"2024-08-17T02:23:35.597886+0000","last_undegraded":"2024-08-17T02:23:35.597886+0000","last_fullsized":"2024-08-17T02:23:35.597886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.592178+0000","last_change":"2024-08-17T02:23:35.589116+0000","last_active":"2024-08-17T02:23:35.592178+0000","last_peered":"2024-08-17T02:23:35.592178+0000","last_clean":"2024-08-17T02:23:35.592178+0000","last_became_active":"2024-08-17T02:23:35.588776+0000","last_became_peered":"2024-08-17T02:23:35.588776+0000","last_unstale":"2024-08-17T02:23:35.592178+0000","last_undegraded":"2024-08-17T02:23:35.592178+0000","last_fullsized":"2024-08-17T02:23:35.592178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604057+0000","last_change":"2024-08-17T02:23:35.597845+0000","last_active":"2024-08-17T02:23:35.604057+0000","last_peered":"2024-08-17T02:23:35.604057+0000","last_clean":"2024-08-17T02:23:35.604057+0000","last_became_active":"2024-08-17T02:23:35.593974+0000","last_became_peered":"2024-08-17T02:23:35.593974+0000","last_unstale":"2024-08-17T02:23:35.604057+0000","last_undegraded":"2024-08-17T02:23:35.604057+0000","last_fullsized":"2024-08-17T02:23:35.604057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:40.177968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596099+0000","last_change":"2024-08-17T02:23:35.592334+0000","last_active":"2024-08-17T02:23:35.596099+0000","last_peered":"2024-08-17T02:23:35.596099+0000","last_clean":"2024-08-17T02:23:35.596099+0000","last_became_active":"2024-08-17T02:23:35.591936+0000","last_became_peered":"2024-08-17T02:23:35.591936+0000","last_unstale":"2024-08-17T02:23:35.596099+0000","last_undegraded":"2024-08-17T02:23:35.596099+0000","last_fullsized":"2024-08-17T02:23:35.596099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:54:21.053209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605344+0000","last_change":"2024-08-17T02:23:35.601382+0000","last_active":"2024-08-17T02:23:35.605344+0000","last_peered":"2024-08-17T02:23:35.605344+0000","last_clean":"2024-08-17T02:23:35.605344+0000","last_became_active":"2024-08-17T02:23:35.600762+0000","last_became_peered":"2024-08-17T02:23:35.600762+0000","last_unstale":"2024-08-17T02:23:35.605344+0000","last_undegraded":"2024-08-17T02:23:35.605344+0000","last_fullsized":"2024-08-17T02:23:35.605344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:58.699491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.600889+0000","last_change":"2024-08-17T02:23:35.593406+0000","last_active":"2024-08-17T02:23:35.600889+0000","last_peered":"2024-08-17T02:23:35.600889+0000","last_clean":"2024-08-17T02:23:35.600889+0000","last_became_active":"2024-08-17T02:23:35.592939+0000","last_became_peered":"2024-08-17T02:23:35.592939+0000","last_unstale":"2024-08-17T02:23:35.600889+0000","last_undegraded":"2024-08-17T02:23:35.600889+0000","last_fullsized":"2024-08-17T02:23:35.600889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:58.163230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603257+0000","last_change":"2024-08-17T02:23:35.597151+0000","last_active":"2024-08-17T02:23:35.603257+0000","last_peered":"2024-08-17T02:23:35.603257+0000","last_clean":"2024-08-17T02:23:35.603257+0000","last_became_active":"2024-08-17T02:23:35.593461+0000","last_became_peered":"2024-08-17T02:23:35.593461+0000","last_unstale":"2024-08-17T02:23:35.603257+0000","last_undegraded":"2024-08-17T02:23:35.603257+0000","last_fullsized":"2024-08-17T02:23:35.603257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:04:25.119433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.601168+0000","last_change":"2024-08-17T02:23:35.598033+0000","last_active":"2024-08-17T02:23:35.601168+0000","last_peered":"2024-08-17T02:23:35.601168+0000","last_clean":"2024-08-17T02:23:35.601168+0000","last_became_active":"2024-08-17T02:23:35.595752+0000","last_became_peered":"2024-08-17T02:23:35.595752+0000","last_unstale":"2024-08-17T02:23:35.601168+0000","last_undegraded":"2024-08-17T02:23:35.601168+0000","last_fullsized":"2024-08-17T02:23:35.601168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:23:53.610539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.595948+0000","last_change":"2024-08-17T02:23:35.592023+0000","last_active":"2024-08-17T02:23:35.595948+0000","last_peered":"2024-08-17T02:23:35.595948+0000","last_clean":"2024-08-17T02:23:35.595948+0000","last_became_active":"2024-08-17T02:23:35.591200+0000","last_became_peered":"2024-08-17T02:23:35.591200+0000","last_unstale":"2024-08-17T02:23:35.595948+0000","last_undegraded":"2024-08-17T02:23:35.595948+0000","last_fullsized":"2024-08-17T02:23:35.595948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.600098+0000","last_change":"2024-08-17T02:23:35.596390+0000","last_active":"2024-08-17T02:23:35.600098+0000","last_peered":"2024-08-17T02:23:35.600098+0000","last_clean":"2024-08-17T02:23:35.600098+0000","last_became_active":"2024-08-17T02:23:35.596157+0000","last_became_peered":"2024-08-17T02:23:35.596157+0000","last_unstale":"2024-08-17T02:23:35.600098+0000","last_undegraded":"2024-08-17T02:23:35.600098+0000","last_fullsized":"2024-08-17T02:23:35.600098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.592637+0000","last_change":"2024-08-17T02:23:35.582359+0000","last_active":"2024-08-17T02:23:35.592637+0000","last_peered":"2024-08-17T02:23:35.592637+0000","last_clean":"2024-08-17T02:23:35.592637+0000","last_became_active":"2024-08-17T02:23:35.581946+0000","last_became_peered":"2024-08-17T02:23:35.581946+0000","last_unstale":"2024-08-17T02:23:35.592637+0000","last_undegraded":"2024-08-17T02:23:35.592637+0000","last_fullsized":"2024-08-17T02:23:35.592637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:27:42.753023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.590492+0000","last_change":"2024-08-17T02:23:35.587890+0000","last_active":"2024-08-17T02:23:35.590492+0000","last_peered":"2024-08-17T02:23:35.590492+0000","last_clean":"2024-08-17T02:23:35.590492+0000","last_became_active":"2024-08-17T02:23:35.585585+0000","last_became_peered":"2024-08-17T02:23:35.585585+0000","last_unstale":"2024-08-17T02:23:35.590492+0000","last_undegraded":"2024-08-17T02:23:35.590492+0000","last_fullsized":"2024-08-17T02:23:35.590492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603716+0000","last_change":"2024-08-17T02:23:35.596596+0000","last_active":"2024-08-17T02:23:35.603716+0000","last_peered":"2024-08-17T02:23:35.603716+0000","last_clean":"2024-08-17T02:23:35.603716+0000","last_became_active":"2024-08-17T02:23:35.596293+0000","last_became_peered":"2024-08-17T02:23:35.596293+0000","last_unstale":"2024-08-17T02:23:35.603716+0000","last_undegraded":"2024-08-17T02:23:35.603716+0000","last_fullsized":"2024-08-17T02:23:35.603716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:25:10.908502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.580252+0000","last_change":"2024-08-17T02:23:35.576127+0000","last_active":"2024-08-17T02:23:35.580252+0000","last_peered":"2024-08-17T02:23:35.580252+0000","last_clean":"2024-08-17T02:23:35.580252+0000","last_became_active":"2024-08-17T02:23:35.575812+0000","last_became_peered":"2024-08-17T02:23:35.575812+0000","last_unstale":"2024-08-17T02:23:35.580252+0000","last_undegraded":"2024-08-17T02:23:35.580252+0000","last_fullsized":"2024-08-17T02:23:35.580252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604727+0000","last_change":"2024-08-17T02:23:35.598920+0000","last_active":"2024-08-17T02:23:35.604727+0000","last_peered":"2024-08-17T02:23:35.604727+0000","last_clean":"2024-08-17T02:23:35.604727+0000","last_became_active":"2024-08-17T02:23:35.598446+0000","last_became_peered":"2024-08-17T02:23:35.598446+0000","last_unstale":"2024-08-17T02:23:35.604727+0000","last_undegraded":"2024-08-17T02:23:35.604727+0000","last_fullsized":"2024-08-17T02:23:35.604727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:44.471490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603819+0000","last_change":"2024-08-17T02:23:35.597673+0000","last_active":"2024-08-17T02:23:35.603819+0000","last_peered":"2024-08-17T02:23:35.603819+0000","last_clean":"2024-08-17T02:23:35.603819+0000","last_became_active":"2024-08-17T02:23:35.596284+0000","last_became_peered":"2024-08-17T02:23:35.596284+0000","last_unstale":"2024-08-17T02:23:35.603819+0000","last_undegraded":"2024-08-17T02:23:35.603819+0000","last_fullsized":"2024-08-17T02:23:35.603819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.586639+0000","last_change":"2024-08-17T02:23:35.581433+0000","last_active":"2024-08-17T02:23:35.586639+0000","last_peered":"2024-08-17T02:23:35.586639+0000","last_clean":"2024-08-17T02:23:35.586639+0000","last_became_active":"2024-08-17T02:23:35.581150+0000","last_became_peered":"2024-08-17T02:23:35.581150+0000","last_unstale":"2024-08-17T02:23:35.586639+0000","last_undegraded":"2024-08-17T02:23:35.586639+0000","last_fullsized":"2024-08-17T02:23:35.586639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:19:09.314565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596841+0000","last_change":"2024-08-17T02:23:35.590432+0000","last_active":"2024-08-17T02:23:35.596841+0000","last_peered":"2024-08-17T02:23:35.596841+0000","last_clean":"2024-08-17T02:23:35.596841+0000","last_became_active":"2024-08-17T02:23:35.590171+0000","last_became_peered":"2024-08-17T02:23:35.590171+0000","last_unstale":"2024-08-17T02:23:35.596841+0000","last_undegraded":"2024-08-17T02:23:35.596841+0000","last_fullsized":"2024-08-17T02:23:35.596841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:44.471490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.581293+0000","last_change":"2024-08-17T02:23:35.576756+0000","last_active":"2024-08-17T02:23:35.581293+0000","last_peered":"2024-08-17T02:23:35.581293+0000","last_clean":"2024-08-17T02:23:35.581293+0000","last_became_active":"2024-08-17T02:23:35.575447+0000","last_became_peered":"2024-08-17T02:23:35.575447+0000","last_unstale":"2024-08-17T02:23:35.581293+0000","last_undegraded":"2024-08-17T02:23:35.581293+0000","last_fullsized":"2024-08-17T02:23:35.581293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:53.414346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.598137+0000","last_change":"2024-08-17T02:23:35.592931+0000","last_active":"2024-08-17T02:23:35.598137+0000","last_peered":"2024-08-17T02:23:35.598137+0000","last_clean":"2024-08-17T02:23:35.598137+0000","last_became_active":"2024-08-17T02:23:35.592658+0000","last_became_peered":"2024-08-17T02:23:35.592658+0000","last_unstale":"2024-08-17T02:23:35.598137+0000","last_undegraded":"2024-08-17T02:23:35.598137+0000","last_fullsized":"2024-08-17T02:23:35.598137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:53.892837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604091+0000","last_change":"2024-08-17T02:23:35.597950+0000","last_active":"2024-08-17T02:23:35.604091+0000","last_peered":"2024-08-17T02:23:35.604091+0000","last_clean":"2024-08-17T02:23:35.604091+0000","last_became_active":"2024-08-17T02:23:35.597671+0000","last_became_peered":"2024-08-17T02:23:35.597671+0000","last_unstale":"2024-08-17T02:23:35.604091+0000","last_undegraded":"2024-08-17T02:23:35.604091+0000","last_fullsized":"2024-08-17T02:23:35.604091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:47.878023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603319+0000","last_change":"2024-08-17T02:23:35.598952+0000","last_active":"2024-08-17T02:23:35.603319+0000","last_peered":"2024-08-17T02:23:35.603319+0000","last_clean":"2024-08-17T02:23:35.603319+0000","last_became_active":"2024-08-17T02:23:35.598602+0000","last_became_peered":"2024-08-17T02:23:35.598602+0000","last_unstale":"2024-08-17T02:23:35.603319+0000","last_undegraded":"2024-08-17T02:23:35.603319+0000","last_fullsized":"2024-08-17T02:23:35.603319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:16.596695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604477+0000","last_change":"2024-08-17T02:23:35.594022+0000","last_active":"2024-08-17T02:23:35.604477+0000","last_peered":"2024-08-17T02:23:35.604477+0000","last_clean":"2024-08-17T02:23:35.604477+0000","last_became_active":"2024-08-17T02:23:35.593747+0000","last_became_peered":"2024-08-17T02:23:35.593747+0000","last_unstale":"2024-08-17T02:23:35.604477+0000","last_undegraded":"2024-08-17T02:23:35.604477+0000","last_fullsized":"2024-08-17T02:23:35.604477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:30.865202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605226+0000","last_change":"2024-08-17T02:23:35.601823+0000","last_active":"2024-08-17T02:23:35.605226+0000","last_peered":"2024-08-17T02:23:35.605226+0000","last_clean":"2024-08-17T02:23:35.605226+0000","last_became_active":"2024-08-17T02:23:35.594672+0000","last_became_peered":"2024-08-17T02:23:35.594672+0000","last_unstale":"2024-08-17T02:23:35.605226+0000","last_undegraded":"2024-08-17T02:23:35.605226+0000","last_fullsized":"2024-08-17T02:23:35.605226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:30.865202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596800+0000","last_change":"2024-08-17T02:23:35.594464+0000","last_active":"2024-08-17T02:23:35.596800+0000","last_peered":"2024-08-17T02:23:35.596800+0000","last_clean":"2024-08-17T02:23:35.596800+0000","last_became_active":"2024-08-17T02:23:35.594132+0000","last_became_peered":"2024-08-17T02:23:35.594132+0000","last_unstale":"2024-08-17T02:23:35.596800+0000","last_undegraded":"2024-08-17T02:23:35.596800+0000","last_fullsized":"2024-08-17T02:23:35.596800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:16.596695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.587445+0000","last_change":"2024-08-17T02:23:35.584046+0000","last_active":"2024-08-17T02:23:35.587445+0000","last_peered":"2024-08-17T02:23:35.587445+0000","last_clean":"2024-08-17T02:23:35.587445+0000","last_became_active":"2024-08-17T02:23:35.583501+0000","last_became_peered":"2024-08-17T02:23:35.583501+0000","last_unstale":"2024-08-17T02:23:35.587445+0000","last_undegraded":"2024-08-17T02:23:35.587445+0000","last_fullsized":"2024-08-17T02:23:35.587445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603996+0000","last_change":"2024-08-17T02:23:35.601673+0000","last_active":"2024-08-17T02:23:35.603996+0000","last_peered":"2024-08-17T02:23:35.603996+0000","last_clean":"2024-08-17T02:23:35.603996+0000","last_became_active":"2024-08-17T02:23:35.600053+0000","last_became_peered":"2024-08-17T02:23:35.600053+0000","last_unstale":"2024-08-17T02:23:35.603996+0000","last_undegraded":"2024-08-17T02:23:35.603996+0000","last_fullsized":"2024-08-17T02:23:35.603996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603669+0000","last_change":"2024-08-17T02:23:35.596895+0000","last_active":"2024-08-17T02:23:35.603669+0000","last_peered":"2024-08-17T02:23:35.603669+0000","last_clean":"2024-08-17T02:23:35.603669+0000","last_became_active":"2024-08-17T02:23:35.596357+0000","last_became_peered":"2024-08-17T02:23:35.596357+0000","last_unstale":"2024-08-17T02:23:35.603669+0000","last_undegraded":"2024-08-17T02:23:35.603669+0000","last_fullsized":"2024-08-17T02:23:35.603669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:16.596695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604107+0000","last_change":"2024-08-17T02:23:35.598186+0000","last_active":"2024-08-17T02:23:35.604107+0000","last_peered":"2024-08-17T02:23:35.604107+0000","last_clean":"2024-08-17T02:23:35.604107+0000","last_became_active":"2024-08-17T02:23:35.597916+0000","last_became_peered":"2024-08-17T02:23:35.597916+0000","last_unstale":"2024-08-17T02:23:35.604107+0000","last_undegraded":"2024-08-17T02:23:35.604107+0000","last_fullsized":"2024-08-17T02:23:35.604107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:58.163230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.595983+0000","last_change":"2024-08-17T02:23:35.592760+0000","last_active":"2024-08-17T02:23:35.595983+0000","last_peered":"2024-08-17T02:23:35.595983+0000","last_clean":"2024-08-17T02:23:35.595983+0000","last_became_active":"2024-08-17T02:23:35.592422+0000","last_became_peered":"2024-08-17T02:23:35.592422+0000","last_unstale":"2024-08-17T02:23:35.595983+0000","last_undegraded":"2024-08-17T02:23:35.595983+0000","last_fullsized":"2024-08-17T02:23:35.595983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:14.018866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604612+0000","last_change":"2024-08-17T02:23:35.597586+0000","last_active":"2024-08-17T02:23:35.604612+0000","last_peered":"2024-08-17T02:23:35.604612+0000","last_clean":"2024-08-17T02:23:35.604612+0000","last_became_active":"2024-08-17T02:23:35.597307+0000","last_became_peered":"2024-08-17T02:23:35.597307+0000","last_unstale":"2024-08-17T02:23:35.604612+0000","last_undegraded":"2024-08-17T02:23:35.604612+0000","last_fullsized":"2024-08-17T02:23:35.604612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596676+0000","last_change":"2024-08-17T02:23:35.590260+0000","last_active":"2024-08-17T02:23:35.596676+0000","last_peered":"2024-08-17T02:23:35.596676+0000","last_clean":"2024-08-17T02:23:35.596676+0000","last_became_active":"2024-08-17T02:23:35.585495+0000","last_became_peered":"2024-08-17T02:23:35.585495+0000","last_unstale":"2024-08-17T02:23:35.596676+0000","last_undegraded":"2024-08-17T02:23:35.596676+0000","last_fullsized":"2024-08-17T02:23:35.596676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:21.900954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.608774+0000","last_change":"2024-08-17T02:23:34.577323+0000","last_active":"2024-08-17T02:23:35.608774+0000","last_peered":"2024-08-17T02:23:35.608774+0000","last_clean":"2024-08-17T02:23:35.608774+0000","last_became_active":"2024-08-17T02:23:34.577034+0000","last_became_peered":"2024-08-17T02:23:34.577034+0000","last_unstale":"2024-08-17T02:23:35.608774+0000","last_undegraded":"2024-08-17T02:23:35.608774+0000","last_fullsized":"2024-08-17T02:23:35.608774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:29.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603650+0000","last_change":"2024-08-17T02:23:35.596697+0000","last_active":"2024-08-17T02:23:35.603650+0000","last_peered":"2024-08-17T02:23:35.603650+0000","last_clean":"2024-08-17T02:23:35.603650+0000","last_became_active":"2024-08-17T02:23:35.595923+0000","last_became_peered":"2024-08-17T02:23:35.595923+0000","last_unstale":"2024-08-17T02:23:35.603650+0000","last_undegraded":"2024-08-17T02:23:35.603650+0000","last_fullsized":"2024-08-17T02:23:35.603650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:08:23.329877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.613478+0000","last_change":"2024-08-17T02:23:34.572025+0000","last_active":"2024-08-17T02:23:35.613478+0000","last_peered":"2024-08-17T02:23:35.613478+0000","last_clean":"2024-08-17T02:23:35.613478+0000","last_became_active":"2024-08-17T02:23:34.571705+0000","last_became_peered":"2024-08-17T02:23:34.571705+0000","last_unstale":"2024-08-17T02:23:35.613478+0000","last_undegraded":"2024-08-17T02:23:35.613478+0000","last_fullsized":"2024-08-17T02:23:35.613478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.576708+0000","last_change":"2024-08-17T02:23:34.580257+0000","last_active":"2024-08-17T02:23:35.576708+0000","last_peered":"2024-08-17T02:23:35.576708+0000","last_clean":"2024-08-17T02:23:35.576708+0000","last_became_active":"2024-08-17T02:23:34.579936+0000","last_became_peered":"2024-08-17T02:23:34.579936+0000","last_unstale":"2024-08-17T02:23:35.576708+0000","last_undegraded":"2024-08-17T02:23:35.576708+0000","last_fullsized":"2024-08-17T02:23:35.576708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:05:52.667388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603279+0000","last_change":"2024-08-17T02:23:35.597773+0000","last_active":"2024-08-17T02:23:35.603279+0000","last_peered":"2024-08-17T02:23:35.603279+0000","last_clean":"2024-08-17T02:23:35.603279+0000","last_became_active":"2024-08-17T02:23:35.597536+0000","last_became_peered":"2024-08-17T02:23:35.597536+0000","last_unstale":"2024-08-17T02:23:35.603279+0000","last_undegraded":"2024-08-17T02:23:35.603279+0000","last_fullsized":"2024-08-17T02:23:35.603279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:25:10.908502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583113+0000","last_change":"2024-08-17T02:23:34.577723+0000","last_active":"2024-08-17T02:23:35.583113+0000","last_peered":"2024-08-17T02:23:35.583113+0000","last_clean":"2024-08-17T02:23:35.583113+0000","last_became_active":"2024-08-17T02:23:34.577455+0000","last_became_peered":"2024-08-17T02:23:34.577455+0000","last_unstale":"2024-08-17T02:23:35.583113+0000","last_undegraded":"2024-08-17T02:23:35.583113+0000","last_fullsized":"2024-08-17T02:23:35.583113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:29.158549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.595349+0000","last_change":"2024-08-17T02:23:35.593879+0000","last_active":"2024-08-17T02:23:35.595349+0000","last_peered":"2024-08-17T02:23:35.595349+0000","last_clean":"2024-08-17T02:23:35.595349+0000","last_became_active":"2024-08-17T02:23:35.593445+0000","last_became_peered":"2024-08-17T02:23:35.593445+0000","last_unstale":"2024-08-17T02:23:35.595349+0000","last_undegraded":"2024-08-17T02:23:35.595349+0000","last_fullsized":"2024-08-17T02:23:35.595349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:53.892837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.571971+0000","last_change":"2024-08-17T02:23:34.579703+0000","last_active":"2024-08-17T02:23:35.571971+0000","last_peered":"2024-08-17T02:23:35.571971+0000","last_clean":"2024-08-17T02:23:35.571971+0000","last_became_active":"2024-08-17T02:23:34.579430+0000","last_became_peered":"2024-08-17T02:23:34.579430+0000","last_unstale":"2024-08-17T02:23:35.571971+0000","last_undegraded":"2024-08-17T02:23:35.571971+0000","last_fullsized":"2024-08-17T02:23:35.571971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:00.835021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603795+0000","last_change":"2024-08-17T02:23:35.596266+0000","last_active":"2024-08-17T02:23:35.603795+0000","last_peered":"2024-08-17T02:23:35.603795+0000","last_clean":"2024-08-17T02:23:35.603795+0000","last_became_active":"2024-08-17T02:23:35.593899+0000","last_became_peered":"2024-08-17T02:23:35.593899+0000","last_unstale":"2024-08-17T02:23:35.603795+0000","last_undegraded":"2024-08-17T02:23:35.603795+0000","last_fullsized":"2024-08-17T02:23:35.603795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:10.629891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.585770+0000","last_change":"2024-08-17T02:23:34.579638+0000","last_active":"2024-08-17T02:23:35.585770+0000","last_peered":"2024-08-17T02:23:35.585770+0000","last_clean":"2024-08-17T02:23:35.585770+0000","last_became_active":"2024-08-17T02:23:34.579374+0000","last_became_peered":"2024-08-17T02:23:34.579374+0000","last_unstale":"2024-08-17T02:23:35.585770+0000","last_undegraded":"2024-08-17T02:23:35.585770+0000","last_fullsized":"2024-08-17T02:23:35.585770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:28.453656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603912+0000","last_change":"2024-08-17T02:23:35.599779+0000","last_active":"2024-08-17T02:23:35.603912+0000","last_peered":"2024-08-17T02:23:35.603912+0000","last_clean":"2024-08-17T02:23:35.603912+0000","last_became_active":"2024-08-17T02:23:35.599431+0000","last_became_peered":"2024-08-17T02:23:35.599431+0000","last_unstale":"2024-08-17T02:23:35.603912+0000","last_undegraded":"2024-08-17T02:23:35.603912+0000","last_fullsized":"2024-08-17T02:23:35.603912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.610216+0000","last_change":"2024-08-17T02:23:34.587150+0000","last_active":"2024-08-17T02:23:35.610216+0000","last_peered":"2024-08-17T02:23:35.610216+0000","last_clean":"2024-08-17T02:23:35.610216+0000","last_became_active":"2024-08-17T02:23:34.586406+0000","last_became_peered":"2024-08-17T02:23:34.586406+0000","last_unstale":"2024-08-17T02:23:35.610216+0000","last_undegraded":"2024-08-17T02:23:35.610216+0000","last_fullsized":"2024-08-17T02:23:35.610216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:29:02.697073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.602428+0000","last_change":"2024-08-17T02:23:35.594894+0000","last_active":"2024-08-17T02:23:35.602428+0000","last_peered":"2024-08-17T02:23:35.602428+0000","last_clean":"2024-08-17T02:23:35.602428+0000","last_became_active":"2024-08-17T02:23:35.593967+0000","last_became_peered":"2024-08-17T02:23:35.593967+0000","last_unstale":"2024-08-17T02:23:35.602428+0000","last_undegraded":"2024-08-17T02:23:35.602428+0000","last_fullsized":"2024-08-17T02:23:35.602428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:13.277984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615851+0000","last_change":"2024-08-17T02:23:34.586772+0000","last_active":"2024-08-17T02:23:35.615851+0000","last_peered":"2024-08-17T02:23:35.615851+0000","last_clean":"2024-08-17T02:23:35.615851+0000","last_became_active":"2024-08-17T02:23:34.586079+0000","last_became_peered":"2024-08-17T02:23:34.586079+0000","last_unstale":"2024-08-17T02:23:35.615851+0000","last_undegraded":"2024-08-17T02:23:35.615851+0000","last_fullsized":"2024-08-17T02:23:35.615851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.606223+0000","last_change":"2024-08-17T02:23:35.603795+0000","last_active":"2024-08-17T02:23:35.606223+0000","last_peered":"2024-08-17T02:23:35.606223+0000","last_clean":"2024-08-17T02:23:35.606223+0000","last_became_active":"2024-08-17T02:23:35.603063+0000","last_became_peered":"2024-08-17T02:23:35.603063+0000","last_unstale":"2024-08-17T02:23:35.606223+0000","last_undegraded":"2024-08-17T02:23:35.606223+0000","last_fullsized":"2024-08-17T02:23:35.606223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:04:25.119433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.618735+0000","last_change":"2024-08-17T02:23:34.574467+0000","last_active":"2024-08-17T02:23:35.618735+0000","last_peered":"2024-08-17T02:23:35.618735+0000","last_clean":"2024-08-17T02:23:35.618735+0000","last_became_active":"2024-08-17T02:23:34.569946+0000","last_became_peered":"2024-08-17T02:23:34.569946+0000","last_unstale":"2024-08-17T02:23:35.618735+0000","last_undegraded":"2024-08-17T02:23:35.618735+0000","last_fullsized":"2024-08-17T02:23:35.618735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:20:34.979718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.598102+0000","last_change":"2024-08-17T02:23:35.592294+0000","last_active":"2024-08-17T02:23:35.598102+0000","last_peered":"2024-08-17T02:23:35.598102+0000","last_clean":"2024-08-17T02:23:35.598102+0000","last_became_active":"2024-08-17T02:23:35.591912+0000","last_became_peered":"2024-08-17T02:23:35.591912+0000","last_unstale":"2024-08-17T02:23:35.598102+0000","last_undegraded":"2024-08-17T02:23:35.598102+0000","last_fullsized":"2024-08-17T02:23:35.598102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:53.414346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583563+0000","last_change":"2024-08-17T02:23:34.587458+0000","last_active":"2024-08-17T02:23:35.583563+0000","last_peered":"2024-08-17T02:23:35.583563+0000","last_clean":"2024-08-17T02:23:35.583563+0000","last_became_active":"2024-08-17T02:23:34.587141+0000","last_became_peered":"2024-08-17T02:23:34.587141+0000","last_unstale":"2024-08-17T02:23:35.583563+0000","last_undegraded":"2024-08-17T02:23:35.583563+0000","last_fullsized":"2024-08-17T02:23:35.583563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605470+0000","last_change":"2024-08-17T02:23:35.601716+0000","last_active":"2024-08-17T02:23:35.605470+0000","last_peered":"2024-08-17T02:23:35.605470+0000","last_clean":"2024-08-17T02:23:35.605470+0000","last_became_active":"2024-08-17T02:23:35.600481+0000","last_became_peered":"2024-08-17T02:23:35.600481+0000","last_unstale":"2024-08-17T02:23:35.605470+0000","last_undegraded":"2024-08-17T02:23:35.605470+0000","last_fullsized":"2024-08-17T02:23:35.605470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:57:57.262402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.571127+0000","last_change":"2024-08-17T02:23:34.572877+0000","last_active":"2024-08-17T02:23:35.571127+0000","last_peered":"2024-08-17T02:23:35.571127+0000","last_clean":"2024-08-17T02:23:35.571127+0000","last_became_active":"2024-08-17T02:23:34.572606+0000","last_became_peered":"2024-08-17T02:23:34.572606+0000","last_unstale":"2024-08-17T02:23:35.571127+0000","last_undegraded":"2024-08-17T02:23:35.571127+0000","last_fullsized":"2024-08-17T02:23:35.571127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:28.453656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.596192+0000","last_change":"2024-08-17T02:23:35.590217+0000","last_active":"2024-08-17T02:23:35.596192+0000","last_peered":"2024-08-17T02:23:35.596192+0000","last_clean":"2024-08-17T02:23:35.596192+0000","last_became_active":"2024-08-17T02:23:35.589427+0000","last_became_peered":"2024-08-17T02:23:35.589427+0000","last_unstale":"2024-08-17T02:23:35.596192+0000","last_undegraded":"2024-08-17T02:23:35.596192+0000","last_fullsized":"2024-08-17T02:23:35.596192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:53.892837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.612998+0000","last_change":"2024-08-17T02:23:34.580970+0000","last_active":"2024-08-17T02:23:35.612998+0000","last_peered":"2024-08-17T02:23:35.612998+0000","last_clean":"2024-08-17T02:23:35.612998+0000","last_became_active":"2024-08-17T02:23:34.580699+0000","last_became_peered":"2024-08-17T02:23:34.580699+0000","last_unstale":"2024-08-17T02:23:35.612998+0000","last_undegraded":"2024-08-17T02:23:35.612998+0000","last_fullsized":"2024-08-17T02:23:35.612998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605360+0000","last_change":"2024-08-17T02:23:35.600825+0000","last_active":"2024-08-17T02:23:35.605360+0000","last_peered":"2024-08-17T02:23:35.605360+0000","last_clean":"2024-08-17T02:23:35.605360+0000","last_became_active":"2024-08-17T02:23:35.600525+0000","last_became_peered":"2024-08-17T02:23:35.600525+0000","last_unstale":"2024-08-17T02:23:35.605360+0000","last_undegraded":"2024-08-17T02:23:35.605360+0000","last_fullsized":"2024-08-17T02:23:35.605360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:30.865202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615727+0000","last_change":"2024-08-17T02:23:34.568078+0000","last_active":"2024-08-17T02:23:35.615727+0000","last_peered":"2024-08-17T02:23:35.615727+0000","last_clean":"2024-08-17T02:23:35.615727+0000","last_became_active":"2024-08-17T02:23:34.567754+0000","last_became_peered":"2024-08-17T02:23:34.567754+0000","last_unstale":"2024-08-17T02:23:35.615727+0000","last_undegraded":"2024-08-17T02:23:35.615727+0000","last_fullsized":"2024-08-17T02:23:35.615727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:45.647236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.605384+0000","last_change":"2024-08-17T02:23:35.600247+0000","last_active":"2024-08-17T02:23:35.605384+0000","last_peered":"2024-08-17T02:23:35.605384+0000","last_clean":"2024-08-17T02:23:35.605384+0000","last_became_active":"2024-08-17T02:23:35.599892+0000","last_became_peered":"2024-08-17T02:23:35.599892+0000","last_unstale":"2024-08-17T02:23:35.605384+0000","last_undegraded":"2024-08-17T02:23:35.605384+0000","last_fullsized":"2024-08-17T02:23:35.605384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:04.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.609828+0000","last_change":"2024-08-17T02:23:34.577876+0000","last_active":"2024-08-17T02:23:35.609828+0000","last_peered":"2024-08-17T02:23:35.609828+0000","last_clean":"2024-08-17T02:23:35.609828+0000","last_became_active":"2024-08-17T02:23:34.577501+0000","last_became_peered":"2024-08-17T02:23:34.577501+0000","last_unstale":"2024-08-17T02:23:35.609828+0000","last_undegraded":"2024-08-17T02:23:35.609828+0000","last_fullsized":"2024-08-17T02:23:35.609828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:33.519680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.606464+0000","last_change":"2024-08-17T02:23:35.604376+0000","last_active":"2024-08-17T02:23:35.606464+0000","last_peered":"2024-08-17T02:23:35.606464+0000","last_clean":"2024-08-17T02:23:35.606464+0000","last_became_active":"2024-08-17T02:23:35.604116+0000","last_became_peered":"2024-08-17T02:23:35.604116+0000","last_unstale":"2024-08-17T02:23:35.606464+0000","last_undegraded":"2024-08-17T02:23:35.606464+0000","last_fullsized":"2024-08-17T02:23:35.606464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:58.699491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.613587+0000","last_change":"2024-08-17T02:23:34.585195+0000","last_active":"2024-08-17T02:23:35.613587+0000","last_peered":"2024-08-17T02:23:35.613587+0000","last_clean":"2024-08-17T02:23:35.613587+0000","last_became_active":"2024-08-17T02:23:34.584875+0000","last_became_peered":"2024-08-17T02:23:34.584875+0000","last_unstale":"2024-08-17T02:23:35.613587+0000","last_undegraded":"2024-08-17T02:23:35.613587+0000","last_fullsized":"2024-08-17T02:23:35.613587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:00.835021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.594448+0000","last_change":"2024-08-17T02:23:35.589341+0000","last_active":"2024-08-17T02:23:35.594448+0000","last_peered":"2024-08-17T02:23:35.594448+0000","last_clean":"2024-08-17T02:23:35.594448+0000","last_became_active":"2024-08-17T02:23:35.588957+0000","last_became_peered":"2024-08-17T02:23:35.588957+0000","last_unstale":"2024-08-17T02:23:35.594448+0000","last_undegraded":"2024-08-17T02:23:35.594448+0000","last_fullsized":"2024-08-17T02:23:35.594448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:57:57.262402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.576331+0000","last_change":"2024-08-17T02:23:34.587854+0000","last_active":"2024-08-17T02:23:35.576331+0000","last_peered":"2024-08-17T02:23:35.576331+0000","last_clean":"2024-08-17T02:23:35.576331+0000","last_became_active":"2024-08-17T02:23:34.587549+0000","last_became_peered":"2024-08-17T02:23:34.587549+0000","last_unstale":"2024-08-17T02:23:35.576331+0000","last_undegraded":"2024-08-17T02:23:35.576331+0000","last_fullsized":"2024-08-17T02:23:35.576331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:00.835021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.602005+0000","last_change":"2024-08-17T02:23:35.596727+0000","last_active":"2024-08-17T02:23:35.602005+0000","last_peered":"2024-08-17T02:23:35.602005+0000","last_clean":"2024-08-17T02:23:35.602005+0000","last_became_active":"2024-08-17T02:23:35.596442+0000","last_became_peered":"2024-08-17T02:23:35.596442+0000","last_unstale":"2024-08-17T02:23:35.602005+0000","last_undegraded":"2024-08-17T02:23:35.602005+0000","last_fullsized":"2024-08-17T02:23:35.602005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:53.779150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.580926+0000","last_change":"2024-08-17T02:23:30.651033+0000","last_active":"2024-08-17T02:23:35.580926+0000","last_peered":"2024-08-17T02:23:35.580926+0000","last_clean":"2024-08-17T02:23:35.580926+0000","last_became_active":"2024-08-17T02:23:30.649860+0000","last_became_peered":"2024-08-17T02:23:30.649860+0000","last_unstale":"2024-08-17T02:23:35.580926+0000","last_undegraded":"2024-08-17T02:23:35.580926+0000","last_fullsized":"2024-08-17T02:23:35.580926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.523857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:29:35.288625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583338+0000","last_change":"2024-08-17T02:23:34.574229+0000","last_active":"2024-08-17T02:23:35.583338+0000","last_peered":"2024-08-17T02:23:35.583338+0000","last_clean":"2024-08-17T02:23:35.583338+0000","last_became_active":"2024-08-17T02:23:34.573885+0000","last_became_peered":"2024-08-17T02:23:34.573885+0000","last_unstale":"2024-08-17T02:23:35.583338+0000","last_undegraded":"2024-08-17T02:23:35.583338+0000","last_fullsized":"2024-08-17T02:23:35.583338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:33.519680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.602258+0000","last_change":"2024-08-17T02:23:35.593836+0000","last_active":"2024-08-17T02:23:35.602258+0000","last_peered":"2024-08-17T02:23:35.602258+0000","last_clean":"2024-08-17T02:23:35.602258+0000","last_became_active":"2024-08-17T02:23:35.593564+0000","last_became_peered":"2024-08-17T02:23:35.593564+0000","last_unstale":"2024-08-17T02:23:35.602258+0000","last_undegraded":"2024-08-17T02:23:35.602258+0000","last_fullsized":"2024-08-17T02:23:35.602258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:47.878023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.580838+0000","last_change":"2024-08-17T02:23:34.582041+0000","last_active":"2024-08-17T02:23:35.580838+0000","last_peered":"2024-08-17T02:23:35.580838+0000","last_clean":"2024-08-17T02:23:35.580838+0000","last_became_active":"2024-08-17T02:23:34.581786+0000","last_became_peered":"2024-08-17T02:23:34.581786+0000","last_unstale":"2024-08-17T02:23:35.580838+0000","last_undegraded":"2024-08-17T02:23:35.580838+0000","last_fullsized":"2024-08-17T02:23:35.580838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:53.571063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.598226+0000","last_change":"2024-08-17T02:23:35.593384+0000","last_active":"2024-08-17T02:23:35.598226+0000","last_peered":"2024-08-17T02:23:35.598226+0000","last_clean":"2024-08-17T02:23:35.598226+0000","last_became_active":"2024-08-17T02:23:35.593105+0000","last_became_peered":"2024-08-17T02:23:35.593105+0000","last_unstale":"2024-08-17T02:23:35.598226+0000","last_undegraded":"2024-08-17T02:23:35.598226+0000","last_fullsized":"2024-08-17T02:23:35.598226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:19:09.314565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.576062+0000","last_change":"2024-08-17T02:23:34.577822+0000","last_active":"2024-08-17T02:23:35.576062+0000","last_peered":"2024-08-17T02:23:35.576062+0000","last_clean":"2024-08-17T02:23:35.576062+0000","last_became_active":"2024-08-17T02:23:34.577467+0000","last_became_peered":"2024-08-17T02:23:34.577467+0000","last_unstale":"2024-08-17T02:23:35.576062+0000","last_undegraded":"2024-08-17T02:23:35.576062+0000","last_fullsized":"2024-08-17T02:23:35.576062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.588280+0000","last_change":"2024-08-17T02:23:35.584388+0000","last_active":"2024-08-17T02:23:35.588280+0000","last_peered":"2024-08-17T02:23:35.588280+0000","last_clean":"2024-08-17T02:23:35.588280+0000","last_became_active":"2024-08-17T02:23:35.584056+0000","last_became_peered":"2024-08-17T02:23:35.584056+0000","last_unstale":"2024-08-17T02:23:35.588280+0000","last_undegraded":"2024-08-17T02:23:35.588280+0000","last_fullsized":"2024-08-17T02:23:35.588280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:37.276820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583764+0000","last_change":"2024-08-17T02:23:34.585609+0000","last_active":"2024-08-17T02:23:35.583764+0000","last_peered":"2024-08-17T02:23:35.583764+0000","last_clean":"2024-08-17T02:23:35.583764+0000","last_became_active":"2024-08-17T02:23:34.585328+0000","last_became_peered":"2024-08-17T02:23:34.585328+0000","last_unstale":"2024-08-17T02:23:35.583764+0000","last_undegraded":"2024-08-17T02:23:35.583764+0000","last_fullsized":"2024-08-17T02:23:35.583764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.593219+0000","last_change":"2024-08-17T02:23:35.582716+0000","last_active":"2024-08-17T02:23:35.593219+0000","last_peered":"2024-08-17T02:23:35.593219+0000","last_clean":"2024-08-17T02:23:35.593219+0000","last_became_active":"2024-08-17T02:23:35.582042+0000","last_became_peered":"2024-08-17T02:23:35.582042+0000","last_unstale":"2024-08-17T02:23:35.593219+0000","last_undegraded":"2024-08-17T02:23:35.593219+0000","last_fullsized":"2024-08-17T02:23:35.593219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:19.127243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.570431+0000","last_change":"2024-08-17T02:23:34.579748+0000","last_active":"2024-08-17T02:23:35.570431+0000","last_peered":"2024-08-17T02:23:35.570431+0000","last_clean":"2024-08-17T02:23:35.570431+0000","last_became_active":"2024-08-17T02:23:34.579282+0000","last_became_peered":"2024-08-17T02:23:34.579282+0000","last_unstale":"2024-08-17T02:23:35.570431+0000","last_undegraded":"2024-08-17T02:23:35.570431+0000","last_fullsized":"2024-08-17T02:23:35.570431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:53.571063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604616+0000","last_change":"2024-08-17T02:23:35.599794+0000","last_active":"2024-08-17T02:23:35.604616+0000","last_peered":"2024-08-17T02:23:35.604616+0000","last_clean":"2024-08-17T02:23:35.604616+0000","last_became_active":"2024-08-17T02:23:35.596190+0000","last_became_peered":"2024-08-17T02:23:35.596190+0000","last_unstale":"2024-08-17T02:23:35.604616+0000","last_undegraded":"2024-08-17T02:23:35.604616+0000","last_fullsized":"2024-08-17T02:23:35.604616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.583507+0000","last_change":"2024-08-17T02:23:34.585808+0000","last_active":"2024-08-17T02:23:35.583507+0000","last_peered":"2024-08-17T02:23:35.583507+0000","last_clean":"2024-08-17T02:23:35.583507+0000","last_became_active":"2024-08-17T02:23:34.584698+0000","last_became_peered":"2024-08-17T02:23:34.584698+0000","last_unstale":"2024-08-17T02:23:35.583507+0000","last_undegraded":"2024-08-17T02:23:35.583507+0000","last_fullsized":"2024-08-17T02:23:35.583507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:29:02.697073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.588719+0000","last_change":"2024-08-17T02:23:35.584214+0000","last_active":"2024-08-17T02:23:35.588719+0000","last_peered":"2024-08-17T02:23:35.588719+0000","last_clean":"2024-08-17T02:23:35.588719+0000","last_became_active":"2024-08-17T02:23:35.583938+0000","last_became_peered":"2024-08-17T02:23:35.583938+0000","last_unstale":"2024-08-17T02:23:35.588719+0000","last_undegraded":"2024-08-17T02:23:35.588719+0000","last_fullsized":"2024-08-17T02:23:35.588719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:16.596695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:23:36.579851+0000","last_change":"2024-08-17T02:23:34.576832+0000","last_active":"2024-08-17T02:23:36.579851+0000","last_peered":"2024-08-17T02:23:36.579851+0000","last_clean":"2024-08-17T02:23:36.579851+0000","last_became_active":"2024-08-17T02:23:34.576507+0000","last_became_peered":"2024-08-17T02:23:34.576507+0000","last_unstale":"2024-08-17T02:23:36.579851+0000","last_undegraded":"2024-08-17T02:23:36.579851+0000","last_fullsized":"2024-08-17T02:23:36.579851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.591343+0000","last_change":"2024-08-17T02:23:35.590465+0000","last_active":"2024-08-17T02:23:35.591343+0000","last_peered":"2024-08-17T02:23:35.591343+0000","last_clean":"2024-08-17T02:23:35.591343+0000","last_became_active":"2024-08-17T02:23:35.590114+0000","last_became_peered":"2024-08-17T02:23:35.590114+0000","last_unstale":"2024-08-17T02:23:35.591343+0000","last_undegraded":"2024-08-17T02:23:35.591343+0000","last_fullsized":"2024-08-17T02:23:35.591343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:53.892837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615597+0000","last_change":"2024-08-17T02:23:34.579565+0000","last_active":"2024-08-17T02:23:35.615597+0000","last_peered":"2024-08-17T02:23:35.615597+0000","last_clean":"2024-08-17T02:23:35.615597+0000","last_became_active":"2024-08-17T02:23:34.579256+0000","last_became_peered":"2024-08-17T02:23:34.579256+0000","last_unstale":"2024-08-17T02:23:35.615597+0000","last_undegraded":"2024-08-17T02:23:35.615597+0000","last_fullsized":"2024-08-17T02:23:35.615597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:33.519680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.598466+0000","last_change":"2024-08-17T02:23:35.591642+0000","last_active":"2024-08-17T02:23:35.598466+0000","last_peered":"2024-08-17T02:23:35.598466+0000","last_clean":"2024-08-17T02:23:35.598466+0000","last_became_active":"2024-08-17T02:23:35.591364+0000","last_became_peered":"2024-08-17T02:23:35.591364+0000","last_unstale":"2024-08-17T02:23:35.598466+0000","last_undegraded":"2024-08-17T02:23:35.598466+0000","last_fullsized":"2024-08-17T02:23:35.598466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:10.629891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.580732+0000","last_change":"2024-08-17T02:23:34.584710+0000","last_active":"2024-08-17T02:23:35.580732+0000","last_peered":"2024-08-17T02:23:35.580732+0000","last_clean":"2024-08-17T02:23:35.580732+0000","last_became_active":"2024-08-17T02:23:34.584459+0000","last_became_peered":"2024-08-17T02:23:34.584459+0000","last_unstale":"2024-08-17T02:23:35.580732+0000","last_undegraded":"2024-08-17T02:23:35.580732+0000","last_fullsized":"2024-08-17T02:23:35.580732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:39.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.592273+0000","last_change":"2024-08-17T02:23:35.579802+0000","last_active":"2024-08-17T02:23:35.592273+0000","last_peered":"2024-08-17T02:23:35.592273+0000","last_clean":"2024-08-17T02:23:35.592273+0000","last_became_active":"2024-08-17T02:23:35.579505+0000","last_became_peered":"2024-08-17T02:23:35.579505+0000","last_unstale":"2024-08-17T02:23:35.592273+0000","last_undegraded":"2024-08-17T02:23:35.592273+0000","last_fullsized":"2024-08-17T02:23:35.592273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:51.900850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.569935+0000","last_change":"2024-08-17T02:23:34.584346+0000","last_active":"2024-08-17T02:23:35.569935+0000","last_peered":"2024-08-17T02:23:35.569935+0000","last_clean":"2024-08-17T02:23:35.569935+0000","last_became_active":"2024-08-17T02:23:34.584030+0000","last_became_peered":"2024-08-17T02:23:34.584030+0000","last_unstale":"2024-08-17T02:23:35.569935+0000","last_undegraded":"2024-08-17T02:23:35.569935+0000","last_fullsized":"2024-08-17T02:23:35.569935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.602212+0000","last_change":"2024-08-17T02:23:35.593165+0000","last_active":"2024-08-17T02:23:35.602212+0000","last_peered":"2024-08-17T02:23:35.602212+0000","last_clean":"2024-08-17T02:23:35.602212+0000","last_became_active":"2024-08-17T02:23:35.585416+0000","last_became_peered":"2024-08-17T02:23:35.585416+0000","last_unstale":"2024-08-17T02:23:35.602212+0000","last_undegraded":"2024-08-17T02:23:35.602212+0000","last_fullsized":"2024-08-17T02:23:35.602212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:10.629891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.569524+0000","last_change":"2024-08-17T02:23:34.586914+0000","last_active":"2024-08-17T02:23:35.569524+0000","last_peered":"2024-08-17T02:23:35.569524+0000","last_clean":"2024-08-17T02:23:35.569524+0000","last_became_active":"2024-08-17T02:23:34.586476+0000","last_became_peered":"2024-08-17T02:23:34.586476+0000","last_unstale":"2024-08-17T02:23:35.569524+0000","last_undegraded":"2024-08-17T02:23:35.569524+0000","last_fullsized":"2024-08-17T02:23:35.569524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:20:34.979718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.589645+0000","last_change":"2024-08-17T02:23:35.585526+0000","last_active":"2024-08-17T02:23:35.589645+0000","last_peered":"2024-08-17T02:23:35.589645+0000","last_clean":"2024-08-17T02:23:35.589645+0000","last_became_active":"2024-08-17T02:23:35.585223+0000","last_became_peered":"2024-08-17T02:23:35.585223+0000","last_unstale":"2024-08-17T02:23:35.589645+0000","last_undegraded":"2024-08-17T02:23:35.589645+0000","last_fullsized":"2024-08-17T02:23:35.589645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:37.276820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615445+0000","last_change":"2024-08-17T02:23:34.583608+0000","last_active":"2024-08-17T02:23:35.615445+0000","last_peered":"2024-08-17T02:23:35.615445+0000","last_clean":"2024-08-17T02:23:35.615445+0000","last_became_active":"2024-08-17T02:23:34.583262+0000","last_became_peered":"2024-08-17T02:23:34.583262+0000","last_unstale":"2024-08-17T02:23:35.615445+0000","last_undegraded":"2024-08-17T02:23:35.615445+0000","last_fullsized":"2024-08-17T02:23:35.615445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:08.127226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.584243+0000","last_change":"2024-08-17T02:23:35.582216+0000","last_active":"2024-08-17T02:23:35.584243+0000","last_peered":"2024-08-17T02:23:35.584243+0000","last_clean":"2024-08-17T02:23:35.584243+0000","last_became_active":"2024-08-17T02:23:35.581896+0000","last_became_peered":"2024-08-17T02:23:35.581896+0000","last_unstale":"2024-08-17T02:23:35.584243+0000","last_undegraded":"2024-08-17T02:23:35.584243+0000","last_fullsized":"2024-08-17T02:23:35.584243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:37.276820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.604633+0000","last_change":"2024-08-17T02:23:35.600164+0000","last_active":"2024-08-17T02:23:35.604633+0000","last_peered":"2024-08-17T02:23:35.604633+0000","last_clean":"2024-08-17T02:23:35.604633+0000","last_became_active":"2024-08-17T02:23:35.594009+0000","last_became_peered":"2024-08-17T02:23:35.594009+0000","last_unstale":"2024-08-17T02:23:35.604633+0000","last_undegraded":"2024-08-17T02:23:35.604633+0000","last_fullsized":"2024-08-17T02:23:35.604633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:04:25.119433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.615820+0000","last_change":"2024-08-17T02:23:34.586673+0000","last_active":"2024-08-17T02:23:35.615820+0000","last_peered":"2024-08-17T02:23:35.615820+0000","last_clean":"2024-08-17T02:23:35.615820+0000","last_became_active":"2024-08-17T02:23:34.586204+0000","last_became_peered":"2024-08-17T02:23:34.586204+0000","last_unstale":"2024-08-17T02:23:35.615820+0000","last_undegraded":"2024-08-17T02:23:35.615820+0000","last_fullsized":"2024-08-17T02:23:35.615820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:54:12.191670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603990+0000","last_change":"2024-08-17T02:23:35.597722+0000","last_active":"2024-08-17T02:23:35.603990+0000","last_peered":"2024-08-17T02:23:35.603990+0000","last_clean":"2024-08-17T02:23:35.603990+0000","last_became_active":"2024-08-17T02:23:35.593591+0000","last_became_peered":"2024-08-17T02:23:35.593591+0000","last_unstale":"2024-08-17T02:23:35.603990+0000","last_undegraded":"2024-08-17T02:23:35.603990+0000","last_fullsized":"2024-08-17T02:23:35.603990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:54:21.053209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.612181+0000","last_change":"2024-08-17T02:23:34.576713+0000","last_active":"2024-08-17T02:23:35.612181+0000","last_peered":"2024-08-17T02:23:35.612181+0000","last_clean":"2024-08-17T02:23:35.612181+0000","last_became_active":"2024-08-17T02:23:34.576458+0000","last_became_peered":"2024-08-17T02:23:34.576458+0000","last_unstale":"2024-08-17T02:23:35.612181+0000","last_undegraded":"2024-08-17T02:23:35.612181+0000","last_fullsized":"2024-08-17T02:23:35.612181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:00.835021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.603641+0000","last_change":"2024-08-17T02:23:35.597367+0000","last_active":"2024-08-17T02:23:35.603641+0000","last_peered":"2024-08-17T02:23:35.603641+0000","last_clean":"2024-08-17T02:23:35.603641+0000","last_became_active":"2024-08-17T02:23:35.597133+0000","last_became_peered":"2024-08-17T02:23:35.597133+0000","last_unstale":"2024-08-17T02:23:35.603641+0000","last_undegraded":"2024-08-17T02:23:35.603641+0000","last_fullsized":"2024-08-17T02:23:35.603641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:19.354664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.610320+0000","last_change":"2024-08-17T02:23:34.573028+0000","last_active":"2024-08-17T02:23:35.610320+0000","last_peered":"2024-08-17T02:23:35.610320+0000","last_clean":"2024-08-17T02:23:35.610320+0000","last_became_active":"2024-08-17T02:23:34.572521+0000","last_became_peered":"2024-08-17T02:23:34.572521+0000","last_unstale":"2024-08-17T02:23:35.610320+0000","last_undegraded":"2024-08-17T02:23:35.610320+0000","last_fullsized":"2024-08-17T02:23:35.610320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:20:34.979718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.590393+0000","last_change":"2024-08-17T02:23:35.587484+0000","last_active":"2024-08-17T02:23:35.590393+0000","last_peered":"2024-08-17T02:23:35.590393+0000","last_clean":"2024-08-17T02:23:35.590393+0000","last_became_active":"2024-08-17T02:23:35.585250+0000","last_became_peered":"2024-08-17T02:23:35.585250+0000","last_unstale":"2024-08-17T02:23:35.590393+0000","last_undegraded":"2024-08-17T02:23:35.590393+0000","last_fullsized":"2024-08-17T02:23:35.590393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:34.549139+0000","last_clean_scrub_stamp":"2024-08-17T02:23:34.549139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:58.770937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:23:35.616297+0000","last_change":"2024-08-17T02:23:34.577769+0000","last_active":"2024-08-17T02:23:35.616297+0000","last_peered":"2024-08-17T02:23:35.616297+0000","last_clean":"2024-08-17T02:23:35.616297+0000","last_became_active":"2024-08-17T02:23:34.576757+0000","last_became_peered":"2024-08-17T02:23:34.576757+0000","last_unstale":"2024-08-17T02:23:35.616297+0000","last_undegraded":"2024-08-17T02:23:35.616297+0000","last_fullsized":"2024-08-17T02:23:35.616297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:33.542608+0000","last_clean_scrub_stamp":"2024-08-17T02:23:33.542608+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:05:52.667388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":823296,"data_stored":669534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":237568,"data_stored":80148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4009999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2959999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":78686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":237568,"data_stored":78722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301752,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070088,"statfs":{"total":96636764160,"available":96327770112,"internally_reserved":0,"allocated":237568,"data_stored":80148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":225280,"data_stored":78596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301748,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070092,"statfs":{"total":96636764160,"available":96327774208,"internally_reserved":0,"allocated":233472,"data_stored":78756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.968}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7149999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3279999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.544}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302328,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069512,"statfs":{"total":96636764160,"available":96327180288,"internally_reserved":0,"allocated":831488,"data_stored":669590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:23:45.290 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:23:45.290 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:23:45.290 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:23:45.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.475+0000 7f7027000640 1 Processor -- start 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.475+0000 7f7027000640 1 -- start start 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.476+0000 7f7027000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7020158b90 0x7f70200b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.476+0000 7f7027000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70200b2370 0x7f70200aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.476+0000 7f7027000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f70200aef60 0x7f7020068630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.476+0000 7f7027000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70200af380 con 0x7f7020158b90 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.476+0000 7f7027000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70200afd20 con 0x7f70200aef60 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.476+0000 7f7027000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70200affe0 con 0x7f70200b2370 2024-08-17T02:23:45.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.476+0000 7f701fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7020158b90 0x7f70200b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.476+0000 7f701fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7020158b90 0x7f70200b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44222/0 (socket says 172.21.15.5:44222) 2024-08-17T02:23:45.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.476+0000 7f701fe00640 1 -- 172.21.15.5:0/512070163 learned_addr learned my addr 172.21.15.5:0/512070163 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:45.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.477+0000 7f701f400640 1 --2- 172.21.15.5:0/512070163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70200b2370 0x7f70200aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.477+0000 7f7025000640 1 --2- 172.21.15.5:0/512070163 >> v2:172.21.15.87:3300/0 conn(0x7f70200aef60 0x7f7020068630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.477+0000 7f701fe00640 1 -- 172.21.15.5:0/512070163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70200b2370 msgr2=0x7f70200aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:45.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.477+0000 7f701fe00640 1 --2- 172.21.15.5:0/512070163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70200b2370 0x7f70200aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.477+0000 7f701fe00640 1 -- 172.21.15.5:0/512070163 >> v2:172.21.15.87:3300/0 conn(0x7f70200aef60 msgr2=0x7f7020068630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:45.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.477+0000 7f701fe00640 1 --2- 172.21.15.5:0/512070163 >> v2:172.21.15.87:3300/0 conn(0x7f70200aef60 0x7f7020068630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.477+0000 7f701fe00640 1 -- 172.21.15.5:0/512070163 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70200b02c0 con 0x7f7020158b90 2024-08-17T02:23:45.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.478+0000 7f701fe00640 1 --2- 172.21.15.5:0/512070163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7020158b90 0x7f70200b1e30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f70200cc310 tx=0x7f70100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c347e882bec75605 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:45.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.478+0000 7f701ea00640 1 -- 172.21.15.5:0/512070163 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701002add0 con 0x7f7020158b90 2024-08-17T02:23:45.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.478+0000 7f701ea00640 1 -- 172.21.15.5:0/512070163 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7010032440 con 0x7f7020158b90 2024-08-17T02:23:45.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.478+0000 7f701ea00640 1 -- 172.21.15.5:0/512070163 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010032820 con 0x7f7020158b90 2024-08-17T02:23:45.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.479+0000 7f7027000640 1 -- 172.21.15.5:0/512070163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7020158b90 msgr2=0x7f70200b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.479+0000 7f7027000640 1 --2- 172.21.15.5:0/512070163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7020158b90 0x7f70200b1e30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f70200cc310 tx=0x7f70100091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.479+0000 7f7027000640 1 -- 172.21.15.5:0/512070163 shutdown_connections 2024-08-17T02:23:45.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.479+0000 7f7027000640 1 --2- 172.21.15.5:0/512070163 >> v2:172.21.15.87:3300/0 conn(0x7f70200aef60 0x7f7020068630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.479+0000 7f7027000640 1 --2- 172.21.15.5:0/512070163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70200b2370 0x7f70200aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.479+0000 7f7027000640 1 --2- 172.21.15.5:0/512070163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7020158b90 0x7f70200b1e30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.479+0000 7f7027000640 1 -- 172.21.15.5:0/512070163 >> 172.21.15.5:0/512070163 conn(0x7f702006e590 msgr2=0x7f702006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:45.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.479+0000 7f7027000640 1 -- 172.21.15.5:0/512070163 shutdown_connections 2024-08-17T02:23:45.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.479+0000 7f7027000640 1 -- 172.21.15.5:0/512070163 wait complete. 2024-08-17T02:23:45.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.480+0000 7f7027000640 1 Processor -- start 2024-08-17T02:23:45.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.480+0000 7f7027000640 1 -- start start 2024-08-17T02:23:45.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.481+0000 7f7027000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70200aef60 0x7f70200c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.481+0000 7f7027000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70200b2370 0x7f70200c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.481+0000 7f7027000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7020158b90 0x7f70200c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.481+0000 7f7027000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70200c5fb0 con 0x7f70200b2370 2024-08-17T02:23:45.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.481+0000 7f7027000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70200c93c0 con 0x7f7020158b90 2024-08-17T02:23:45.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.481+0000 7f7027000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70200c6fe0 con 0x7f70200aef60 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.481+0000 7f701f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70200b2370 0x7f70200c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.481+0000 7f701f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70200b2370 0x7f70200c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44236/0 (socket says 172.21.15.5:44236) 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.481+0000 7f701f400640 1 -- 172.21.15.5:0/1664378897 learned_addr learned my addr 172.21.15.5:0/1664378897 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.481+0000 7f701fe00640 1 --2- 172.21.15.5:0/1664378897 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70200aef60 0x7f70200c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.482+0000 7f7025000640 1 --2- 172.21.15.5:0/1664378897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7020158b90 0x7f70200c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.482+0000 7f701f400640 1 -- 172.21.15.5:0/1664378897 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70200aef60 msgr2=0x7f70200c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.482+0000 7f701f400640 1 --2- 172.21.15.5:0/1664378897 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70200aef60 0x7f70200c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.482+0000 7f701f400640 1 -- 172.21.15.5:0/1664378897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7020158b90 msgr2=0x7f70200c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.482+0000 7f701f400640 1 --2- 172.21.15.5:0/1664378897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7020158b90 0x7f70200c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.482+0000 7f701f400640 1 -- 172.21.15.5:0/1664378897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7010009450 con 0x7f70200b2370 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.482+0000 7f701f400640 1 --2- 172.21.15.5:0/1664378897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70200b2370 0x7f70200c7be0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f700c00d8c0 tx=0x7f700c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.482+0000 7f7017400640 1 -- 172.21.15.5:0/1664378897 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c00de50 con 0x7f70200b2370 2024-08-17T02:23:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.482+0000 7f7017400640 1 -- 172.21.15.5:0/1664378897 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c00b8d0 con 0x7f70200b2370 2024-08-17T02:23:45.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.482+0000 7f7027000640 1 -- 172.21.15.5:0/1664378897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70200c87b0 con 0x7f70200b2370 2024-08-17T02:23:45.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.482+0000 7f7017400640 1 -- 172.21.15.5:0/1664378897 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c00bc70 con 0x7f70200b2370 2024-08-17T02:23:45.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.483+0000 7f7027000640 1 -- 172.21.15.5:0/1664378897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70200c8d70 con 0x7f70200b2370 2024-08-17T02:23:45.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.484+0000 7f7027000640 1 -- 172.21.15.5:0/1664378897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7020063fb0 con 0x7f70200b2370 2024-08-17T02:23:45.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.484+0000 7f7017400640 1 -- 172.21.15.5:0/1664378897 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f700c014640 con 0x7f70200b2370 2024-08-17T02:23:45.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.486+0000 7f7017400640 1 --2- 172.21.15.5:0/1664378897 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7000065150 0x7f7000067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.486+0000 7f7017400640 1 -- 172.21.15.5:0/1664378897 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f700c082a00 con 0x7f70200b2370 2024-08-17T02:23:45.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.486+0000 7f701fe00640 1 --2- 172.21.15.5:0/1664378897 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7000065150 0x7f7000067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.486+0000 7f701fe00640 1 --2- 172.21.15.5:0/1664378897 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7000065150 0x7f7000067600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7010034000 tx=0x7f7010032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:45.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.490+0000 7f7017400640 1 -- 172.21.15.5:0/1664378897 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f700c050b90 con 0x7f70200b2370 2024-08-17T02:23:45.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.706+0000 7f7027000640 1 -- 172.21.15.5:0/1664378897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7020158740 con 0x7f70200b2370 2024-08-17T02:23:45.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.707+0000 7f7017400640 1 -- 172.21.15.5:0/1664378897 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f700c0541b0 con 0x7f70200b2370 2024-08-17T02:23:45.707 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:45.707 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:23:45.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.709+0000 7f7027000640 1 -- 172.21.15.5:0/1664378897 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7000065150 msgr2=0x7f7000067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.709+0000 7f7027000640 1 --2- 172.21.15.5:0/1664378897 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7000065150 0x7f7000067600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7010034000 tx=0x7f7010032000 comp rx=0 tx=0).stop 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.709+0000 7f7027000640 1 -- 172.21.15.5:0/1664378897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70200b2370 msgr2=0x7f70200c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.709+0000 7f7027000640 1 --2- 172.21.15.5:0/1664378897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70200b2370 0x7f70200c7be0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f700c00d8c0 tx=0x7f700c008040 comp rx=0 tx=0).stop 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.709+0000 7f7027000640 1 -- 172.21.15.5:0/1664378897 shutdown_connections 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.709+0000 7f7027000640 1 --2- 172.21.15.5:0/1664378897 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7000065150 0x7f7000067600 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.709+0000 7f7027000640 1 --2- 172.21.15.5:0/1664378897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7020158b90 0x7f70200c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.709+0000 7f7027000640 1 --2- 172.21.15.5:0/1664378897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70200b2370 0x7f70200c7be0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.709+0000 7f7027000640 1 --2- 172.21.15.5:0/1664378897 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70200aef60 0x7f70200c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.709+0000 7f7027000640 1 -- 172.21.15.5:0/1664378897 >> 172.21.15.5:0/1664378897 conn(0x7f702006e590 msgr2=0x7f702006fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.709+0000 7f7027000640 1 -- 172.21.15.5:0/1664378897 shutdown_connections 2024-08-17T02:23:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.709+0000 7f7027000640 1 -- 172.21.15.5:0/1664378897 wait complete. 2024-08-17T02:23:45.725 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:23:45.725 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:45.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.876+0000 7fa945800640 1 Processor -- start 2024-08-17T02:23:45.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.876+0000 7fa945800640 1 -- start start 2024-08-17T02:23:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.877+0000 7fa945800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9400ad960 0x7fa94015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.878+0000 7fa945800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94015b5e0 con 0x7fa9400ca050 2024-08-17T02:23:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.878+0000 7fa945800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9400cb160 con 0x7fa9400add30 2024-08-17T02:23:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.878+0000 7fa945800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9400b0d10 con 0x7fa9400ad960 2024-08-17T02:23:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.878+0000 7fa937e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa9400ca050 0x7fa940156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49392/0 (socket says 172.21.15.5:49392) 2024-08-17T02:23:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.878+0000 7fa937e00640 1 -- 172.21.15.5:0/1167931153 learned_addr learned my addr 172.21.15.5:0/1167931153 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.878+0000 7fa93ea00640 1 --2- 172.21.15.5:0/1167931153 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9400ad960 0x7fa94015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.878+0000 7fa93e000640 1 -- 172.21.15.5:0/1167931153 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426909201 0 0) 0x7fa928001110 con 0x7fa9400ca050 2024-08-17T02:23:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.878+0000 7fa93e000640 1 -- 172.21.15.5:0/1167931153 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9240034e0 con 0x7fa9400ca050 2024-08-17T02:23:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.878+0000 7fa93e000640 1 -- 172.21.15.5:0/1167931153 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707093043 0 0) 0x7fa9400cb160 con 0x7fa9400add30 2024-08-17T02:23:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.878+0000 7fa93e000640 1 -- 172.21.15.5:0/1167931153 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa928001110 con 0x7fa9400add30 2024-08-17T02:23:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.879+0000 7fa93ea00640 1 -- 172.21.15.5:0/1167931153 >> v1:172.21.15.87:6789/0 conn(0x7fa9400add30 legacy=0x7fa9400aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.879+0000 7fa93ea00640 1 -- 172.21.15.5:0/1167931153 >> v1:172.21.15.5:6789/0 conn(0x7fa9400ca050 legacy=0x7fa940156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.879+0000 7fa93ea00640 1 -- 172.21.15.5:0/1167931153 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9400ca550 con 0x7fa9400ad960 2024-08-17T02:23:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.880+0000 7fa93ea00640 1 --2- 172.21.15.5:0/1167931153 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9400ad960 0x7fa94015b0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa930009880 tx=0x7fa9300090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38119d7238a9d769 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.880+0000 7fa93e000640 1 -- 172.21.15.5:0/1167931153 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93002aea0 con 0x7fa9400ad960 2024-08-17T02:23:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.880+0000 7fa93e000640 1 -- 172.21.15.5:0/1167931153 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa930032440 con 0x7fa9400ad960 2024-08-17T02:23:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.880+0000 7fa93e000640 1 -- 172.21.15.5:0/1167931153 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9300327e0 con 0x7fa9400ad960 2024-08-17T02:23:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.880+0000 7fa945800640 1 -- 172.21.15.5:0/1167931153 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9400ad960 msgr2=0x7fa94015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.880+0000 7fa945800640 1 --2- 172.21.15.5:0/1167931153 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9400ad960 0x7fa94015b0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa930009880 tx=0x7fa9300090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.880+0000 7fa945800640 1 -- 172.21.15.5:0/1167931153 shutdown_connections 2024-08-17T02:23:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.880+0000 7fa945800640 1 --2- 172.21.15.5:0/1167931153 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9400ad960 0x7fa94015b0a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.880+0000 7fa945800640 1 -- 172.21.15.5:0/1167931153 >> 172.21.15.5:0/1167931153 conn(0x7fa940066e60 msgr2=0x7fa940067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.881+0000 7fa945800640 1 -- 172.21.15.5:0/1167931153 shutdown_connections 2024-08-17T02:23:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.881+0000 7fa945800640 1 -- 172.21.15.5:0/1167931153 wait complete. 2024-08-17T02:23:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.882+0000 7fa945800640 1 Processor -- start 2024-08-17T02:23:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.882+0000 7fa945800640 1 -- start start 2024-08-17T02:23:45.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.883+0000 7fa945800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9400ad960 0x7fa940158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.883+0000 7fa945800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9400add30 0x7fa9401441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.883+0000 7fa945800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9400ca050 0x7fa9400af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.883+0000 7fa945800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9401589b0 con 0x7fa9400ad960 2024-08-17T02:23:45.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.883+0000 7fa945800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9400a5320 con 0x7fa9400add30 2024-08-17T02:23:45.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.883+0000 7fa945800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9400a5040 con 0x7fa9400ca050 2024-08-17T02:23:45.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.883+0000 7fa93ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9400ad960 0x7fa940158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.883+0000 7fa93ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9400ad960 0x7fa940158470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44244/0 (socket says 172.21.15.5:44244) 2024-08-17T02:23:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.883+0000 7fa93ea00640 1 -- 172.21.15.5:0/3978263087 learned_addr learned my addr 172.21.15.5:0/3978263087 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.883+0000 7fa93ea00640 1 -- 172.21.15.5:0/3978263087 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9400ca050 msgr2=0x7fa9400af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.883+0000 7fa93ea00640 1 --2- 172.21.15.5:0/3978263087 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9400ca050 0x7fa9400af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.883+0000 7fa93ea00640 1 -- 172.21.15.5:0/3978263087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9400add30 msgr2=0x7fa9401441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.883+0000 7fa937e00640 1 --2- 172.21.15.5:0/3978263087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9400add30 0x7fa9401441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.884+0000 7fa93ea00640 1 --2- 172.21.15.5:0/3978263087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9400add30 0x7fa9401441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.884+0000 7fa93ea00640 1 -- 172.21.15.5:0/3978263087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa930009390 con 0x7fa9400ad960 2024-08-17T02:23:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.884+0000 7fa937e00640 1 --2- 172.21.15.5:0/3978263087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9400add30 0x7fa9401441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.884+0000 7fa93ea00640 1 --2- 172.21.15.5:0/3978263087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9400ad960 0x7fa940158470 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa930009880 tx=0x7fa930032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:45.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.884+0000 7fa936000640 1 -- 172.21.15.5:0/3978263087 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93002aea0 con 0x7fa9400ad960 2024-08-17T02:23:45.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.884+0000 7fa936000640 1 -- 172.21.15.5:0/3978263087 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa930000c40 con 0x7fa9400ad960 2024-08-17T02:23:45.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.884+0000 7fa945800640 1 -- 172.21.15.5:0/3978263087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94016a5c0 con 0x7fa9400ad960 2024-08-17T02:23:45.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.884+0000 7fa936000640 1 -- 172.21.15.5:0/3978263087 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930031cd0 con 0x7fa9400ad960 2024-08-17T02:23:45.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.884+0000 7fa945800640 1 -- 172.21.15.5:0/3978263087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94016ab80 con 0x7fa9400ad960 2024-08-17T02:23:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.885+0000 7fa945800640 1 -- 172.21.15.5:0/3978263087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94016ad70 con 0x7fa9400ad960 2024-08-17T02:23:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.886+0000 7fa936000640 1 -- 172.21.15.5:0/3978263087 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa930039040 con 0x7fa9400ad960 2024-08-17T02:23:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.887+0000 7fa936000640 1 --2- 172.21.15.5:0/3978263087 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa91c065150 0x7fa91c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.887+0000 7fa936000640 1 -- 172.21.15.5:0/3978263087 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa9300a20b0 con 0x7fa9400ad960 2024-08-17T02:23:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.887+0000 7fa937e00640 1 --2- 172.21.15.5:0/3978263087 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa91c065150 0x7fa91c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:45.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.888+0000 7fa937e00640 1 --2- 172.21.15.5:0/3978263087 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa91c065150 0x7fa91c067600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa928007fd0 tx=0x7fa928009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:45.891+0000 7fa936000640 1 -- 172.21.15.5:0/3978263087 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa9300700d0 con 0x7fa9400ad960 2024-08-17T02:23:46.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.073+0000 7fa945800640 1 -- 172.21.15.5:0/3978263087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa940063fb0 con 0x7fa9400ad960 2024-08-17T02:23:46.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.073+0000 7fa936000640 1 -- 172.21.15.5:0/3978263087 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fa9300736f0 con 0x7fa9400ad960 2024-08-17T02:23:46.074 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:46.074 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:36.575545+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:32.642845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:33.982937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:46.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.075+0000 7fa945800640 1 -- 172.21.15.5:0/3978263087 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa91c065150 msgr2=0x7fa91c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.075+0000 7fa945800640 1 --2- 172.21.15.5:0/3978263087 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa91c065150 0x7fa91c067600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa928007fd0 tx=0x7fa928009040 comp rx=0 tx=0).stop 2024-08-17T02:23:46.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.075+0000 7fa945800640 1 -- 172.21.15.5:0/3978263087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9400ad960 msgr2=0x7fa940158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.075+0000 7fa945800640 1 --2- 172.21.15.5:0/3978263087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9400ad960 0x7fa940158470 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa930009880 tx=0x7fa930032000 comp rx=0 tx=0).stop 2024-08-17T02:23:46.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.076+0000 7fa945800640 1 -- 172.21.15.5:0/3978263087 shutdown_connections 2024-08-17T02:23:46.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.076+0000 7fa945800640 1 --2- 172.21.15.5:0/3978263087 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa91c065150 0x7fa91c067600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.076+0000 7fa945800640 1 --2- 172.21.15.5:0/3978263087 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9400ca050 0x7fa9400af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.076+0000 7fa945800640 1 --2- 172.21.15.5:0/3978263087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9400add30 0x7fa9401441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.076+0000 7fa945800640 1 --2- 172.21.15.5:0/3978263087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9400ad960 0x7fa940158470 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.076+0000 7fa945800640 1 -- 172.21.15.5:0/3978263087 >> 172.21.15.5:0/3978263087 conn(0x7fa940066e60 msgr2=0x7fa94006a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:46.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.076+0000 7fa945800640 1 -- 172.21.15.5:0/3978263087 shutdown_connections 2024-08-17T02:23:46.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.076+0000 7fa945800640 1 -- 172.21.15.5:0/3978263087 wait complete. 2024-08-17T02:23:46.091 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:28.773677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:23:32.642845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:23:33.982937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:23:46.092 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:23:46.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.245+0000 7fbf4de00640 1 Processor -- start 2024-08-17T02:23:46.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.245+0000 7fbf4de00640 1 -- start start 2024-08-17T02:23:46.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.246+0000 7fbf4de00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbf480cd780 0x7fbf480ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.246+0000 7fbf4de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbf4815bbd0 0x7fbf4815c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.247+0000 7fbf4de00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4815c550 con 0x7fbf480cc7e0 2024-08-17T02:23:46.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.247+0000 7fbf4de00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf480cdc60 con 0x7fbf4815bbd0 2024-08-17T02:23:46.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.247+0000 7fbf4de00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf480cdf40 con 0x7fbf480cd780 2024-08-17T02:23:46.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.247+0000 7fbf4ca00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbf480cc7e0 0x7fbf480cab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49394/0 (socket says 172.21.15.5:49394) 2024-08-17T02:23:46.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.247+0000 7fbf4ca00640 1 -- 172.21.15.5:0/1060123396 learned_addr learned my addr 172.21.15.5:0/1060123396 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:46.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.247+0000 7fbf4d400640 1 --2- 172.21.15.5:0/1060123396 >> v2:172.21.15.5:3300/0 conn(0x7fbf4815bbd0 0x7fbf4815c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.247+0000 7fbf47e00640 1 --2- 172.21.15.5:0/1060123396 >> v2:172.21.15.87:3300/0 conn(0x7fbf480cd780 0x7fbf480ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.247+0000 7fbf47400640 1 -- 172.21.15.5:0/1060123396 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919379452 0 0) 0x7fbf4815c550 con 0x7fbf480cc7e0 2024-08-17T02:23:46.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.247+0000 7fbf47400640 1 -- 172.21.15.5:0/1060123396 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf300034e0 con 0x7fbf480cc7e0 2024-08-17T02:23:46.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.247+0000 7fbf4d400640 1 -- 172.21.15.5:0/1060123396 >> v2:172.21.15.87:3300/0 conn(0x7fbf480cd780 msgr2=0x7fbf480ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:46.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.247+0000 7fbf4d400640 1 --2- 172.21.15.5:0/1060123396 >> v2:172.21.15.87:3300/0 conn(0x7fbf480cd780 0x7fbf480ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.247+0000 7fbf4d400640 1 -- 172.21.15.5:0/1060123396 >> v1:172.21.15.5:6789/0 conn(0x7fbf480cc7e0 legacy=0x7fbf480cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.247+0000 7fbf4d400640 1 -- 172.21.15.5:0/1060123396 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf480ce220 con 0x7fbf4815bbd0 2024-08-17T02:23:46.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.248+0000 7fbf4d400640 1 --2- 172.21.15.5:0/1060123396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf4815bbd0 0x7fbf4815c010 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbf480af570 tx=0x7fbf40009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f16a27eb1ef700 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:46.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.249+0000 7fbf47400640 1 -- 172.21.15.5:0/1060123396 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40007550 con 0x7fbf4815bbd0 2024-08-17T02:23:46.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.249+0000 7fbf47400640 1 -- 172.21.15.5:0/1060123396 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4002d050 con 0x7fbf4815bbd0 2024-08-17T02:23:46.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.249+0000 7fbf47400640 1 -- 172.21.15.5:0/1060123396 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40007900 con 0x7fbf4815bbd0 2024-08-17T02:23:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.249+0000 7fbf4de00640 1 -- 172.21.15.5:0/1060123396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf4815bbd0 msgr2=0x7fbf4815c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.249+0000 7fbf4de00640 1 --2- 172.21.15.5:0/1060123396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf4815bbd0 0x7fbf4815c010 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbf480af570 tx=0x7fbf40009780 comp rx=0 tx=0).stop 2024-08-17T02:23:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.249+0000 7fbf4de00640 1 -- 172.21.15.5:0/1060123396 shutdown_connections 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.249+0000 7fbf4de00640 1 --2- 172.21.15.5:0/1060123396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf4815bbd0 0x7fbf4815c010 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.249+0000 7fbf4de00640 1 --2- 172.21.15.5:0/1060123396 >> v2:172.21.15.87:3300/0 conn(0x7fbf480cd780 0x7fbf480ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.249+0000 7fbf4de00640 1 -- 172.21.15.5:0/1060123396 >> 172.21.15.5:0/1060123396 conn(0x7fbf48087a80 msgr2=0x7fbf4806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.249+0000 7fbf4de00640 1 -- 172.21.15.5:0/1060123396 shutdown_connections 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.249+0000 7fbf4de00640 1 -- 172.21.15.5:0/1060123396 wait complete. 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.251+0000 7fbf4de00640 1 Processor -- start 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.251+0000 7fbf4de00640 1 -- start start 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.252+0000 7fbf4de00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf480cc7e0 0x7fbf480c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.252+0000 7fbf4de00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf480cd780 0x7fbf480c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.252+0000 7fbf4de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf4815bbd0 0x7fbf480b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.252+0000 7fbf4de00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480c9330 con 0x7fbf4815bbd0 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.252+0000 7fbf4de00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4815c740 con 0x7fbf480cc7e0 2024-08-17T02:23:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.252+0000 7fbf4de00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4815c990 con 0x7fbf480cd780 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.252+0000 7fbf4d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf4815bbd0 0x7fbf480b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.252+0000 7fbf4d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf4815bbd0 0x7fbf480b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44272/0 (socket says 172.21.15.5:44272) 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.252+0000 7fbf4d400640 1 -- 172.21.15.5:0/3628951351 learned_addr learned my addr 172.21.15.5:0/3628951351 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.252+0000 7fbf47e00640 1 --2- 172.21.15.5:0/3628951351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf480cd780 0x7fbf480c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.252+0000 7fbf4ca00640 1 --2- 172.21.15.5:0/3628951351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf480cc7e0 0x7fbf480c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.253+0000 7fbf4d400640 1 -- 172.21.15.5:0/3628951351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf480cd780 msgr2=0x7fbf480c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.253+0000 7fbf4d400640 1 --2- 172.21.15.5:0/3628951351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf480cd780 0x7fbf480c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.253+0000 7fbf4d400640 1 -- 172.21.15.5:0/3628951351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf480cc7e0 msgr2=0x7fbf480c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.253+0000 7fbf4d400640 1 --2- 172.21.15.5:0/3628951351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf480cc7e0 0x7fbf480c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.253+0000 7fbf4d400640 1 -- 172.21.15.5:0/3628951351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf40009a20 con 0x7fbf4815bbd0 2024-08-17T02:23:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.253+0000 7fbf4ca00640 1 --2- 172.21.15.5:0/3628951351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf480cc7e0 0x7fbf480c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.253+0000 7fbf4d400640 1 --2- 172.21.15.5:0/3628951351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf4815bbd0 0x7fbf480b33d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbf40009e90 tx=0x7fbf40037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.253+0000 7fbf3be00640 1 -- 172.21.15.5:0/3628951351 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf400078d0 con 0x7fbf4815bbd0 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.253+0000 7fbf3be00640 1 -- 172.21.15.5:0/3628951351 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf40040070 con 0x7fbf4815bbd0 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.253+0000 7fbf3be00640 1 -- 172.21.15.5:0/3628951351 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40031b00 con 0x7fbf4815bbd0 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.253+0000 7fbf4de00640 1 -- 172.21.15.5:0/3628951351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4815cc70 con 0x7fbf4815bbd0 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.253+0000 7fbf4de00640 1 -- 172.21.15.5:0/3628951351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4815d230 con 0x7fbf4815bbd0 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.254+0000 7fbf4de00640 1 -- 172.21.15.5:0/3628951351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf48070720 con 0x7fbf4815bbd0 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.255+0000 7fbf3be00640 1 -- 172.21.15.5:0/3628951351 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbf40042030 con 0x7fbf4815bbd0 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.256+0000 7fbf3be00640 1 --2- 172.21.15.5:0/3628951351 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fbf28065150 0x7fbf28067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.256+0000 7fbf3be00640 1 -- 172.21.15.5:0/3628951351 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf400a3d50 con 0x7fbf4815bbd0 2024-08-17T02:23:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.256+0000 7fbf4ca00640 1 --2- 172.21.15.5:0/3628951351 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fbf28065150 0x7fbf28067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.257+0000 7fbf4ca00640 1 --2- 172.21.15.5:0/3628951351 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fbf28065150 0x7fbf28067600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c005840 tx=0x7fbf3c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.260+0000 7fbf3be00640 1 -- 172.21.15.5:0/3628951351 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbf40071d70 con 0x7fbf4815bbd0 2024-08-17T02:23:46.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.442+0000 7fbf4de00640 1 -- 172.21.15.5:0/3628951351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbf480645d0 con 0x7fbf4815bbd0 2024-08-17T02:23:46.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.443+0000 7fbf3be00640 1 -- 172.21.15.5:0/3628951351 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbf40075390 con 0x7fbf4815bbd0 2024-08-17T02:23:46.444 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:23:46.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.445+0000 7fbf4de00640 1 -- 172.21.15.5:0/3628951351 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fbf28065150 msgr2=0x7fbf28067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.445+0000 7fbf4de00640 1 --2- 172.21.15.5:0/3628951351 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fbf28065150 0x7fbf28067600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c005840 tx=0x7fbf3c009040 comp rx=0 tx=0).stop 2024-08-17T02:23:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.445+0000 7fbf4de00640 1 -- 172.21.15.5:0/3628951351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf4815bbd0 msgr2=0x7fbf480b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.445+0000 7fbf4de00640 1 --2- 172.21.15.5:0/3628951351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf4815bbd0 0x7fbf480b33d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbf40009e90 tx=0x7fbf40037000 comp rx=0 tx=0).stop 2024-08-17T02:23:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.445+0000 7fbf4de00640 1 -- 172.21.15.5:0/3628951351 shutdown_connections 2024-08-17T02:23:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.445+0000 7fbf4de00640 1 --2- 172.21.15.5:0/3628951351 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fbf28065150 0x7fbf28067600 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.445+0000 7fbf4de00640 1 --2- 172.21.15.5:0/3628951351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf480cd780 0x7fbf480c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.445+0000 7fbf4de00640 1 --2- 172.21.15.5:0/3628951351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf4815bbd0 0x7fbf480b33d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.445+0000 7fbf4de00640 1 --2- 172.21.15.5:0/3628951351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf480cc7e0 0x7fbf480c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.445+0000 7fbf4de00640 1 -- 172.21.15.5:0/3628951351 >> 172.21.15.5:0/3628951351 conn(0x7fbf48087a80 msgr2=0x7fbf480cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.445+0000 7fbf4de00640 1 -- 172.21.15.5:0/3628951351 shutdown_connections 2024-08-17T02:23:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.445+0000 7fbf4de00640 1 -- 172.21.15.5:0/3628951351 wait complete. 2024-08-17T02:23:46.461 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:23:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.614+0000 7fcdf6e00640 1 Processor -- start 2024-08-17T02:23:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.614+0000 7fcdf6e00640 1 -- start start 2024-08-17T02:23:46.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.615+0000 7fcdf6e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcdf00ae8d0 0x7fcdf00aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.615+0000 7fcdf6e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcdf00c9ed0 0x7fcdf015f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.615+0000 7fcdf6e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf00cb180 con 0x7fcdf00aff50 2024-08-17T02:23:46.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.615+0000 7fcdf6e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf00ad410 con 0x7fcdf00ae8d0 2024-08-17T02:23:46.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.615+0000 7fcdf6e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf00ad6b0 con 0x7fcdf00c9ed0 2024-08-17T02:23:46.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.615+0000 7fcdefe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcdf00ae8d0 0x7fcdf00aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.615+0000 7fcdefe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcdf00ae8d0 0x7fcdf00aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44286/0 (socket says 172.21.15.5:44286) 2024-08-17T02:23:46.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.615+0000 7fcdefe00640 1 -- 172.21.15.5:0/3612500064 learned_addr learned my addr 172.21.15.5:0/3612500064 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:46.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.615+0000 7fcdf4e00640 1 --2- 172.21.15.5:0/3612500064 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcdf00c9ed0 0x7fcdf015f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.616+0000 7fcdefe00640 1 -- 172.21.15.5:0/3612500064 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcdf00c9ed0 msgr2=0x7fcdf015f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:46.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.616+0000 7fcdefe00640 1 --2- 172.21.15.5:0/3612500064 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcdf00c9ed0 0x7fcdf015f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.616+0000 7fcdefe00640 1 -- 172.21.15.5:0/3612500064 >> v1:172.21.15.87:6789/0 conn(0x7fcdf00aff50 legacy=0x7fcdf00aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.616+0000 7fcdefe00640 1 -- 172.21.15.5:0/3612500064 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf00ad990 con 0x7fcdf00ae8d0 2024-08-17T02:23:46.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.617+0000 7fcdefe00640 1 --2- 172.21.15.5:0/3612500064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf00ae8d0 0x7fcdf00aced0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009910 tx=0x7fcde00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d734fbba5224a0a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:46.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.617+0000 7fcdef400640 1 -- 172.21.15.5:0/3612500064 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde002ae40 con 0x7fcdf00ae8d0 2024-08-17T02:23:46.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.617+0000 7fcdef400640 1 -- 172.21.15.5:0/3612500064 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde0032440 con 0x7fcdf00ae8d0 2024-08-17T02:23:46.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.617+0000 7fcdef400640 1 -- 172.21.15.5:0/3612500064 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0032820 con 0x7fcdf00ae8d0 2024-08-17T02:23:46.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.617+0000 7fcdf6e00640 1 -- 172.21.15.5:0/3612500064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf00ae8d0 msgr2=0x7fcdf00aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.617+0000 7fcdf6e00640 1 --2- 172.21.15.5:0/3612500064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf00ae8d0 0x7fcdf00aced0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009910 tx=0x7fcde00091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.618+0000 7fcdf6e00640 1 -- 172.21.15.5:0/3612500064 shutdown_connections 2024-08-17T02:23:46.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.618+0000 7fcdf6e00640 1 --2- 172.21.15.5:0/3612500064 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcdf00c9ed0 0x7fcdf015f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.618+0000 7fcdf6e00640 1 --2- 172.21.15.5:0/3612500064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf00ae8d0 0x7fcdf00aced0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.618+0000 7fcdf6e00640 1 -- 172.21.15.5:0/3612500064 >> 172.21.15.5:0/3612500064 conn(0x7fcdf0066e60 msgr2=0x7fcdf0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:46.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.618+0000 7fcdf6e00640 1 -- 172.21.15.5:0/3612500064 shutdown_connections 2024-08-17T02:23:46.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.618+0000 7fcdf6e00640 1 -- 172.21.15.5:0/3612500064 wait complete. 2024-08-17T02:23:46.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.619+0000 7fcdf6e00640 1 Processor -- start 2024-08-17T02:23:46.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.619+0000 7fcdf6e00640 1 -- start start 2024-08-17T02:23:46.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.620+0000 7fcdf6e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcdf00ae8d0 0x7fcdf00c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.620+0000 7fcdf6e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdf00aff50 0x7fcdf014ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.620+0000 7fcdf6e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf00c9ed0 0x7fcdf0140340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.620+0000 7fcdf6e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf0140880 con 0x7fcdf00c9ed0 2024-08-17T02:23:46.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.620+0000 7fcdf6e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf014ffd0 con 0x7fcdf00aff50 2024-08-17T02:23:46.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.620+0000 7fcdf6e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf014f3c0 con 0x7fcdf00ae8d0 2024-08-17T02:23:46.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.620+0000 7fcdf4e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf00c9ed0 0x7fcdf0140340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.620+0000 7fcdf4e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf00c9ed0 0x7fcdf0140340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44300/0 (socket says 172.21.15.5:44300) 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.620+0000 7fcdf4e00640 1 -- 172.21.15.5:0/2980975508 learned_addr learned my addr 172.21.15.5:0/2980975508 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.620+0000 7fcdefe00640 1 --2- 172.21.15.5:0/2980975508 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcdf00ae8d0 0x7fcdf00c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.620+0000 7fcde7e00640 1 --2- 172.21.15.5:0/2980975508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdf00aff50 0x7fcdf014ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.621+0000 7fcdf4e00640 1 -- 172.21.15.5:0/2980975508 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcdf00ae8d0 msgr2=0x7fcdf00c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.621+0000 7fcdf4e00640 1 --2- 172.21.15.5:0/2980975508 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcdf00ae8d0 0x7fcdf00c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.621+0000 7fcdf4e00640 1 -- 172.21.15.5:0/2980975508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdf00aff50 msgr2=0x7fcdf014ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.621+0000 7fcdf4e00640 1 --2- 172.21.15.5:0/2980975508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdf00aff50 0x7fcdf014ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.621+0000 7fcdf4e00640 1 -- 172.21.15.5:0/2980975508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde0009450 con 0x7fcdf00c9ed0 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.621+0000 7fcdf4e00640 1 --2- 172.21.15.5:0/2980975508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf00c9ed0 0x7fcdf0140340 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcde8007f20 tx=0x7fcde8009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:46.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.621+0000 7fcde7400640 1 -- 172.21.15.5:0/2980975508 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde800ee30 con 0x7fcdf00c9ed0 2024-08-17T02:23:46.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.621+0000 7fcde7400640 1 -- 172.21.15.5:0/2980975508 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde8014420 con 0x7fcdf00c9ed0 2024-08-17T02:23:46.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.621+0000 7fcde7400640 1 -- 172.21.15.5:0/2980975508 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde80147e0 con 0x7fcdf00c9ed0 2024-08-17T02:23:46.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.621+0000 7fcdf6e00640 1 -- 172.21.15.5:0/2980975508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf014f6a0 con 0x7fcdf00c9ed0 2024-08-17T02:23:46.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.621+0000 7fcdf6e00640 1 -- 172.21.15.5:0/2980975508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf014fc60 con 0x7fcdf00c9ed0 2024-08-17T02:23:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.622+0000 7fcdf6e00640 1 -- 172.21.15.5:0/2980975508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf0150160 con 0x7fcdf00c9ed0 2024-08-17T02:23:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.623+0000 7fcde7400640 1 -- 172.21.15.5:0/2980975508 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcde8014b50 con 0x7fcdf00c9ed0 2024-08-17T02:23:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.624+0000 7fcde7400640 1 --2- 172.21.15.5:0/2980975508 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcdcc065150 0x7fcdcc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.624+0000 7fcde7400640 1 -- 172.21.15.5:0/2980975508 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcde8082b00 con 0x7fcdf00c9ed0 2024-08-17T02:23:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.624+0000 7fcdefe00640 1 --2- 172.21.15.5:0/2980975508 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcdcc065150 0x7fcdcc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.625+0000 7fcdefe00640 1 --2- 172.21.15.5:0/2980975508 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcdcc065150 0x7fcdcc067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcde0034000 tx=0x7fcde0032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:46.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.628+0000 7fcde7400640 1 -- 172.21.15.5:0/2980975508 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcde8084e60 con 0x7fcdf00c9ed0 2024-08-17T02:23:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.812+0000 7fcdf6e00640 1 -- 172.21.15.5:0/2980975508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcdf0063fb0 con 0x7fcdf00c9ed0 2024-08-17T02:23:46.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.812+0000 7fcde7400640 1 -- 172.21.15.5:0/2980975508 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcde8050bd0 con 0x7fcdf00c9ed0 2024-08-17T02:23:46.813 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:23:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.814+0000 7fcdf6e00640 1 -- 172.21.15.5:0/2980975508 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcdcc065150 msgr2=0x7fcdcc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.814+0000 7fcdf6e00640 1 --2- 172.21.15.5:0/2980975508 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcdcc065150 0x7fcdcc067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcde0034000 tx=0x7fcde0032000 comp rx=0 tx=0).stop 2024-08-17T02:23:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.814+0000 7fcdf6e00640 1 -- 172.21.15.5:0/2980975508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf00c9ed0 msgr2=0x7fcdf0140340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.814+0000 7fcdf6e00640 1 --2- 172.21.15.5:0/2980975508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf00c9ed0 0x7fcdf0140340 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcde8007f20 tx=0x7fcde8009860 comp rx=0 tx=0).stop 2024-08-17T02:23:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.814+0000 7fcdf6e00640 1 -- 172.21.15.5:0/2980975508 shutdown_connections 2024-08-17T02:23:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.814+0000 7fcdf6e00640 1 --2- 172.21.15.5:0/2980975508 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcdcc065150 0x7fcdcc067600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.814+0000 7fcdf6e00640 1 --2- 172.21.15.5:0/2980975508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf00c9ed0 0x7fcdf0140340 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.814+0000 7fcdf6e00640 1 --2- 172.21.15.5:0/2980975508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdf00aff50 0x7fcdf014ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.814+0000 7fcdf6e00640 1 --2- 172.21.15.5:0/2980975508 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcdf00ae8d0 0x7fcdf00c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.814+0000 7fcdf6e00640 1 -- 172.21.15.5:0/2980975508 >> 172.21.15.5:0/2980975508 conn(0x7fcdf0066e60 msgr2=0x7fcdf014e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:46.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.814+0000 7fcdf6e00640 1 -- 172.21.15.5:0/2980975508 shutdown_connections 2024-08-17T02:23:46.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.814+0000 7fcdf6e00640 1 -- 172.21.15.5:0/2980975508 wait complete. 2024-08-17T02:23:46.829 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:23:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.982+0000 7fef04600640 1 Processor -- start 2024-08-17T02:23:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.982+0000 7fef04600640 1 -- start start 2024-08-17T02:23:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.983+0000 7fef04600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feefc1590b0 0x7feefc0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.983+0000 7fef04600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feefc0acf10 0x7feefc159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.983+0000 7fef04600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feefc15a4e0 con 0x7feefc0afca0 2024-08-17T02:23:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.983+0000 7fef04600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feefc0b0980 con 0x7feefc0acf10 2024-08-17T02:23:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.983+0000 7fef04600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feefc0c92b0 con 0x7feefc1590b0 2024-08-17T02:23:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.983+0000 7fef01c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feefc0afca0 0x7feefc1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49398/0 (socket says 172.21.15.5:49398) 2024-08-17T02:23:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.983+0000 7fef01c00640 1 -- 172.21.15.5:0/1912842988 learned_addr learned my addr 172.21.15.5:0/1912842988 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.983+0000 7fef02600640 1 --2- 172.21.15.5:0/1912842988 >> v2:172.21.15.5:3300/0 conn(0x7feefc0acf10 0x7feefc159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.984+0000 7fef01200640 1 --2- 172.21.15.5:0/1912842988 >> v2:172.21.15.87:3300/0 conn(0x7feefc1590b0 0x7feefc0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.984+0000 7feefbe00640 1 -- 172.21.15.5:0/1912842988 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1295424000 0 0) 0x7feef0001110 con 0x7feefc0afca0 2024-08-17T02:23:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.984+0000 7fef02600640 1 -- 172.21.15.5:0/1912842988 >> v2:172.21.15.87:3300/0 conn(0x7feefc1590b0 msgr2=0x7feefc0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.984+0000 7fef02600640 1 --2- 172.21.15.5:0/1912842988 >> v2:172.21.15.87:3300/0 conn(0x7feefc1590b0 0x7feefc0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.984+0000 7fef02600640 1 -- 172.21.15.5:0/1912842988 >> v1:172.21.15.5:6789/0 conn(0x7feefc0afca0 legacy=0x7feefc1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.984+0000 7fef02600640 1 -- 172.21.15.5:0/1912842988 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc0ad480 con 0x7feefc0acf10 2024-08-17T02:23:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.984+0000 7fef01200640 1 --2- 172.21.15.5:0/1912842988 >> v2:172.21.15.87:3300/0 conn(0x7feefc1590b0 0x7feefc0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:46.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.985+0000 7fef02600640 1 --2- 172.21.15.5:0/1912842988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feefc0acf10 0x7feefc159fa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feefc0c83b0 tx=0x7feef4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f680fd6d431019c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.985+0000 7feefbe00640 1 -- 172.21.15.5:0/1912842988 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef4032660 con 0x7feefc0acf10 2024-08-17T02:23:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.985+0000 7feefbe00640 1 -- 172.21.15.5:0/1912842988 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef40327c0 con 0x7feefc0acf10 2024-08-17T02:23:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.985+0000 7feefbe00640 1 -- 172.21.15.5:0/1912842988 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef4032b60 con 0x7feefc0acf10 2024-08-17T02:23:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.986+0000 7fef04600640 1 -- 172.21.15.5:0/1912842988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feefc0acf10 msgr2=0x7feefc159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.986+0000 7fef04600640 1 --2- 172.21.15.5:0/1912842988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feefc0acf10 0x7feefc159fa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feefc0c83b0 tx=0x7feef4009780 comp rx=0 tx=0).stop 2024-08-17T02:23:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.986+0000 7fef04600640 1 -- 172.21.15.5:0/1912842988 shutdown_connections 2024-08-17T02:23:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.986+0000 7fef04600640 1 --2- 172.21.15.5:0/1912842988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feefc0acf10 0x7feefc159fa0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.986+0000 7fef04600640 1 --2- 172.21.15.5:0/1912842988 >> v2:172.21.15.87:3300/0 conn(0x7feefc1590b0 0x7feefc0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.986+0000 7fef04600640 1 -- 172.21.15.5:0/1912842988 >> 172.21.15.5:0/1912842988 conn(0x7feefc066e60 msgr2=0x7feefc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.986+0000 7fef04600640 1 -- 172.21.15.5:0/1912842988 shutdown_connections 2024-08-17T02:23:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.986+0000 7fef04600640 1 -- 172.21.15.5:0/1912842988 wait complete. 2024-08-17T02:23:46.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.987+0000 7fef04600640 1 Processor -- start 2024-08-17T02:23:46.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.987+0000 7fef04600640 1 -- start start 2024-08-17T02:23:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.988+0000 7fef04600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feefc0acf10 0x7feefc149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.988+0000 7fef04600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feefc0afca0 0x7feefc156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.988+0000 7fef04600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feefc1590b0 0x7feefc0cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.988+0000 7fef04600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc168d40 con 0x7feefc0acf10 2024-08-17T02:23:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.988+0000 7fef04600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc157330 con 0x7feefc1590b0 2024-08-17T02:23:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.988+0000 7fef04600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feefc157610 con 0x7feefc0afca0 2024-08-17T02:23:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.988+0000 7fef01c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feefc0acf10 0x7feefc149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.988+0000 7fef01c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feefc0acf10 0x7feefc149350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44320/0 (socket says 172.21.15.5:44320) 2024-08-17T02:23:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.988+0000 7fef01c00640 1 -- 172.21.15.5:0/1551810658 learned_addr learned my addr 172.21.15.5:0/1551810658 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.989+0000 7fef01200640 1 --2- 172.21.15.5:0/1551810658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feefc0afca0 0x7feefc156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.989+0000 7fef02600640 1 --2- 172.21.15.5:0/1551810658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feefc1590b0 0x7feefc0cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.989+0000 7fef01c00640 1 -- 172.21.15.5:0/1551810658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feefc0afca0 msgr2=0x7feefc156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.989+0000 7fef01c00640 1 --2- 172.21.15.5:0/1551810658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feefc0afca0 0x7feefc156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.989+0000 7fef01c00640 1 -- 172.21.15.5:0/1551810658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feefc1590b0 msgr2=0x7feefc0cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.989+0000 7fef01c00640 1 --2- 172.21.15.5:0/1551810658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feefc1590b0 0x7feefc0cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.989+0000 7fef01c00640 1 -- 172.21.15.5:0/1551810658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef4009a20 con 0x7feefc0acf10 2024-08-17T02:23:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.989+0000 7fef01c00640 1 --2- 172.21.15.5:0/1551810658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feefc0acf10 0x7feefc149350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feef000c810 tx=0x7feef0007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.989+0000 7feef8c00640 1 -- 172.21.15.5:0/1551810658 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0005870 con 0x7feefc0acf10 2024-08-17T02:23:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.989+0000 7feef8c00640 1 -- 172.21.15.5:0/1551810658 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef00059d0 con 0x7feefc0acf10 2024-08-17T02:23:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.989+0000 7feef8c00640 1 -- 172.21.15.5:0/1551810658 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0005dd0 con 0x7feefc0acf10 2024-08-17T02:23:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.989+0000 7fef04600640 1 -- 172.21.15.5:0/1551810658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feefc1578f0 con 0x7feefc0acf10 2024-08-17T02:23:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.990+0000 7fef04600640 1 -- 172.21.15.5:0/1551810658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feefc14bf50 con 0x7feefc0acf10 2024-08-17T02:23:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.991+0000 7fef04600640 1 -- 172.21.15.5:0/1551810658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feefc168eb0 con 0x7feefc0acf10 2024-08-17T02:23:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.991+0000 7feef8c00640 1 -- 172.21.15.5:0/1551810658 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7feef0007300 con 0x7feefc0acf10 2024-08-17T02:23:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.992+0000 7feef8c00640 1 --2- 172.21.15.5:0/1551810658 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7feedc065150 0x7feedc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.992+0000 7feef8c00640 1 -- 172.21.15.5:0/1551810658 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feef0081c70 con 0x7feefc0acf10 2024-08-17T02:23:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.992+0000 7fef01200640 1 --2- 172.21.15.5:0/1551810658 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7feedc065150 0x7feedc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.993+0000 7fef01200640 1 --2- 172.21.15.5:0/1551810658 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7feedc065150 0x7feedc067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feefc14d000 tx=0x7feee8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:46.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:46.996+0000 7feef8c00640 1 -- 172.21.15.5:0/1551810658 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7feef004fdc0 con 0x7feefc0acf10 2024-08-17T02:23:47.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.180+0000 7fef04600640 1 -- 172.21.15.5:0/1551810658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feefc15a4e0 con 0x7feefc0acf10 2024-08-17T02:23:47.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.180+0000 7feef8c00640 1 -- 172.21.15.5:0/1551810658 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7feefc15a4e0 con 0x7feefc0acf10 2024-08-17T02:23:47.181 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-17T02:23:47.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.182+0000 7fef04600640 1 -- 172.21.15.5:0/1551810658 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7feedc065150 msgr2=0x7feedc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.182+0000 7fef04600640 1 --2- 172.21.15.5:0/1551810658 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7feedc065150 0x7feedc067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feefc14d000 tx=0x7feee8008040 comp rx=0 tx=0).stop 2024-08-17T02:23:47.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.182+0000 7fef04600640 1 -- 172.21.15.5:0/1551810658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feefc0acf10 msgr2=0x7feefc149350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.182+0000 7fef04600640 1 --2- 172.21.15.5:0/1551810658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feefc0acf10 0x7feefc149350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feef000c810 tx=0x7feef0007bc0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.182+0000 7fef04600640 1 -- 172.21.15.5:0/1551810658 shutdown_connections 2024-08-17T02:23:47.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.182+0000 7fef04600640 1 --2- 172.21.15.5:0/1551810658 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7feedc065150 0x7feedc067600 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.182+0000 7fef04600640 1 --2- 172.21.15.5:0/1551810658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feefc0afca0 0x7feefc156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.182+0000 7fef04600640 1 --2- 172.21.15.5:0/1551810658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feefc1590b0 0x7feefc0cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.182+0000 7fef04600640 1 --2- 172.21.15.5:0/1551810658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feefc0acf10 0x7feefc149350 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.182+0000 7fef04600640 1 -- 172.21.15.5:0/1551810658 >> 172.21.15.5:0/1551810658 conn(0x7feefc066e60 msgr2=0x7feefc06d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:47.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.182+0000 7fef04600640 1 -- 172.21.15.5:0/1551810658 shutdown_connections 2024-08-17T02:23:47.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.183+0000 7fef04600640 1 -- 172.21.15.5:0/1551810658 wait complete. 2024-08-17T02:23:47.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:23:47.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.348+0000 7f5eed600640 1 Processor -- start 2024-08-17T02:23:47.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.348+0000 7f5eed600640 1 -- start start 2024-08-17T02:23:47.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.349+0000 7f5eed600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5ee80afca0 0x7f5ee80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.349+0000 7f5eed600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee81590b0 0x7f5ee8159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.349+0000 7f5eed600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee815a4e0 con 0x7f5ee80acf10 2024-08-17T02:23:47.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.349+0000 7f5eed600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee80b0980 con 0x7f5ee80afca0 2024-08-17T02:23:47.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.349+0000 7f5eed600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80c92b0 con 0x7f5ee81590b0 2024-08-17T02:23:47.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.350+0000 7f5edfe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5ee80acf10 0x7f5ee81589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49410/0 (socket says 172.21.15.5:49410) 2024-08-17T02:23:47.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.350+0000 7f5edfe00640 1 -- 172.21.15.5:0/2894015511 learned_addr learned my addr 172.21.15.5:0/2894015511 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:47.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.350+0000 7f5ee6a00640 1 --2- 172.21.15.5:0/2894015511 >> v2:172.21.15.87:3300/0 conn(0x7f5ee80afca0 0x7f5ee80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.350+0000 7f5ee7400640 1 --2- 172.21.15.5:0/2894015511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee81590b0 0x7f5ee8159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.350+0000 7f5ee6000640 1 -- 172.21.15.5:0/2894015511 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843034722 0 0) 0x7f5ed0001110 con 0x7f5ee80acf10 2024-08-17T02:23:47.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.350+0000 7f5ee6000640 1 -- 172.21.15.5:0/2894015511 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ecc0034e0 con 0x7f5ee80acf10 2024-08-17T02:23:47.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.350+0000 7f5ee6000640 1 -- 172.21.15.5:0/2894015511 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1679623858 0 0) 0x7f5ecc0034e0 con 0x7f5ee80acf10 2024-08-17T02:23:47.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.350+0000 7f5ee6000640 1 -- 172.21.15.5:0/2894015511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee81590b0 msgr2=0x7f5ee8159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:47.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.350+0000 7f5ee6000640 1 --2- 172.21.15.5:0/2894015511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee81590b0 0x7f5ee8159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.350+0000 7f5ee6000640 1 -- 172.21.15.5:0/2894015511 >> v2:172.21.15.87:3300/0 conn(0x7f5ee80afca0 msgr2=0x7f5ee80b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:47.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.350+0000 7f5ee6000640 1 --2- 172.21.15.5:0/2894015511 >> v2:172.21.15.87:3300/0 conn(0x7f5ee80afca0 0x7f5ee80b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.350+0000 7f5ee6000640 1 -- 172.21.15.5:0/2894015511 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee80ad480 con 0x7f5ee80acf10 2024-08-17T02:23:47.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.350+0000 7f5ee6000640 1 -- 172.21.15.5:0/2894015511 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2658686246 0 0) 0x7f5ed0001600 con 0x7f5ee80acf10 2024-08-17T02:23:47.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.351+0000 7f5ee6000640 1 -- 172.21.15.5:0/2894015511 >> v1:172.21.15.5:6789/0 conn(0x7f5ee80acf10 legacy=0x7f5ee81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.351+0000 7f5ee6000640 1 --2- 172.21.15.5:0/2894015511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee81590b0 0x7f5ecc0039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.351+0000 7f5ee6000640 1 --2- 172.21.15.5:0/2894015511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ecc003f50 0x7f5ecc004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.351+0000 7f5ee6000640 1 --2- 172.21.15.5:0/2894015511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ecc004cc0 0x7f5ecc005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.351+0000 7f5ee6000640 1 -- 172.21.15.5:0/2894015511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80c92b0 con 0x7f5ecc004cc0 2024-08-17T02:23:47.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.351+0000 7f5ee6000640 1 -- 172.21.15.5:0/2894015511 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc00b9d0 con 0x7f5ecc003f50 2024-08-17T02:23:47.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.351+0000 7f5ee6000640 1 -- 172.21.15.5:0/2894015511 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc00bb40 con 0x7f5ee81590b0 2024-08-17T02:23:47.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.351+0000 7f5ee7400640 1 --2- 172.21.15.5:0/2894015511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ecc004cc0 0x7f5ecc005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.351+0000 7f5ee6a00640 1 --2- 172.21.15.5:0/2894015511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee81590b0 0x7f5ecc0039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.351+0000 7f5edfe00640 1 --2- 172.21.15.5:0/2894015511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ecc003f50 0x7f5ecc004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.351+0000 7f5ee7400640 1 -- 172.21.15.5:0/2894015511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee81590b0 msgr2=0x7f5ecc0039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:47.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.351+0000 7f5ee7400640 1 --2- 172.21.15.5:0/2894015511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee81590b0 0x7f5ecc0039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.351+0000 7f5ee7400640 1 -- 172.21.15.5:0/2894015511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ecc003f50 msgr2=0x7f5ecc004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:47.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.351+0000 7f5ee7400640 1 --2- 172.21.15.5:0/2894015511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ecc003f50 0x7f5ecc004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.351+0000 7f5ee7400640 1 -- 172.21.15.5:0/2894015511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc0034e0 con 0x7f5ecc004cc0 2024-08-17T02:23:47.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.352+0000 7f5ee7400640 1 --2- 172.21.15.5:0/2894015511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ecc004cc0 0x7f5ecc005130 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5ee81594f0 tx=0x7f5ee000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec6d727e5967a71 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:47.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.352+0000 7f5ee6000640 1 -- 172.21.15.5:0/2894015511 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee00313f0 con 0x7f5ecc004cc0 2024-08-17T02:23:47.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.353+0000 7f5ee6000640 1 -- 172.21.15.5:0/2894015511 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee000f040 con 0x7f5ecc004cc0 2024-08-17T02:23:47.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.353+0000 7f5ee6000640 1 -- 172.21.15.5:0/2894015511 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0031760 con 0x7f5ecc004cc0 2024-08-17T02:23:47.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.353+0000 7f5eed600640 1 -- 172.21.15.5:0/2894015511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ecc004cc0 msgr2=0x7f5ecc005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.353+0000 7f5eed600640 1 --2- 172.21.15.5:0/2894015511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ecc004cc0 0x7f5ecc005130 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5ee81594f0 tx=0x7f5ee000b040 comp rx=0 tx=0).stop 2024-08-17T02:23:47.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.353+0000 7f5ee7400640 1 -- 172.21.15.5:0/2894015511 reap_dead start 2024-08-17T02:23:47.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.353+0000 7f5eed600640 1 -- 172.21.15.5:0/2894015511 shutdown_connections 2024-08-17T02:23:47.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.353+0000 7f5eed600640 1 -- 172.21.15.5:0/2894015511 >> 172.21.15.5:0/2894015511 conn(0x7f5ee8066e60 msgr2=0x7f5ee8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:47.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.353+0000 7f5eed600640 1 -- 172.21.15.5:0/2894015511 shutdown_connections 2024-08-17T02:23:47.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.353+0000 7f5eed600640 1 -- 172.21.15.5:0/2894015511 wait complete. 2024-08-17T02:23:47.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.355+0000 7f5eed600640 1 Processor -- start 2024-08-17T02:23:47.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.355+0000 7f5eed600640 1 -- start start 2024-08-17T02:23:47.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.355+0000 7f5eed600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ecc004cc0 0x7f5ee80c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.355+0000 7f5eed600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee80c7b70 0x7f5ee814e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.356+0000 7f5eed600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee806a3b0 0x7f5ee806a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.356+0000 7f5eed600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80c8270 con 0x7f5ee80c7b70 2024-08-17T02:23:47.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.356+0000 7f5eed600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee816cf80 con 0x7f5ecc004cc0 2024-08-17T02:23:47.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.356+0000 7f5eed600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee806ad40 con 0x7f5ee806a3b0 2024-08-17T02:23:47.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.356+0000 7f5edfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee80c7b70 0x7f5ee814e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.356+0000 7f5edfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee80c7b70 0x7f5ee814e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44346/0 (socket says 172.21.15.5:44346) 2024-08-17T02:23:47.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.356+0000 7f5edfe00640 1 -- 172.21.15.5:0/151452379 learned_addr learned my addr 172.21.15.5:0/151452379 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:47.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.356+0000 7f5ee6a00640 1 --2- 172.21.15.5:0/151452379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ecc004cc0 0x7f5ee80c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.356+0000 7f5ee7400640 1 --2- 172.21.15.5:0/151452379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee806a3b0 0x7f5ee806a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.356+0000 7f5edfe00640 1 -- 172.21.15.5:0/151452379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee806a3b0 msgr2=0x7f5ee806a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.356+0000 7f5edfe00640 1 --2- 172.21.15.5:0/151452379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee806a3b0 0x7f5ee806a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.356+0000 7f5edfe00640 1 -- 172.21.15.5:0/151452379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ecc004cc0 msgr2=0x7f5ee80c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.356+0000 7f5edfe00640 1 --2- 172.21.15.5:0/151452379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ecc004cc0 0x7f5ee80c07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.356+0000 7f5edfe00640 1 -- 172.21.15.5:0/151452379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee80c7fe0 con 0x7f5ee80c7b70 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.356+0000 7f5ee6a00640 1 --2- 172.21.15.5:0/151452379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ecc004cc0 0x7f5ee80c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.356+0000 7f5edfe00640 1 --2- 172.21.15.5:0/151452379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee80c7b70 0x7f5ee814e290 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0001050 tx=0x7f5ee80683f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.357+0000 7f5ede000640 1 -- 172.21.15.5:0/151452379 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0018030 con 0x7f5ee80c7b70 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.357+0000 7f5ede000640 1 -- 172.21.15.5:0/151452379 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed000fa00 con 0x7f5ee80c7b70 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.357+0000 7f5ede000640 1 -- 172.21.15.5:0/151452379 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed000fda0 con 0x7f5ee80c7b70 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.357+0000 7f5eed600640 1 -- 172.21.15.5:0/151452379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee814e7d0 con 0x7f5ee80c7b70 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.357+0000 7f5eed600640 1 -- 172.21.15.5:0/151452379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee816c930 con 0x7f5ee80c7b70 2024-08-17T02:23:47.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.358+0000 7f5eed600640 1 -- 172.21.15.5:0/151452379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee8063fb0 con 0x7f5ee80c7b70 2024-08-17T02:23:47.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.359+0000 7f5ede000640 1 -- 172.21.15.5:0/151452379 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5ed001b070 con 0x7f5ee80c7b70 2024-08-17T02:23:47.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.359+0000 7f5ede000640 1 --2- 172.21.15.5:0/151452379 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5ec4065180 0x7f5ec4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.359+0000 7f5ede000640 1 -- 172.21.15.5:0/151452379 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ed0019070 con 0x7f5ee80c7b70 2024-08-17T02:23:47.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.360+0000 7f5ee6a00640 1 --2- 172.21.15.5:0/151452379 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5ec4065180 0x7f5ec4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.360+0000 7f5ee6a00640 1 --2- 172.21.15.5:0/151452379 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5ec4065180 0x7f5ec4067630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8006e70 tx=0x7f5ed8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:47.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.364+0000 7f5ede000640 1 -- 172.21.15.5:0/151452379 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5ed00501f0 con 0x7f5ee80c7b70 2024-08-17T02:23:47.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.580+0000 7f5eed600640 1 -- 172.21.15.5:0/151452379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ee815a4e0 con 0x7f5ee80c7b70 2024-08-17T02:23:47.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.581+0000 7f5ede000640 1 -- 172.21.15.5:0/151452379 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4582 (secure 0 0 0) 0x7f5ee815a4e0 con 0x7f5ee80c7b70 2024-08-17T02:23:47.582 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:47.582 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/2870814974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2870814974},{"type":"v1","addr":"172.21.15.87:6834","nonce":2870814974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/508600504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":508600504},{"type":"v1","addr":"172.21.15.5:6835","nonce":508600504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3215918333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3215918333},{"type":"v1","addr":"172.21.15.5:6837","nonce":3215918333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:34.987476+0000","modified":"2024-08-17T02:23:38.593683+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/3443816405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3443816405},{"type":"v1","addr":"172.21.15.87:6835","nonce":3443816405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:23:47.582 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-08-17T02:23:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.583+0000 7f5eed600640 1 -- 172.21.15.5:0/151452379 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5ec4065180 msgr2=0x7f5ec4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.583+0000 7f5eed600640 1 --2- 172.21.15.5:0/151452379 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5ec4065180 0x7f5ec4067630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8006e70 tx=0x7f5ed8008040 comp rx=0 tx=0).stop 2024-08-17T02:23:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.583+0000 7f5eed600640 1 -- 172.21.15.5:0/151452379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee80c7b70 msgr2=0x7f5ee814e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.583+0000 7f5eed600640 1 --2- 172.21.15.5:0/151452379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee80c7b70 0x7f5ee814e290 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0001050 tx=0x7f5ee80683f0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.583+0000 7f5eed600640 1 -- 172.21.15.5:0/151452379 shutdown_connections 2024-08-17T02:23:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.583+0000 7f5eed600640 1 --2- 172.21.15.5:0/151452379 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5ec4065180 0x7f5ec4067630 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.583+0000 7f5eed600640 1 --2- 172.21.15.5:0/151452379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee806a3b0 0x7f5ee806a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.583+0000 7f5eed600640 1 --2- 172.21.15.5:0/151452379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee80c7b70 0x7f5ee814e290 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.583+0000 7f5eed600640 1 --2- 172.21.15.5:0/151452379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ecc004cc0 0x7f5ee80c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.583+0000 7f5eed600640 1 -- 172.21.15.5:0/151452379 >> 172.21.15.5:0/151452379 conn(0x7f5ee8066e60 msgr2=0x7f5ee8151e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.583+0000 7f5eed600640 1 -- 172.21.15.5:0/151452379 shutdown_connections 2024-08-17T02:23:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.583+0000 7f5eed600640 1 -- 172.21.15.5:0/151452379 wait complete. 2024-08-17T02:23:47.599 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:47.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.751+0000 7f86e8e00640 1 Processor -- start 2024-08-17T02:23:47.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.751+0000 7f86e8e00640 1 -- start start 2024-08-17T02:23:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.752+0000 7f86e8e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86e41590b0 0x7f86e40b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.752+0000 7f86e8e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86e40acf10 0x7f86e4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.752+0000 7f86e8e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e415a4e0 con 0x7f86e40afca0 2024-08-17T02:23:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.752+0000 7f86e8e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e40b0980 con 0x7f86e40acf10 2024-08-17T02:23:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.752+0000 7f86e8e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40c92b0 con 0x7f86e41590b0 2024-08-17T02:23:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.753+0000 7f86e2800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86e40acf10 0x7f86e4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.753+0000 7f86e1e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f86e40afca0 0x7f86e41589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49416/0 (socket says 172.21.15.5:49416) 2024-08-17T02:23:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.753+0000 7f86e2800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86e40acf10 0x7f86e4159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44356/0 (socket says 172.21.15.5:44356) 2024-08-17T02:23:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.753+0000 7f86e1e00640 1 -- 172.21.15.5:0/2134958796 learned_addr learned my addr 172.21.15.5:0/2134958796 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.753+0000 7f86e2800640 1 -- 172.21.15.5:0/2134958796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86e41590b0 msgr2=0x7f86e40b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.753+0000 7f86dbe00640 1 --2- 172.21.15.5:0/2134958796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86e41590b0 0x7f86e40b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.753+0000 7f86e1400640 1 -- 172.21.15.5:0/2134958796 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071998194 0 0) 0x7f86d4001110 con 0x7f86e40afca0 2024-08-17T02:23:47.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.753+0000 7f86e2800640 1 --2- 172.21.15.5:0/2134958796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86e41590b0 0x7f86e40b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.753+0000 7f86e2800640 1 -- 172.21.15.5:0/2134958796 >> v1:172.21.15.5:6789/0 conn(0x7f86e40afca0 legacy=0x7f86e41589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.753+0000 7f86e2800640 1 -- 172.21.15.5:0/2134958796 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e40ad480 con 0x7f86e40acf10 2024-08-17T02:23:47.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.753+0000 7f86dbe00640 1 --2- 172.21.15.5:0/2134958796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86e41590b0 0x7f86e40b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:47.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.754+0000 7f86e2800640 1 --2- 172.21.15.5:0/2134958796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e40acf10 0x7f86e4159fa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009e60 tx=0x7f86dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971e47b82d7898a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:47.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.754+0000 7f86e1400640 1 -- 172.21.15.5:0/2134958796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc007550 con 0x7f86e40acf10 2024-08-17T02:23:47.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.754+0000 7f86e1400640 1 -- 172.21.15.5:0/2134958796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc02d050 con 0x7f86e40acf10 2024-08-17T02:23:47.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.754+0000 7f86e1400640 1 -- 172.21.15.5:0/2134958796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0078e0 con 0x7f86e40acf10 2024-08-17T02:23:47.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.755+0000 7f86e8e00640 1 -- 172.21.15.5:0/2134958796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e40acf10 msgr2=0x7f86e4159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.755+0000 7f86e8e00640 1 --2- 172.21.15.5:0/2134958796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e40acf10 0x7f86e4159fa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009e60 tx=0x7f86dc009780 comp rx=0 tx=0).stop 2024-08-17T02:23:47.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.755+0000 7f86e8e00640 1 -- 172.21.15.5:0/2134958796 shutdown_connections 2024-08-17T02:23:47.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.755+0000 7f86e8e00640 1 --2- 172.21.15.5:0/2134958796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e40acf10 0x7f86e4159fa0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.755+0000 7f86e8e00640 1 --2- 172.21.15.5:0/2134958796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86e41590b0 0x7f86e40b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.755+0000 7f86e8e00640 1 -- 172.21.15.5:0/2134958796 >> 172.21.15.5:0/2134958796 conn(0x7f86e4066e60 msgr2=0x7f86e4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:47.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.755+0000 7f86e8e00640 1 -- 172.21.15.5:0/2134958796 shutdown_connections 2024-08-17T02:23:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.755+0000 7f86e8e00640 1 -- 172.21.15.5:0/2134958796 wait complete. 2024-08-17T02:23:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.756+0000 7f86e8e00640 1 Processor -- start 2024-08-17T02:23:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.757+0000 7f86e8e00640 1 -- start start 2024-08-17T02:23:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.757+0000 7f86e8e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86e40acf10 0x7f86e4168d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.757+0000 7f86e8e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86e40afca0 0x7f86e416bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.757+0000 7f86e8e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e41590b0 0x7f86e40c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.757+0000 7f86e8e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e416c050 con 0x7f86e41590b0 2024-08-17T02:23:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.757+0000 7f86e8e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4157cd0 con 0x7f86e40acf10 2024-08-17T02:23:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.757+0000 7f86e8e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4157fb0 con 0x7f86e40afca0 2024-08-17T02:23:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.758+0000 7f86e2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e41590b0 0x7f86e40c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.758+0000 7f86e1e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86e40acf10 0x7f86e4168d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.758+0000 7f86e2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e41590b0 0x7f86e40c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44360/0 (socket says 172.21.15.5:44360) 2024-08-17T02:23:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.758+0000 7f86e2800640 1 -- 172.21.15.5:0/2987296399 learned_addr learned my addr 172.21.15.5:0/2987296399 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.758+0000 7f86dbe00640 1 --2- 172.21.15.5:0/2987296399 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86e40afca0 0x7f86e416bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.758+0000 7f86e2800640 1 -- 172.21.15.5:0/2987296399 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86e40afca0 msgr2=0x7f86e416bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.758+0000 7f86e2800640 1 --2- 172.21.15.5:0/2987296399 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86e40afca0 0x7f86e416bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.758+0000 7f86e2800640 1 -- 172.21.15.5:0/2987296399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86e40acf10 msgr2=0x7f86e4168d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.758+0000 7f86e2800640 1 --2- 172.21.15.5:0/2987296399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86e40acf10 0x7f86e4168d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.758+0000 7f86e2800640 1 -- 172.21.15.5:0/2987296399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc009a20 con 0x7f86e41590b0 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.758+0000 7f86e2800640 1 --2- 172.21.15.5:0/2987296399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e41590b0 0x7f86e40c6cb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009e60 tx=0x7f86dc037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.759+0000 7f86d9600640 1 -- 172.21.15.5:0/2987296399 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0319e0 con 0x7f86e41590b0 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.759+0000 7f86d9600640 1 -- 172.21.15.5:0/2987296399 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc040070 con 0x7f86e41590b0 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.759+0000 7f86d9600640 1 -- 172.21.15.5:0/2987296399 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc031d70 con 0x7f86e41590b0 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.759+0000 7f86e8e00640 1 -- 172.21.15.5:0/2987296399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e4158290 con 0x7f86e41590b0 2024-08-17T02:23:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.759+0000 7f86e8e00640 1 -- 172.21.15.5:0/2987296399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e40c4ed0 con 0x7f86e41590b0 2024-08-17T02:23:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.760+0000 7f86e8e00640 1 -- 172.21.15.5:0/2987296399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e40c50f0 con 0x7f86e41590b0 2024-08-17T02:23:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.760+0000 7f86d9600640 1 -- 172.21.15.5:0/2987296399 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f86dc042030 con 0x7f86e41590b0 2024-08-17T02:23:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.762+0000 7f86d9600640 1 --2- 172.21.15.5:0/2987296399 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f86c0065150 0x7f86c0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.762+0000 7f86d9600640 1 -- 172.21.15.5:0/2987296399 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f86dc0a3da0 con 0x7f86e41590b0 2024-08-17T02:23:47.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.762+0000 7f86e1e00640 1 --2- 172.21.15.5:0/2987296399 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f86c0065150 0x7f86c0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:47.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.762+0000 7f86e1e00640 1 --2- 172.21.15.5:0/2987296399 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f86c0065150 0x7f86c0067600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f86d4006e90 tx=0x7f86d4007b00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:47.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.766+0000 7f86d9600640 1 -- 172.21.15.5:0/2987296399 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f86dc071e70 con 0x7f86e41590b0 2024-08-17T02:23:47.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.949+0000 7f86e8e00640 1 -- 172.21.15.5:0/2987296399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86e4063fb0 con 0x7f86e41590b0 2024-08-17T02:23:47.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.950+0000 7f86d9600640 1 -- 172.21.15.5:0/2987296399 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f86dc075490 con 0x7f86e41590b0 2024-08-17T02:23:47.951 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:47.951 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:36.575545+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:32.642845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:33.982937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:47.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.952+0000 7f86e8e00640 1 -- 172.21.15.5:0/2987296399 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f86c0065150 msgr2=0x7f86c0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.952+0000 7f86e8e00640 1 --2- 172.21.15.5:0/2987296399 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f86c0065150 0x7f86c0067600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f86d4006e90 tx=0x7f86d4007b00 comp rx=0 tx=0).stop 2024-08-17T02:23:47.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.952+0000 7f86e8e00640 1 -- 172.21.15.5:0/2987296399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e41590b0 msgr2=0x7f86e40c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:47.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.952+0000 7f86e8e00640 1 --2- 172.21.15.5:0/2987296399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e41590b0 0x7f86e40c6cb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009e60 tx=0x7f86dc037000 comp rx=0 tx=0).stop 2024-08-17T02:23:47.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.952+0000 7f86e8e00640 1 -- 172.21.15.5:0/2987296399 shutdown_connections 2024-08-17T02:23:47.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.952+0000 7f86e8e00640 1 --2- 172.21.15.5:0/2987296399 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f86c0065150 0x7f86c0067600 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.952+0000 7f86e8e00640 1 --2- 172.21.15.5:0/2987296399 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86e40afca0 0x7f86e416bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.952+0000 7f86e8e00640 1 --2- 172.21.15.5:0/2987296399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e41590b0 0x7f86e40c6cb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.952+0000 7f86e8e00640 1 --2- 172.21.15.5:0/2987296399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86e40acf10 0x7f86e4168d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:47.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.952+0000 7f86e8e00640 1 -- 172.21.15.5:0/2987296399 >> 172.21.15.5:0/2987296399 conn(0x7f86e4066e60 msgr2=0x7f86e40ca9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:47.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.952+0000 7f86e8e00640 1 -- 172.21.15.5:0/2987296399 shutdown_connections 2024-08-17T02:23:47.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:47.952+0000 7f86e8e00640 1 -- 172.21.15.5:0/2987296399 wait complete. 2024-08-17T02:23:47.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:28.773677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:23:32.642845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:23:33.982937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:23:47.970 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:23:48.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.122+0000 7ff51f200640 1 Processor -- start 2024-08-17T02:23:48.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.122+0000 7ff51f200640 1 -- start start 2024-08-17T02:23:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.123+0000 7ff51f200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff518067aa0 0x7ff5180acb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.123+0000 7ff51f200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5180a8dd0 con 0x7ff518158f30 2024-08-17T02:23:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.123+0000 7ff51f200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5180abbc0 con 0x7ff518158b60 2024-08-17T02:23:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.123+0000 7ff51f200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5180abe60 con 0x7ff518067aa0 2024-08-17T02:23:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.123+0000 7ff51d200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff518067aa0 0x7ff5180acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.124+0000 7ff51d200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff518067aa0 0x7ff5180acb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44370/0 (socket says 172.21.15.5:44370) 2024-08-17T02:23:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.124+0000 7ff51d200640 1 -- 172.21.15.5:0/278936560 learned_addr learned my addr 172.21.15.5:0/278936560 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.124+0000 7ff517400640 1 --1- 172.21.15.5:0/278936560 >> v1:172.21.15.5:6789/0 conn(0x7ff518158f30 0x7ff5180a9260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49420/0 (socket says 172.21.15.5:49420) 2024-08-17T02:23:48.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.124+0000 7ff51d200640 1 -- 172.21.15.5:0/278936560 >> v1:172.21.15.87:6789/0 conn(0x7ff518158b60 legacy=0x7ff5180ac420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.124+0000 7ff51d200640 1 -- 172.21.15.5:0/278936560 >> v1:172.21.15.5:6789/0 conn(0x7ff518158f30 legacy=0x7ff5180a9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.124+0000 7ff51d200640 1 -- 172.21.15.5:0/278936560 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5180ac140 con 0x7ff518067aa0 2024-08-17T02:23:48.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.125+0000 7ff51d200640 1 --2- 172.21.15.5:0/278936560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff518067aa0 0x7ff5180acb30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff510009f20 tx=0x7ff510009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f901a419d2221e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.125+0000 7ff516a00640 1 -- 172.21.15.5:0/278936560 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff510032460 con 0x7ff518067aa0 2024-08-17T02:23:48.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.125+0000 7ff516a00640 1 -- 172.21.15.5:0/278936560 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5100325c0 con 0x7ff518067aa0 2024-08-17T02:23:48.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.125+0000 7ff516a00640 1 -- 172.21.15.5:0/278936560 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5100329a0 con 0x7ff518067aa0 2024-08-17T02:23:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.126+0000 7ff51f200640 1 -- 172.21.15.5:0/278936560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff518067aa0 msgr2=0x7ff5180acb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.126+0000 7ff51f200640 1 --2- 172.21.15.5:0/278936560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff518067aa0 0x7ff5180acb30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff510009f20 tx=0x7ff510009840 comp rx=0 tx=0).stop 2024-08-17T02:23:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.126+0000 7ff51f200640 1 -- 172.21.15.5:0/278936560 shutdown_connections 2024-08-17T02:23:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.126+0000 7ff51f200640 1 --2- 172.21.15.5:0/278936560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff518067aa0 0x7ff5180acb30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.126+0000 7ff51f200640 1 -- 172.21.15.5:0/278936560 >> 172.21.15.5:0/278936560 conn(0x7ff5180cc390 msgr2=0x7ff518066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.126+0000 7ff51f200640 1 -- 172.21.15.5:0/278936560 shutdown_connections 2024-08-17T02:23:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.126+0000 7ff51f200640 1 -- 172.21.15.5:0/278936560 wait complete. 2024-08-17T02:23:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.127+0000 7ff51f200640 1 Processor -- start 2024-08-17T02:23:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.127+0000 7ff51f200640 1 -- start start 2024-08-17T02:23:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.128+0000 7ff51f200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff518067aa0 0x7ff51813fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.128+0000 7ff51f200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff518158b60 0x7ff518157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.128+0000 7ff51f200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff518158f30 0x7ff518157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.128+0000 7ff51f200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff518154fd0 con 0x7ff518158b60 2024-08-17T02:23:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.128+0000 7ff51f200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5181546e0 con 0x7ff518158f30 2024-08-17T02:23:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.128+0000 7ff51f200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff518140210 con 0x7ff518067aa0 2024-08-17T02:23:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.129+0000 7ff517400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff518158b60 0x7ff518157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.129+0000 7ff517400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff518158b60 0x7ff518157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44378/0 (socket says 172.21.15.5:44378) 2024-08-17T02:23:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.129+0000 7ff517400640 1 -- 172.21.15.5:0/3725284977 learned_addr learned my addr 172.21.15.5:0/3725284977 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.129+0000 7ff51d200640 1 --2- 172.21.15.5:0/3725284977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff518158f30 0x7ff518157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.129+0000 7ff517e00640 1 --2- 172.21.15.5:0/3725284977 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff518067aa0 0x7ff51813fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.129+0000 7ff517400640 1 -- 172.21.15.5:0/3725284977 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff518067aa0 msgr2=0x7ff51813fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.129+0000 7ff517400640 1 --2- 172.21.15.5:0/3725284977 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff518067aa0 0x7ff51813fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.129+0000 7ff517400640 1 -- 172.21.15.5:0/3725284977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff518158f30 msgr2=0x7ff518157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.129+0000 7ff517400640 1 --2- 172.21.15.5:0/3725284977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff518158f30 0x7ff518157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.129+0000 7ff517400640 1 -- 172.21.15.5:0/3725284977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff510009ae0 con 0x7ff518158b60 2024-08-17T02:23:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.129+0000 7ff517400640 1 --2- 172.21.15.5:0/3725284977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff518158b60 0x7ff518157030 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff50400c4e0 tx=0x7ff504007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.130+0000 7ff50f400640 1 -- 172.21.15.5:0/3725284977 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5040072e0 con 0x7ff518158b60 2024-08-17T02:23:48.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.130+0000 7ff50f400640 1 -- 172.21.15.5:0/3725284977 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff504007460 con 0x7ff518158b60 2024-08-17T02:23:48.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.130+0000 7ff50f400640 1 -- 172.21.15.5:0/3725284977 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5040047a0 con 0x7ff518158b60 2024-08-17T02:23:48.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.130+0000 7ff51f200640 1 -- 172.21.15.5:0/3725284977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff518154980 con 0x7ff518158b60 2024-08-17T02:23:48.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.130+0000 7ff51f200640 1 -- 172.21.15.5:0/3725284977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff518153a40 con 0x7ff518158b60 2024-08-17T02:23:48.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.131+0000 7ff51f200640 1 -- 172.21.15.5:0/3725284977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff518155140 con 0x7ff518158b60 2024-08-17T02:23:48.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.132+0000 7ff50f400640 1 -- 172.21.15.5:0/3725284977 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff504004bf0 con 0x7ff518158b60 2024-08-17T02:23:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.133+0000 7ff50f400640 1 --2- 172.21.15.5:0/3725284977 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff4f8065150 0x7ff4f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.133+0000 7ff50f400640 1 -- 172.21.15.5:0/3725284977 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff504081c70 con 0x7ff518158b60 2024-08-17T02:23:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.133+0000 7ff517e00640 1 --2- 172.21.15.5:0/3725284977 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff4f8065150 0x7ff4f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.134+0000 7ff517e00640 1 --2- 172.21.15.5:0/3725284977 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff4f8065150 0x7ff4f8067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff508007fd0 tx=0x7ff508007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.137+0000 7ff50f400640 1 -- 172.21.15.5:0/3725284977 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff50404fd40 con 0x7ff518158b60 2024-08-17T02:23:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.321+0000 7ff51f200640 1 -- 172.21.15.5:0/3725284977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff518063fb0 con 0x7ff518158b60 2024-08-17T02:23:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.322+0000 7ff50f400640 1 -- 172.21.15.5:0/3725284977 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff504053360 con 0x7ff518158b60 2024-08-17T02:23:48.323 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:23:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.324+0000 7ff51f200640 1 -- 172.21.15.5:0/3725284977 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff4f8065150 msgr2=0x7ff4f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.324+0000 7ff51f200640 1 --2- 172.21.15.5:0/3725284977 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff4f8065150 0x7ff4f8067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff508007fd0 tx=0x7ff508007e30 comp rx=0 tx=0).stop 2024-08-17T02:23:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.324+0000 7ff51f200640 1 -- 172.21.15.5:0/3725284977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff518158b60 msgr2=0x7ff518157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.324+0000 7ff51f200640 1 --2- 172.21.15.5:0/3725284977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff518158b60 0x7ff518157030 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff50400c4e0 tx=0x7ff504007ee0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.324+0000 7ff51f200640 1 -- 172.21.15.5:0/3725284977 shutdown_connections 2024-08-17T02:23:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.324+0000 7ff51f200640 1 --2- 172.21.15.5:0/3725284977 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff4f8065150 0x7ff4f8067600 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.324+0000 7ff51f200640 1 --2- 172.21.15.5:0/3725284977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff518158f30 0x7ff518157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.324+0000 7ff51f200640 1 --2- 172.21.15.5:0/3725284977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff518158b60 0x7ff518157030 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.324+0000 7ff51f200640 1 --2- 172.21.15.5:0/3725284977 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff518067aa0 0x7ff51813fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.324+0000 7ff51f200640 1 -- 172.21.15.5:0/3725284977 >> 172.21.15.5:0/3725284977 conn(0x7ff5180cc390 msgr2=0x7ff5180af1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.324+0000 7ff51f200640 1 -- 172.21.15.5:0/3725284977 shutdown_connections 2024-08-17T02:23:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.324+0000 7ff51f200640 1 -- 172.21.15.5:0/3725284977 wait complete. 2024-08-17T02:23:48.340 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:23:48.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.494+0000 7fa4e6600640 1 Processor -- start 2024-08-17T02:23:48.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.494+0000 7fa4e6600640 1 -- start start 2024-08-17T02:23:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.496+0000 7fa4e6600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa4e014c9e0 0x7fa4e00cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.496+0000 7fa4e6600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e00cc3d0 0x7fa4e00acce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.496+0000 7fa4e6600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa4e00ad220 0x7fa4e0156e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.496+0000 7fa4e6600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e00ad6a0 con 0x7fa4e014c9e0 2024-08-17T02:23:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.496+0000 7fa4e6600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e00696e0 con 0x7fa4e00ad220 2024-08-17T02:23:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.496+0000 7fa4e6600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e00699c0 con 0x7fa4e00cc3d0 2024-08-17T02:23:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.496+0000 7fa4e5200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa4e014c9e0 0x7fa4e00cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.496+0000 7fa4e5200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa4e014c9e0 0x7fa4e00cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44394/0 (socket says 172.21.15.5:44394) 2024-08-17T02:23:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.496+0000 7fa4e5200640 1 -- 172.21.15.5:0/3715011780 learned_addr learned my addr 172.21.15.5:0/3715011780 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.496+0000 7fa4e5c00640 1 --2- 172.21.15.5:0/3715011780 >> v2:172.21.15.87:3300/0 conn(0x7fa4e00ad220 0x7fa4e0156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.496+0000 7fa4dfe00640 1 --2- 172.21.15.5:0/3715011780 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e00cc3d0 0x7fa4e00acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.496+0000 7fa4e5200640 1 -- 172.21.15.5:0/3715011780 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e00cc3d0 msgr2=0x7fa4e00acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.496+0000 7fa4e5200640 1 --2- 172.21.15.5:0/3715011780 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e00cc3d0 0x7fa4e00acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.496+0000 7fa4e5200640 1 -- 172.21.15.5:0/3715011780 >> v2:172.21.15.87:3300/0 conn(0x7fa4e00ad220 msgr2=0x7fa4e0156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.496+0000 7fa4e5200640 1 --2- 172.21.15.5:0/3715011780 >> v2:172.21.15.87:3300/0 conn(0x7fa4e00ad220 0x7fa4e0156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.496+0000 7fa4e5200640 1 -- 172.21.15.5:0/3715011780 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e0069ca0 con 0x7fa4e014c9e0 2024-08-17T02:23:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.497+0000 7fa4e5200640 1 --2- 172.21.15.5:0/3715011780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4e014c9e0 0x7fa4e00cbe90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00cc840 tx=0x7fa4d400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61881cea5825c5ed server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.498+0000 7fa4df400640 1 -- 172.21.15.5:0/3715011780 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4032640 con 0x7fa4e014c9e0 2024-08-17T02:23:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.498+0000 7fa4df400640 1 -- 172.21.15.5:0/3715011780 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d40327a0 con 0x7fa4e014c9e0 2024-08-17T02:23:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.498+0000 7fa4df400640 1 -- 172.21.15.5:0/3715011780 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4032b80 con 0x7fa4e014c9e0 2024-08-17T02:23:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.498+0000 7fa4e6600640 1 -- 172.21.15.5:0/3715011780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4e014c9e0 msgr2=0x7fa4e00cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.498+0000 7fa4e6600640 1 --2- 172.21.15.5:0/3715011780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4e014c9e0 0x7fa4e00cbe90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00cc840 tx=0x7fa4d400b460 comp rx=0 tx=0).stop 2024-08-17T02:23:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.498+0000 7fa4e6600640 1 -- 172.21.15.5:0/3715011780 shutdown_connections 2024-08-17T02:23:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.498+0000 7fa4e6600640 1 --2- 172.21.15.5:0/3715011780 >> v2:172.21.15.87:3300/0 conn(0x7fa4e00ad220 0x7fa4e0156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.498+0000 7fa4e6600640 1 --2- 172.21.15.5:0/3715011780 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e00cc3d0 0x7fa4e00acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.498+0000 7fa4e6600640 1 --2- 172.21.15.5:0/3715011780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4e014c9e0 0x7fa4e00cbe90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.498+0000 7fa4e6600640 1 -- 172.21.15.5:0/3715011780 >> 172.21.15.5:0/3715011780 conn(0x7fa4e0067930 msgr2=0x7fa4e00cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.498+0000 7fa4e6600640 1 -- 172.21.15.5:0/3715011780 shutdown_connections 2024-08-17T02:23:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.498+0000 7fa4e6600640 1 -- 172.21.15.5:0/3715011780 wait complete. 2024-08-17T02:23:48.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.500+0000 7fa4e6600640 1 Processor -- start 2024-08-17T02:23:48.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.500+0000 7fa4e6600640 1 -- start start 2024-08-17T02:23:48.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.501+0000 7fa4e6600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e00ad220 0x7fa4e0151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.501+0000 7fa4e6600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4e00cc3d0 0x7fa4e014f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.501+0000 7fa4e6600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e014c9e0 0x7fa4e013f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.501+0000 7fa4e6600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e0154060 con 0x7fa4e00cc3d0 2024-08-17T02:23:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.501+0000 7fa4e6600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e0154b80 con 0x7fa4e014c9e0 2024-08-17T02:23:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.501+0000 7fa4e6600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e014fc60 con 0x7fa4e00ad220 2024-08-17T02:23:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.501+0000 7fa4dfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4e00cc3d0 0x7fa4e014f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.501+0000 7fa4dfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4e00cc3d0 0x7fa4e014f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44404/0 (socket says 172.21.15.5:44404) 2024-08-17T02:23:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.501+0000 7fa4dfe00640 1 -- 172.21.15.5:0/921679956 learned_addr learned my addr 172.21.15.5:0/921679956 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.501+0000 7fa4e5200640 1 --2- 172.21.15.5:0/921679956 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e00ad220 0x7fa4e0151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.501+0000 7fa4e5c00640 1 --2- 172.21.15.5:0/921679956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e014c9e0 0x7fa4e013f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.501+0000 7fa4dfe00640 1 -- 172.21.15.5:0/921679956 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e00ad220 msgr2=0x7fa4e0151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.501+0000 7fa4dfe00640 1 --2- 172.21.15.5:0/921679956 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e00ad220 0x7fa4e0151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.501+0000 7fa4dfe00640 1 -- 172.21.15.5:0/921679956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e014c9e0 msgr2=0x7fa4e013f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.501+0000 7fa4dfe00640 1 --2- 172.21.15.5:0/921679956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e014c9e0 0x7fa4e013f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.501+0000 7fa4dfe00640 1 -- 172.21.15.5:0/921679956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d400b700 con 0x7fa4e00cc3d0 2024-08-17T02:23:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.502+0000 7fa4dfe00640 1 --2- 172.21.15.5:0/921679956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4e00cc3d0 0x7fa4e014f450 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00d890 tx=0x7fa4cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.502+0000 7fa4d3e00640 1 -- 172.21.15.5:0/921679956 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc00de20 con 0x7fa4e00cc3d0 2024-08-17T02:23:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.502+0000 7fa4d3e00640 1 -- 172.21.15.5:0/921679956 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc00b8d0 con 0x7fa4e00cc3d0 2024-08-17T02:23:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.502+0000 7fa4d3e00640 1 -- 172.21.15.5:0/921679956 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc00bc70 con 0x7fa4e00cc3d0 2024-08-17T02:23:48.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.502+0000 7fa4e6600640 1 -- 172.21.15.5:0/921679956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e0154290 con 0x7fa4e00cc3d0 2024-08-17T02:23:48.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.502+0000 7fa4e6600640 1 -- 172.21.15.5:0/921679956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e01545b0 con 0x7fa4e00cc3d0 2024-08-17T02:23:48.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.503+0000 7fa4e6600640 1 -- 172.21.15.5:0/921679956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e0154d10 con 0x7fa4e00cc3d0 2024-08-17T02:23:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.504+0000 7fa4d3e00640 1 -- 172.21.15.5:0/921679956 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa4cc014640 con 0x7fa4e00cc3d0 2024-08-17T02:23:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.505+0000 7fa4d3e00640 1 --2- 172.21.15.5:0/921679956 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa4c00651d0 0x7fa4c0067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.505+0000 7fa4d3e00640 1 -- 172.21.15.5:0/921679956 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4cc082b30 con 0x7fa4e00cc3d0 2024-08-17T02:23:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.505+0000 7fa4e5200640 1 --2- 172.21.15.5:0/921679956 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa4c00651d0 0x7fa4c0067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.506+0000 7fa4e5200640 1 --2- 172.21.15.5:0/921679956 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa4c00651d0 0x7fa4c0067680 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4037000 tx=0x7fa4d403a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.509+0000 7fa4d3e00640 1 -- 172.21.15.5:0/921679956 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa4cc050b50 con 0x7fa4e00cc3d0 2024-08-17T02:23:48.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.693+0000 7fa4e6600640 1 -- 172.21.15.5:0/921679956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa4e0070720 con 0x7fa4e00cc3d0 2024-08-17T02:23:48.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.694+0000 7fa4d3e00640 1 -- 172.21.15.5:0/921679956 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa4cc054170 con 0x7fa4e00cc3d0 2024-08-17T02:23:48.695 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:23:48.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.696+0000 7fa4e6600640 1 -- 172.21.15.5:0/921679956 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa4c00651d0 msgr2=0x7fa4c0067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.696+0000 7fa4e6600640 1 --2- 172.21.15.5:0/921679956 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa4c00651d0 0x7fa4c0067680 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4037000 tx=0x7fa4d403a000 comp rx=0 tx=0).stop 2024-08-17T02:23:48.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.696+0000 7fa4e6600640 1 -- 172.21.15.5:0/921679956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4e00cc3d0 msgr2=0x7fa4e014f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.696+0000 7fa4e6600640 1 --2- 172.21.15.5:0/921679956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4e00cc3d0 0x7fa4e014f450 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00d890 tx=0x7fa4cc008040 comp rx=0 tx=0).stop 2024-08-17T02:23:48.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.696+0000 7fa4e6600640 1 -- 172.21.15.5:0/921679956 shutdown_connections 2024-08-17T02:23:48.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.696+0000 7fa4e6600640 1 --2- 172.21.15.5:0/921679956 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa4c00651d0 0x7fa4c0067680 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.696+0000 7fa4e6600640 1 --2- 172.21.15.5:0/921679956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e014c9e0 0x7fa4e013f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.696+0000 7fa4e6600640 1 --2- 172.21.15.5:0/921679956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4e00cc3d0 0x7fa4e014f450 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.696+0000 7fa4e6600640 1 --2- 172.21.15.5:0/921679956 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e00ad220 0x7fa4e0151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.696+0000 7fa4e6600640 1 -- 172.21.15.5:0/921679956 >> 172.21.15.5:0/921679956 conn(0x7fa4e0067930 msgr2=0x7fa4e00c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:48.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.696+0000 7fa4e6600640 1 -- 172.21.15.5:0/921679956 shutdown_connections 2024-08-17T02:23:48.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.696+0000 7fa4e6600640 1 -- 172.21.15.5:0/921679956 wait complete. 2024-08-17T02:23:48.711 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:23:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.865+0000 7fada7200640 1 Processor -- start 2024-08-17T02:23:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.865+0000 7fada7200640 1 -- start start 2024-08-17T02:23:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.866+0000 7fada7200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fada00acf10 0x7fada00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.866+0000 7fada7200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada00c92b0 con 0x7fada00afca0 2024-08-17T02:23:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.866+0000 7fada7200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada00ad480 con 0x7fada01590b0 2024-08-17T02:23:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.866+0000 7fada7200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada00b0980 con 0x7fada00acf10 2024-08-17T02:23:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.867+0000 7fada5200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fada00acf10 0x7fada00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.867+0000 7fad9fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fada00afca0 0x7fada01589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49428/0 (socket says 172.21.15.5:49428) 2024-08-17T02:23:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.867+0000 7fad9fe00640 1 -- 172.21.15.5:0/2986830084 learned_addr learned my addr 172.21.15.5:0/2986830084 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.867+0000 7fada5200640 1 -- 172.21.15.5:0/2986830084 >> v1:172.21.15.87:6789/0 conn(0x7fada01590b0 legacy=0x7fada00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.867+0000 7fada5200640 1 -- 172.21.15.5:0/2986830084 >> v1:172.21.15.5:6789/0 conn(0x7fada00afca0 legacy=0x7fada01589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.867+0000 7fada5200640 1 -- 172.21.15.5:0/2986830084 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada00ad760 con 0x7fada00acf10 2024-08-17T02:23:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.867+0000 7fad9ea00640 1 -- 172.21.15.5:0/2986830084 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086517343 0 0) 0x7fada00c92b0 con 0x7fada00afca0 2024-08-17T02:23:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.868+0000 7fada5200640 1 --2- 172.21.15.5:0/2986830084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fada00acf10 0x7fada00b0070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fad98009e60 tx=0x7fad98009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64eab4c14677bb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.868+0000 7fad9ea00640 1 -- 172.21.15.5:0/2986830084 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98007550 con 0x7fada00acf10 2024-08-17T02:23:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.868+0000 7fad9ea00640 1 -- 172.21.15.5:0/2986830084 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9802d050 con 0x7fada00acf10 2024-08-17T02:23:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.868+0000 7fad9ea00640 1 -- 172.21.15.5:0/2986830084 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98007900 con 0x7fada00acf10 2024-08-17T02:23:48.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.869+0000 7fada7200640 1 -- 172.21.15.5:0/2986830084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fada00acf10 msgr2=0x7fada00b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.869+0000 7fada7200640 1 --2- 172.21.15.5:0/2986830084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fada00acf10 0x7fada00b0070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fad98009e60 tx=0x7fad98009780 comp rx=0 tx=0).stop 2024-08-17T02:23:48.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.869+0000 7fada7200640 1 -- 172.21.15.5:0/2986830084 shutdown_connections 2024-08-17T02:23:48.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.869+0000 7fada7200640 1 --2- 172.21.15.5:0/2986830084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fada00acf10 0x7fada00b0070 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.869+0000 7fada7200640 1 -- 172.21.15.5:0/2986830084 >> 172.21.15.5:0/2986830084 conn(0x7fada0066e60 msgr2=0x7fada0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:48.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.869+0000 7fada7200640 1 -- 172.21.15.5:0/2986830084 shutdown_connections 2024-08-17T02:23:48.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.869+0000 7fada7200640 1 -- 172.21.15.5:0/2986830084 wait complete. 2024-08-17T02:23:48.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.870+0000 7fada7200640 1 Processor -- start 2024-08-17T02:23:48.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.870+0000 7fada7200640 1 -- start start 2024-08-17T02:23:48.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.871+0000 7fada7200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fada00acf10 0x7fada0155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.871+0000 7fada7200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fada00afca0 0x7fada01395b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.871+0000 7fada7200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fada01590b0 0x7fada0139af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.871+0000 7fada7200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada0152190 con 0x7fada01590b0 2024-08-17T02:23:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.871+0000 7fada7200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada0152470 con 0x7fada00acf10 2024-08-17T02:23:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.871+0000 7fada7200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada0152750 con 0x7fada00afca0 2024-08-17T02:23:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.871+0000 7fada5200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fada01590b0 0x7fada0139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.872+0000 7fada5200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fada01590b0 0x7fada0139af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44420/0 (socket says 172.21.15.5:44420) 2024-08-17T02:23:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.872+0000 7fada5200640 1 -- 172.21.15.5:0/323822481 learned_addr learned my addr 172.21.15.5:0/323822481 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.872+0000 7fad9fe00640 1 --2- 172.21.15.5:0/323822481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fada00acf10 0x7fada0155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.872+0000 7fad9f400640 1 --2- 172.21.15.5:0/323822481 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fada00afca0 0x7fada01395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.872+0000 7fada5200640 1 -- 172.21.15.5:0/323822481 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fada00afca0 msgr2=0x7fada01395b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.872+0000 7fada5200640 1 --2- 172.21.15.5:0/323822481 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fada00afca0 0x7fada01395b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.872+0000 7fada5200640 1 -- 172.21.15.5:0/323822481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fada00acf10 msgr2=0x7fada0155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:48.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.872+0000 7fada5200640 1 --2- 172.21.15.5:0/323822481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fada00acf10 0x7fada0155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:48.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.872+0000 7fada5200640 1 -- 172.21.15.5:0/323822481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad98009a20 con 0x7fada01590b0 2024-08-17T02:23:48.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.872+0000 7fada5200640 1 --2- 172.21.15.5:0/323822481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fada01590b0 0x7fada0139af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fad980097c0 tx=0x7fad98037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.872+0000 7fad97400640 1 -- 172.21.15.5:0/323822481 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98031cc0 con 0x7fada01590b0 2024-08-17T02:23:48.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.873+0000 7fad97400640 1 -- 172.21.15.5:0/323822481 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad98031e20 con 0x7fada01590b0 2024-08-17T02:23:48.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.873+0000 7fad97400640 1 -- 172.21.15.5:0/323822481 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9803d680 con 0x7fada01590b0 2024-08-17T02:23:48.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.873+0000 7fada7200640 1 -- 172.21.15.5:0/323822481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada0152a30 con 0x7fada01590b0 2024-08-17T02:23:48.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.873+0000 7fada7200640 1 -- 172.21.15.5:0/323822481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada0155750 con 0x7fada01590b0 2024-08-17T02:23:48.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.874+0000 7fada7200640 1 -- 172.21.15.5:0/323822481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada0152f30 con 0x7fada01590b0 2024-08-17T02:23:48.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.874+0000 7fad97400640 1 -- 172.21.15.5:0/323822481 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fad98003040 con 0x7fada01590b0 2024-08-17T02:23:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.875+0000 7fad97400640 1 --2- 172.21.15.5:0/323822481 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fad80065150 0x7fad80067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.875+0000 7fad97400640 1 -- 172.21.15.5:0/323822481 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fad980a3dc0 con 0x7fada01590b0 2024-08-17T02:23:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.876+0000 7fad9fe00640 1 --2- 172.21.15.5:0/323822481 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fad80065150 0x7fad80067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.876+0000 7fad9fe00640 1 --2- 172.21.15.5:0/323822481 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fad80065150 0x7fad80067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fad900011e0 tx=0x7fad90007c80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:48.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:48.879+0000 7fad97400640 1 -- 172.21.15.5:0/323822481 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fad98071e90 con 0x7fada01590b0 2024-08-17T02:23:49.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.065+0000 7fada7200640 1 -- 172.21.15.5:0/323822481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fada0155940 con 0x7fada01590b0 2024-08-17T02:23:49.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.065+0000 7fad97400640 1 -- 172.21.15.5:0/323822481 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fad980754b0 con 0x7fada01590b0 2024-08-17T02:23:49.066 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-17T02:23:49.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.067+0000 7fada7200640 1 -- 172.21.15.5:0/323822481 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fad80065150 msgr2=0x7fad80067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.067+0000 7fada7200640 1 --2- 172.21.15.5:0/323822481 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fad80065150 0x7fad80067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fad900011e0 tx=0x7fad90007c80 comp rx=0 tx=0).stop 2024-08-17T02:23:49.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.067+0000 7fada7200640 1 -- 172.21.15.5:0/323822481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fada01590b0 msgr2=0x7fada0139af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.067+0000 7fada7200640 1 --2- 172.21.15.5:0/323822481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fada01590b0 0x7fada0139af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fad980097c0 tx=0x7fad98037000 comp rx=0 tx=0).stop 2024-08-17T02:23:49.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.067+0000 7fada7200640 1 -- 172.21.15.5:0/323822481 shutdown_connections 2024-08-17T02:23:49.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.067+0000 7fada7200640 1 --2- 172.21.15.5:0/323822481 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fad80065150 0x7fad80067600 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.067+0000 7fada7200640 1 --2- 172.21.15.5:0/323822481 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fada00afca0 0x7fada01395b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.067+0000 7fada7200640 1 --2- 172.21.15.5:0/323822481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fada01590b0 0x7fada0139af0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.067+0000 7fada7200640 1 --2- 172.21.15.5:0/323822481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fada00acf10 0x7fada0155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.067+0000 7fada7200640 1 -- 172.21.15.5:0/323822481 >> 172.21.15.5:0/323822481 conn(0x7fada0066e60 msgr2=0x7fada0069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:49.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.067+0000 7fada7200640 1 -- 172.21.15.5:0/323822481 shutdown_connections 2024-08-17T02:23:49.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.068+0000 7fada7200640 1 -- 172.21.15.5:0/323822481 wait complete. 2024-08-17T02:23:49.084 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:23:49.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.234+0000 7ff2fa200640 1 Processor -- start 2024-08-17T02:23:49.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.234+0000 7ff2fa200640 1 -- start start 2024-08-17T02:23:49.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.235+0000 7ff2fa200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff2f4158b90 0x7ff2f40b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:49.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.235+0000 7ff2fa200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff2f40b2370 0x7ff2f40aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:49.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.235+0000 7ff2fa200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f40afd20 con 0x7ff2f40aef60 2024-08-17T02:23:49.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.235+0000 7ff2fa200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f40af330 con 0x7ff2f4158b90 2024-08-17T02:23:49.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.235+0000 7ff2fa200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f40affe0 con 0x7ff2f40b2370 2024-08-17T02:23:49.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.235+0000 7ff2f3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff2f4158b90 0x7ff2f40b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:49.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.235+0000 7ff2f3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff2f4158b90 0x7ff2f40b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44426/0 (socket says 172.21.15.5:44426) 2024-08-17T02:23:49.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.235+0000 7ff2f3400640 1 -- 172.21.15.5:0/4263278476 learned_addr learned my addr 172.21.15.5:0/4263278476 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:49.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.235+0000 7ff2f2a00640 1 --2- 172.21.15.5:0/4263278476 >> v2:172.21.15.87:3300/0 conn(0x7ff2f40b2370 0x7ff2f40aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.236+0000 7ff2f3400640 1 -- 172.21.15.5:0/4263278476 >> v2:172.21.15.87:3300/0 conn(0x7ff2f40b2370 msgr2=0x7ff2f40aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.236+0000 7ff2f3400640 1 --2- 172.21.15.5:0/4263278476 >> v2:172.21.15.87:3300/0 conn(0x7ff2f40b2370 0x7ff2f40aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.236+0000 7ff2f3400640 1 -- 172.21.15.5:0/4263278476 >> v1:172.21.15.87:6789/0 conn(0x7ff2f40aef60 legacy=0x7ff2f4068630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.236+0000 7ff2f3400640 1 -- 172.21.15.5:0/4263278476 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f40b02c0 con 0x7ff2f4158b90 2024-08-17T02:23:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.236+0000 7ff2f2a00640 1 --2- 172.21.15.5:0/4263278476 >> v2:172.21.15.87:3300/0 conn(0x7ff2f40b2370 0x7ff2f40aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.237+0000 7ff2f3400640 1 --2- 172.21.15.5:0/4263278476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f4158b90 0x7ff2f40b1e30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40b56c0 tx=0x7ff2e40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433a832fe00c85c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.237+0000 7ff2f2000640 1 -- 172.21.15.5:0/4263278476 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e402ae80 con 0x7ff2f4158b90 2024-08-17T02:23:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.237+0000 7ff2f2000640 1 -- 172.21.15.5:0/4263278476 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e4032440 con 0x7ff2f4158b90 2024-08-17T02:23:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.237+0000 7ff2f2000640 1 -- 172.21.15.5:0/4263278476 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4032800 con 0x7ff2f4158b90 2024-08-17T02:23:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.237+0000 7ff2fa200640 1 -- 172.21.15.5:0/4263278476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f4158b90 msgr2=0x7ff2f40b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.237+0000 7ff2fa200640 1 --2- 172.21.15.5:0/4263278476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f4158b90 0x7ff2f40b1e30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40b56c0 tx=0x7ff2e40091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.238+0000 7ff2fa200640 1 -- 172.21.15.5:0/4263278476 shutdown_connections 2024-08-17T02:23:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.238+0000 7ff2fa200640 1 --2- 172.21.15.5:0/4263278476 >> v2:172.21.15.87:3300/0 conn(0x7ff2f40b2370 0x7ff2f40aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.238+0000 7ff2fa200640 1 --2- 172.21.15.5:0/4263278476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f4158b90 0x7ff2f40b1e30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.238+0000 7ff2fa200640 1 -- 172.21.15.5:0/4263278476 >> 172.21.15.5:0/4263278476 conn(0x7ff2f406e590 msgr2=0x7ff2f406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.238+0000 7ff2fa200640 1 -- 172.21.15.5:0/4263278476 shutdown_connections 2024-08-17T02:23:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.238+0000 7ff2fa200640 1 -- 172.21.15.5:0/4263278476 wait complete. 2024-08-17T02:23:49.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.239+0000 7ff2fa200640 1 Processor -- start 2024-08-17T02:23:49.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.239+0000 7ff2fa200640 1 -- start start 2024-08-17T02:23:49.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.240+0000 7ff2fa200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f40aef60 0x7ff2f40c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:49.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.240+0000 7ff2fa200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f40b2370 0x7ff2f40c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:49.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.240+0000 7ff2fa200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f4158b90 0x7ff2f4157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:49.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.240+0000 7ff2fa200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f40c82a0 con 0x7ff2f4158b90 2024-08-17T02:23:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.240+0000 7ff2fa200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f40c7690 con 0x7ff2f40b2370 2024-08-17T02:23:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.240+0000 7ff2fa200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f40c7970 con 0x7ff2f40aef60 2024-08-17T02:23:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.240+0000 7ff2f3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f4158b90 0x7ff2f4157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.240+0000 7ff2f3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f4158b90 0x7ff2f4157950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44428/0 (socket says 172.21.15.5:44428) 2024-08-17T02:23:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.240+0000 7ff2f3e00640 1 -- 172.21.15.5:0/3120309166 learned_addr learned my addr 172.21.15.5:0/3120309166 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.240+0000 7ff2f2a00640 1 --2- 172.21.15.5:0/3120309166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f40b2370 0x7ff2f40c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.240+0000 7ff2f3400640 1 --2- 172.21.15.5:0/3120309166 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f40aef60 0x7ff2f40c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.241+0000 7ff2f3e00640 1 -- 172.21.15.5:0/3120309166 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f40aef60 msgr2=0x7ff2f40c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.241+0000 7ff2f3e00640 1 --2- 172.21.15.5:0/3120309166 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f40aef60 0x7ff2f40c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.241+0000 7ff2f3e00640 1 -- 172.21.15.5:0/3120309166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f40b2370 msgr2=0x7ff2f40c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.241+0000 7ff2f3e00640 1 --2- 172.21.15.5:0/3120309166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f40b2370 0x7ff2f40c90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.241+0000 7ff2f3e00640 1 -- 172.21.15.5:0/3120309166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e4009450 con 0x7ff2f4158b90 2024-08-17T02:23:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.241+0000 7ff2f3e00640 1 --2- 172.21.15.5:0/3120309166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f4158b90 0x7ff2f4157950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec00c7c0 tx=0x7ff2ec0015d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:49.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.241+0000 7ff2eaa00640 1 -- 172.21.15.5:0/3120309166 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec00a640 con 0x7ff2f4158b90 2024-08-17T02:23:49.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.241+0000 7ff2eaa00640 1 -- 172.21.15.5:0/3120309166 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec00a7c0 con 0x7ff2f4158b90 2024-08-17T02:23:49.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.241+0000 7ff2eaa00640 1 -- 172.21.15.5:0/3120309166 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec00ab80 con 0x7ff2f4158b90 2024-08-17T02:23:49.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.241+0000 7ff2fa200640 1 -- 172.21.15.5:0/3120309166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f40c7c50 con 0x7ff2f4158b90 2024-08-17T02:23:49.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.242+0000 7ff2fa200640 1 -- 172.21.15.5:0/3120309166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f40c7260 con 0x7ff2f4158b90 2024-08-17T02:23:49.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.243+0000 7ff2fa200640 1 -- 172.21.15.5:0/3120309166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f4063fb0 con 0x7ff2f4158b90 2024-08-17T02:23:49.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.243+0000 7ff2eaa00640 1 -- 172.21.15.5:0/3120309166 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff2ec012420 con 0x7ff2f4158b90 2024-08-17T02:23:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.245+0000 7ff2eaa00640 1 --2- 172.21.15.5:0/3120309166 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff2d4065150 0x7ff2d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.245+0000 7ff2eaa00640 1 -- 172.21.15.5:0/3120309166 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff2ec082640 con 0x7ff2f4158b90 2024-08-17T02:23:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.245+0000 7ff2f3400640 1 --2- 172.21.15.5:0/3120309166 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff2d4065150 0x7ff2d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.245+0000 7ff2f3400640 1 --2- 172.21.15.5:0/3120309166 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff2d4065150 0x7ff2d4067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4034000 tx=0x7ff2e4032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:49.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.249+0000 7ff2eaa00640 1 -- 172.21.15.5:0/3120309166 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff2ec050710 con 0x7ff2f4158b90 2024-08-17T02:23:49.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.469+0000 7ff2fa200640 1 -- 172.21.15.5:0/3120309166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2f415c7e0 con 0x7ff2f4158b90 2024-08-17T02:23:49.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.470+0000 7ff2eaa00640 1 -- 172.21.15.5:0/3120309166 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4582 (secure 0 0 0) 0x7ff2ec053d30 con 0x7ff2f4158b90 2024-08-17T02:23:49.471 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:49.471 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/2870814974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2870814974},{"type":"v1","addr":"172.21.15.87:6834","nonce":2870814974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/508600504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":508600504},{"type":"v1","addr":"172.21.15.5:6835","nonce":508600504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3215918333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3215918333},{"type":"v1","addr":"172.21.15.5:6837","nonce":3215918333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:34.987476+0000","modified":"2024-08-17T02:23:38.593683+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/3443816405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3443816405},{"type":"v1","addr":"172.21.15.87:6835","nonce":3443816405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:23:49.471 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-08-17T02:23:49.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.472+0000 7ff2fa200640 1 -- 172.21.15.5:0/3120309166 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff2d4065150 msgr2=0x7ff2d4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.472+0000 7ff2fa200640 1 --2- 172.21.15.5:0/3120309166 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff2d4065150 0x7ff2d4067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4034000 tx=0x7ff2e4032000 comp rx=0 tx=0).stop 2024-08-17T02:23:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.472+0000 7ff2fa200640 1 -- 172.21.15.5:0/3120309166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f4158b90 msgr2=0x7ff2f4157950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.472+0000 7ff2fa200640 1 --2- 172.21.15.5:0/3120309166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f4158b90 0x7ff2f4157950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec00c7c0 tx=0x7ff2ec0015d0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.472+0000 7ff2fa200640 1 -- 172.21.15.5:0/3120309166 shutdown_connections 2024-08-17T02:23:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.472+0000 7ff2fa200640 1 --2- 172.21.15.5:0/3120309166 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff2d4065150 0x7ff2d4067600 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.472+0000 7ff2fa200640 1 --2- 172.21.15.5:0/3120309166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2f4158b90 0x7ff2f4157950 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.472+0000 7ff2fa200640 1 --2- 172.21.15.5:0/3120309166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f40b2370 0x7ff2f40c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.472+0000 7ff2fa200640 1 --2- 172.21.15.5:0/3120309166 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f40aef60 0x7ff2f40c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.472+0000 7ff2fa200640 1 -- 172.21.15.5:0/3120309166 >> 172.21.15.5:0/3120309166 conn(0x7ff2f406e590 msgr2=0x7ff2f40cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.472+0000 7ff2fa200640 1 -- 172.21.15.5:0/3120309166 shutdown_connections 2024-08-17T02:23:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.472+0000 7ff2fa200640 1 -- 172.21.15.5:0/3120309166 wait complete. 2024-08-17T02:23:49.487 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:49.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.638+0000 7fc917800640 1 Processor -- start 2024-08-17T02:23:49.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.638+0000 7fc917800640 1 -- start start 2024-08-17T02:23:49.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.639+0000 7fc917800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc9100aee60 0x7fc9100caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:49.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.639+0000 7fc917800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9100afd20 con 0x7fc910158b90 2024-08-17T02:23:49.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.639+0000 7fc917800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9100affe0 con 0x7fc9100aea20 2024-08-17T02:23:49.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.639+0000 7fc917800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9100b02c0 con 0x7fc9100aee60 2024-08-17T02:23:49.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.639+0000 7fc914e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc910158b90 0x7fc9100b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49438/0 (socket says 172.21.15.5:49438) 2024-08-17T02:23:49.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.639+0000 7fc914e00640 1 -- 172.21.15.5:0/2608709380 learned_addr learned my addr 172.21.15.5:0/2608709380 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:49.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.640+0000 7fc915800640 1 --2- 172.21.15.5:0/2608709380 >> v2:172.21.15.87:3300/0 conn(0x7fc9100aee60 0x7fc9100caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:49.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.640+0000 7fc90f400640 1 -- 172.21.15.5:0/2608709380 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1076337512 0 0) 0x7fc9100afd20 con 0x7fc910158b90 2024-08-17T02:23:49.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.640+0000 7fc90f400640 1 -- 172.21.15.5:0/2608709380 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8f80034e0 con 0x7fc910158b90 2024-08-17T02:23:49.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.640+0000 7fc915800640 1 -- 172.21.15.5:0/2608709380 >> v1:172.21.15.87:6789/0 conn(0x7fc9100aea20 legacy=0x7fc9100ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.640+0000 7fc915800640 1 -- 172.21.15.5:0/2608709380 >> v1:172.21.15.5:6789/0 conn(0x7fc910158b90 legacy=0x7fc9100b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.640+0000 7fc90f400640 1 -- 172.21.15.5:0/2608709380 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1110041299 0 0) 0x7fc8f80034e0 con 0x7fc910158b90 2024-08-17T02:23:49.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.640+0000 7fc915800640 1 -- 172.21.15.5:0/2608709380 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9100ca3c0 con 0x7fc9100aee60 2024-08-17T02:23:49.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.641+0000 7fc915800640 1 --2- 172.21.15.5:0/2608709380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9100aee60 0x7fc9100caff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc908009e60 tx=0x7fc908009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=418c7b45d5b17c6c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:49.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.641+0000 7fc90f400640 1 -- 172.21.15.5:0/2608709380 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904001490 con 0x7fc9100aee60 2024-08-17T02:23:49.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.641+0000 7fc90f400640 1 -- 172.21.15.5:0/2608709380 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90802d050 con 0x7fc9100aee60 2024-08-17T02:23:49.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.641+0000 7fc90f400640 1 -- 172.21.15.5:0/2608709380 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908031610 con 0x7fc9100aee60 2024-08-17T02:23:49.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.642+0000 7fc917800640 1 -- 172.21.15.5:0/2608709380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9100aee60 msgr2=0x7fc9100caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.642+0000 7fc917800640 1 --2- 172.21.15.5:0/2608709380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9100aee60 0x7fc9100caff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc908009e60 tx=0x7fc908009780 comp rx=0 tx=0).stop 2024-08-17T02:23:49.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.642+0000 7fc917800640 1 -- 172.21.15.5:0/2608709380 shutdown_connections 2024-08-17T02:23:49.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.642+0000 7fc917800640 1 --2- 172.21.15.5:0/2608709380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9100aee60 0x7fc9100caff0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.642+0000 7fc917800640 1 -- 172.21.15.5:0/2608709380 >> 172.21.15.5:0/2608709380 conn(0x7fc91006e590 msgr2=0x7fc91006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:49.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.642+0000 7fc917800640 1 -- 172.21.15.5:0/2608709380 shutdown_connections 2024-08-17T02:23:49.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.642+0000 7fc917800640 1 -- 172.21.15.5:0/2608709380 wait complete. 2024-08-17T02:23:49.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.643+0000 7fc917800640 1 Processor -- start 2024-08-17T02:23:49.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.644+0000 7fc917800640 1 -- start start 2024-08-17T02:23:49.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.644+0000 7fc917800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9100aea20 0x7fc9100c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.644+0000 7fc917800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9100aee60 0x7fc910169670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.644+0000 7fc917800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc910158b90 0x7fc910157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.644+0000 7fc917800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc910169bb0 con 0x7fc910158b90 2024-08-17T02:23:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.644+0000 7fc917800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100ca0d0 con 0x7fc9100aee60 2024-08-17T02:23:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.644+0000 7fc917800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc910159000 con 0x7fc9100aea20 2024-08-17T02:23:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.645+0000 7fc915800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc910158b90 0x7fc910157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.645+0000 7fc915800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc910158b90 0x7fc910157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44432/0 (socket says 172.21.15.5:44432) 2024-08-17T02:23:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.645+0000 7fc915800640 1 -- 172.21.15.5:0/853000583 learned_addr learned my addr 172.21.15.5:0/853000583 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.645+0000 7fc914e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9100aea20 0x7fc9100c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.645+0000 7fc90fe00640 1 --2- 172.21.15.5:0/853000583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9100aee60 0x7fc910169670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.645+0000 7fc915800640 1 -- 172.21.15.5:0/853000583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9100aea20 msgr2=0x7fc9100c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.645+0000 7fc915800640 1 --2- 172.21.15.5:0/853000583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9100aea20 0x7fc9100c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.645+0000 7fc915800640 1 -- 172.21.15.5:0/853000583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9100aee60 msgr2=0x7fc910169670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.645+0000 7fc915800640 1 --2- 172.21.15.5:0/853000583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9100aee60 0x7fc910169670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.645+0000 7fc915800640 1 -- 172.21.15.5:0/853000583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc908009a20 con 0x7fc910158b90 2024-08-17T02:23:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.645+0000 7fc915800640 1 --2- 172.21.15.5:0/853000583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc910158b90 0x7fc910157a90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc908009e60 tx=0x7fc908037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:49.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.646+0000 7fc903e00640 1 -- 172.21.15.5:0/853000583 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90803ba70 con 0x7fc910158b90 2024-08-17T02:23:49.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.646+0000 7fc903e00640 1 -- 172.21.15.5:0/853000583 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc908040070 con 0x7fc910158b90 2024-08-17T02:23:49.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.646+0000 7fc903e00640 1 -- 172.21.15.5:0/853000583 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90803be40 con 0x7fc910158b90 2024-08-17T02:23:49.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.646+0000 7fc917800640 1 -- 172.21.15.5:0/853000583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9101592e0 con 0x7fc910158b90 2024-08-17T02:23:49.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.646+0000 7fc917800640 1 -- 172.21.15.5:0/853000583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9101598a0 con 0x7fc910158b90 2024-08-17T02:23:49.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.647+0000 7fc917800640 1 -- 172.21.15.5:0/853000583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc910063fb0 con 0x7fc910158b90 2024-08-17T02:23:49.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.648+0000 7fc903e00640 1 -- 172.21.15.5:0/853000583 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc908003030 con 0x7fc910158b90 2024-08-17T02:23:49.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.648+0000 7fc903e00640 1 --2- 172.21.15.5:0/853000583 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc8f0065150 0x7fc8f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:49.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.648+0000 7fc903e00640 1 -- 172.21.15.5:0/853000583 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc908042070 con 0x7fc910158b90 2024-08-17T02:23:49.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.649+0000 7fc914e00640 1 --2- 172.21.15.5:0/853000583 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc8f0065150 0x7fc8f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:49.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.649+0000 7fc914e00640 1 --2- 172.21.15.5:0/853000583 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc8f0065150 0x7fc8f0067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc904000fd0 tx=0x7fc904000bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:49.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.653+0000 7fc903e00640 1 -- 172.21.15.5:0/853000583 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc908071560 con 0x7fc910158b90 2024-08-17T02:23:49.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.839+0000 7fc917800640 1 -- 172.21.15.5:0/853000583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9100b4390 con 0x7fc910158b90 2024-08-17T02:23:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.840+0000 7fc903e00640 1 -- 172.21.15.5:0/853000583 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fc908074b80 con 0x7fc910158b90 2024-08-17T02:23:49.841 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:49.841 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:36.575545+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:32.642845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:33.982937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:49.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.842+0000 7fc917800640 1 -- 172.21.15.5:0/853000583 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc8f0065150 msgr2=0x7fc8f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.842+0000 7fc917800640 1 --2- 172.21.15.5:0/853000583 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc8f0065150 0x7fc8f0067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc904000fd0 tx=0x7fc904000bc0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.842+0000 7fc917800640 1 -- 172.21.15.5:0/853000583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc910158b90 msgr2=0x7fc910157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:49.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.842+0000 7fc917800640 1 --2- 172.21.15.5:0/853000583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc910158b90 0x7fc910157a90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc908009e60 tx=0x7fc908037000 comp rx=0 tx=0).stop 2024-08-17T02:23:49.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.842+0000 7fc917800640 1 -- 172.21.15.5:0/853000583 shutdown_connections 2024-08-17T02:23:49.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.842+0000 7fc917800640 1 --2- 172.21.15.5:0/853000583 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc8f0065150 0x7fc8f0067600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.842+0000 7fc917800640 1 --2- 172.21.15.5:0/853000583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc910158b90 0x7fc910157a90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.842+0000 7fc917800640 1 --2- 172.21.15.5:0/853000583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9100aee60 0x7fc910169670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.842+0000 7fc917800640 1 --2- 172.21.15.5:0/853000583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9100aea20 0x7fc9100c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:49.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.842+0000 7fc917800640 1 -- 172.21.15.5:0/853000583 >> 172.21.15.5:0/853000583 conn(0x7fc91006e590 msgr2=0x7fc9100b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:49.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.842+0000 7fc917800640 1 -- 172.21.15.5:0/853000583 shutdown_connections 2024-08-17T02:23:49.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:49.842+0000 7fc917800640 1 -- 172.21.15.5:0/853000583 wait complete. 2024-08-17T02:23:49.858 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:23:50.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.008+0000 7fc41de00640 1 Processor -- start 2024-08-17T02:23:50.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.009+0000 7fc41de00640 1 -- start start 2024-08-17T02:23:50.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.010+0000 7fc41de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc41815b1f0 0x7fc4180b1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.010+0000 7fc41de00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4180b0de0 con 0x7fc4180afe50 2024-08-17T02:23:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.010+0000 7fc41de00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4180b22c0 con 0x7fc4180ca3d0 2024-08-17T02:23:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.010+0000 7fc41de00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc41815b640 con 0x7fc41815b1f0 2024-08-17T02:23:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.010+0000 7fc41ca00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc4180afe50 0x7fc4180b1ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36526/0 (socket says 172.21.15.5:36526) 2024-08-17T02:23:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.010+0000 7fc41ca00640 1 -- 172.21.15.5:0/3801794175 learned_addr learned my addr 172.21.15.5:0/3801794175 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.010+0000 7fc417e00640 1 --2- 172.21.15.5:0/3801794175 >> v2:172.21.15.5:3300/0 conn(0x7fc41815b1f0 0x7fc4180b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.011+0000 7fc417e00640 1 -- 172.21.15.5:0/3801794175 >> v1:172.21.15.87:6789/0 conn(0x7fc4180ca3d0 legacy=0x7fc418157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.011+0000 7fc417400640 1 -- 172.21.15.5:0/3801794175 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639729102 0 0) 0x7fc4180b0de0 con 0x7fc4180afe50 2024-08-17T02:23:50.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.011+0000 7fc417e00640 1 -- 172.21.15.5:0/3801794175 >> v1:172.21.15.5:6789/0 conn(0x7fc4180afe50 legacy=0x7fc4180b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:50.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.011+0000 7fc417e00640 1 -- 172.21.15.5:0/3801794175 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4180b25a0 con 0x7fc41815b1f0 2024-08-17T02:23:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.011+0000 7fc417e00640 1 --2- 172.21.15.5:0/3801794175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc41815b1f0 0x7fc4180b1270 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc404009850 tx=0x7fc4040090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7daabdbab2735234 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.012+0000 7fc417400640 1 -- 172.21.15.5:0/3801794175 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40402ad00 con 0x7fc41815b1f0 2024-08-17T02:23:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.012+0000 7fc417400640 1 -- 172.21.15.5:0/3801794175 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40402ae60 con 0x7fc41815b1f0 2024-08-17T02:23:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.012+0000 7fc417400640 1 -- 172.21.15.5:0/3801794175 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404032670 con 0x7fc41815b1f0 2024-08-17T02:23:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.012+0000 7fc41de00640 1 -- 172.21.15.5:0/3801794175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc41815b1f0 msgr2=0x7fc4180b1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.012+0000 7fc41de00640 1 --2- 172.21.15.5:0/3801794175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc41815b1f0 0x7fc4180b1270 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc404009850 tx=0x7fc4040090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.012+0000 7fc41de00640 1 -- 172.21.15.5:0/3801794175 shutdown_connections 2024-08-17T02:23:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.012+0000 7fc41de00640 1 --2- 172.21.15.5:0/3801794175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc41815b1f0 0x7fc4180b1270 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.012+0000 7fc41de00640 1 -- 172.21.15.5:0/3801794175 >> 172.21.15.5:0/3801794175 conn(0x7fc418066e60 msgr2=0x7fc418067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.012+0000 7fc41de00640 1 -- 172.21.15.5:0/3801794175 shutdown_connections 2024-08-17T02:23:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.012+0000 7fc41de00640 1 -- 172.21.15.5:0/3801794175 wait complete. 2024-08-17T02:23:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.014+0000 7fc41de00640 1 Processor -- start 2024-08-17T02:23:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.014+0000 7fc41de00640 1 -- start start 2024-08-17T02:23:50.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.015+0000 7fc41de00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4180afe50 0x7fc418146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.015+0000 7fc41de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4180ca3d0 0x7fc4181573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.015+0000 7fc41de00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc41815b1f0 0x7fc418157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.015+0000 7fc41de00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41816a4e0 con 0x7fc4180ca3d0 2024-08-17T02:23:50.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.015+0000 7fc41de00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41816b060 con 0x7fc4180afe50 2024-08-17T02:23:50.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.015+0000 7fc41de00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41816a730 con 0x7fc41815b1f0 2024-08-17T02:23:50.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.015+0000 7fc417e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4180ca3d0 0x7fc4181573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.015+0000 7fc417e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4180ca3d0 0x7fc4181573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50696/0 (socket says 172.21.15.5:50696) 2024-08-17T02:23:50.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.015+0000 7fc417e00640 1 -- 172.21.15.5:0/495721441 learned_addr learned my addr 172.21.15.5:0/495721441 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:50.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.015+0000 7fc41ca00640 1 --2- 172.21.15.5:0/495721441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4180afe50 0x7fc418146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.015+0000 7fc41d400640 1 --2- 172.21.15.5:0/495721441 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc41815b1f0 0x7fc418157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.015+0000 7fc417e00640 1 -- 172.21.15.5:0/495721441 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc41815b1f0 msgr2=0x7fc418157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:50.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.015+0000 7fc417e00640 1 --2- 172.21.15.5:0/495721441 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc41815b1f0 0x7fc418157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.015+0000 7fc417e00640 1 -- 172.21.15.5:0/495721441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4180afe50 msgr2=0x7fc418146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:50.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.015+0000 7fc417e00640 1 --2- 172.21.15.5:0/495721441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4180afe50 0x7fc418146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.015+0000 7fc417e00640 1 -- 172.21.15.5:0/495721441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc404009390 con 0x7fc4180ca3d0 2024-08-17T02:23:50.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.016+0000 7fc417e00640 1 --2- 172.21.15.5:0/495721441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4180ca3d0 0x7fc4181573f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc404009360 tx=0x7fc404032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:50.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.016+0000 7fc40be00640 1 -- 172.21.15.5:0/495721441 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404032e20 con 0x7fc4180ca3d0 2024-08-17T02:23:50.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.016+0000 7fc40be00640 1 -- 172.21.15.5:0/495721441 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc404031a60 con 0x7fc4180ca3d0 2024-08-17T02:23:50.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.016+0000 7fc40be00640 1 -- 172.21.15.5:0/495721441 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404031e20 con 0x7fc4180ca3d0 2024-08-17T02:23:50.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.016+0000 7fc41de00640 1 -- 172.21.15.5:0/495721441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41816aa10 con 0x7fc4180ca3d0 2024-08-17T02:23:50.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.016+0000 7fc41de00640 1 -- 172.21.15.5:0/495721441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc418146890 con 0x7fc4180ca3d0 2024-08-17T02:23:50.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.017+0000 7fc41de00640 1 -- 172.21.15.5:0/495721441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41816b1d0 con 0x7fc4180ca3d0 2024-08-17T02:23:50.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.018+0000 7fc40be00640 1 -- 172.21.15.5:0/495721441 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc404044030 con 0x7fc4180ca3d0 2024-08-17T02:23:50.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.019+0000 7fc40be00640 1 --2- 172.21.15.5:0/495721441 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc3f8065150 0x7fc3f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.019+0000 7fc40be00640 1 -- 172.21.15.5:0/495721441 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc404042070 con 0x7fc4180ca3d0 2024-08-17T02:23:50.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.019+0000 7fc41ca00640 1 --2- 172.21.15.5:0/495721441 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc3f8065150 0x7fc3f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.020+0000 7fc41ca00640 1 --2- 172.21.15.5:0/495721441 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc3f8065150 0x7fc3f8067600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0011e0 tx=0x7fc40c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:50.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.023+0000 7fc40be00640 1 -- 172.21.15.5:0/495721441 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc404071020 con 0x7fc4180ca3d0 2024-08-17T02:23:50.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.245+0000 7fc41de00640 1 -- 172.21.15.5:0/495721441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc418070720 con 0x7fc4180ca3d0 2024-08-17T02:23:50.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.246+0000 7fc40be00640 1 -- 172.21.15.5:0/495721441 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4582 (secure 0 0 0) 0x7fc404074640 con 0x7fc4180ca3d0 2024-08-17T02:23:50.247 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:23:50.247 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/2870814974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2870814974},{"type":"v1","addr":"172.21.15.87:6834","nonce":2870814974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/508600504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":508600504},{"type":"v1","addr":"172.21.15.5:6835","nonce":508600504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3215918333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3215918333},{"type":"v1","addr":"172.21.15.5:6837","nonce":3215918333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:34.987476+0000","modified":"2024-08-17T02:23:38.593683+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/3443816405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3443816405},{"type":"v1","addr":"172.21.15.87:6835","nonce":3443816405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:23:50.247 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-08-17T02:23:50.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.248+0000 7fc41de00640 1 -- 172.21.15.5:0/495721441 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc3f8065150 msgr2=0x7fc3f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:50.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.248+0000 7fc41de00640 1 --2- 172.21.15.5:0/495721441 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc3f8065150 0x7fc3f8067600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0011e0 tx=0x7fc40c009040 comp rx=0 tx=0).stop 2024-08-17T02:23:50.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.248+0000 7fc41de00640 1 -- 172.21.15.5:0/495721441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4180ca3d0 msgr2=0x7fc4181573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:50.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.248+0000 7fc41de00640 1 --2- 172.21.15.5:0/495721441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4180ca3d0 0x7fc4181573f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc404009360 tx=0x7fc404032000 comp rx=0 tx=0).stop 2024-08-17T02:23:50.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.248+0000 7fc41de00640 1 -- 172.21.15.5:0/495721441 shutdown_connections 2024-08-17T02:23:50.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.248+0000 7fc41de00640 1 --2- 172.21.15.5:0/495721441 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc3f8065150 0x7fc3f8067600 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.248+0000 7fc41de00640 1 --2- 172.21.15.5:0/495721441 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc41815b1f0 0x7fc418157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.248+0000 7fc41de00640 1 --2- 172.21.15.5:0/495721441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4180ca3d0 0x7fc4181573f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.248+0000 7fc41de00640 1 --2- 172.21.15.5:0/495721441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4180afe50 0x7fc418146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.248+0000 7fc41de00640 1 -- 172.21.15.5:0/495721441 >> 172.21.15.5:0/495721441 conn(0x7fc418066e60 msgr2=0x7fc41815a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:50.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.248+0000 7fc41de00640 1 -- 172.21.15.5:0/495721441 shutdown_connections 2024-08-17T02:23:50.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.248+0000 7fc41de00640 1 -- 172.21.15.5:0/495721441 wait complete. 2024-08-17T02:23:50.666 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:23:34.987476+0000', 'modified': '2024-08-17T02:23:38.593683+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.87:6835/3443816405', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6833', 'nonce': 3443816405}, {'type': 'v1', 'addr': '172.21.15.87:6835', 'nonce': 3443816405}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:23:50.666 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:23:50.667 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-08-17T02:23:50.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.820+0000 7f550a000640 1 Processor -- start 2024-08-17T02:23:50.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.820+0000 7f550a000640 1 -- start start 2024-08-17T02:23:50.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.821+0000 7f550a000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55040ad960 0x7f550415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.821+0000 7f550a000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550415b5e0 con 0x7f55040add30 2024-08-17T02:23:50.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.821+0000 7f550a000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55040cb160 con 0x7f55040ca050 2024-08-17T02:23:50.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.821+0000 7f550a000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55040b0d10 con 0x7f55040ad960 2024-08-17T02:23:50.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.821+0000 7f5503e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f55040add30 0x7f55040aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36542/0 (socket says 172.21.15.5:36542) 2024-08-17T02:23:50.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.821+0000 7f5503e00640 1 -- 172.21.15.5:0/706810502 learned_addr learned my addr 172.21.15.5:0/706810502 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:23:50.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.822+0000 7f5503400640 1 --2- 172.21.15.5:0/706810502 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55040ad960 0x7f550415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.822+0000 7f5502000640 1 -- 172.21.15.5:0/706810502 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 817640772 0 0) 0x7f54fc001490 con 0x7f55040add30 2024-08-17T02:23:50.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.822+0000 7f5502000640 1 -- 172.21.15.5:0/706810502 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54e80034e0 con 0x7f55040add30 2024-08-17T02:23:50.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.822+0000 7f5502000640 1 -- 172.21.15.5:0/706810502 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407564745 0 0) 0x7f55040cb160 con 0x7f55040ca050 2024-08-17T02:23:50.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.822+0000 7f5502000640 1 -- 172.21.15.5:0/706810502 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54fc001490 con 0x7f55040ca050 2024-08-17T02:23:50.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.822+0000 7f5503400640 1 -- 172.21.15.5:0/706810502 >> v1:172.21.15.87:6789/0 conn(0x7f55040ca050 legacy=0x7f5504156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:50.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.822+0000 7f5503400640 1 -- 172.21.15.5:0/706810502 >> v1:172.21.15.5:6789/0 conn(0x7f55040add30 legacy=0x7f55040aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:50.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.822+0000 7f5503400640 1 -- 172.21.15.5:0/706810502 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55040ca550 con 0x7f55040ad960 2024-08-17T02:23:50.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.823+0000 7f5503400640 1 --2- 172.21.15.5:0/706810502 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55040ad960 0x7f550415b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009880 tx=0x7f54f40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc6533263e731d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:50.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.824+0000 7f5502000640 1 -- 172.21.15.5:0/706810502 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4032440 con 0x7f55040ad960 2024-08-17T02:23:50.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.824+0000 7f5502000640 1 -- 172.21.15.5:0/706810502 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f40325a0 con 0x7f55040ad960 2024-08-17T02:23:50.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.824+0000 7f5502000640 1 -- 172.21.15.5:0/706810502 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4032940 con 0x7f55040ad960 2024-08-17T02:23:50.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.824+0000 7f550a000640 1 -- 172.21.15.5:0/706810502 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55040ad960 msgr2=0x7f550415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:50.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.824+0000 7f550a000640 1 --2- 172.21.15.5:0/706810502 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55040ad960 0x7f550415b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009880 tx=0x7f54f40090f0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.824+0000 7f550a000640 1 -- 172.21.15.5:0/706810502 shutdown_connections 2024-08-17T02:23:50.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.824+0000 7f550a000640 1 --2- 172.21.15.5:0/706810502 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55040ad960 0x7f550415b0a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.824+0000 7f550a000640 1 -- 172.21.15.5:0/706810502 >> 172.21.15.5:0/706810502 conn(0x7f5504066e60 msgr2=0x7f5504067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.825+0000 7f550a000640 1 -- 172.21.15.5:0/706810502 shutdown_connections 2024-08-17T02:23:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.825+0000 7f550a000640 1 -- 172.21.15.5:0/706810502 wait complete. 2024-08-17T02:23:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.826+0000 7f550a000640 1 Processor -- start 2024-08-17T02:23:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.826+0000 7f550a000640 1 -- start start 2024-08-17T02:23:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.827+0000 7f550a000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55040ad960 0x7f5504142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.827+0000 7f550a000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55040add30 0x7f55040a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.827+0000 7f550a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55040ca050 0x7f55040a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.827+0000 7f550a000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55040a5c50 con 0x7f55040ca050 2024-08-17T02:23:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.827+0000 7f550a000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55040a60e0 con 0x7f55040add30 2024-08-17T02:23:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.827+0000 7f550a000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5504159ef0 con 0x7f55040ad960 2024-08-17T02:23:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.827+0000 7f5503e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55040ca050 0x7f55040a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.827+0000 7f5503400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55040ad960 0x7f5504142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.827+0000 7f5502a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55040add30 0x7f55040a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.827+0000 7f5503e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55040ca050 0x7f55040a4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50702/0 (socket says 172.21.15.5:50702) 2024-08-17T02:23:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.827+0000 7f5503400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55040ad960 0x7f5504142510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:33604/0 (socket says 172.21.15.5:33604) 2024-08-17T02:23:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.827+0000 7f5503e00640 1 -- 172.21.15.5:0/2875347158 learned_addr learned my addr 172.21.15.5:0/2875347158 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.828+0000 7f5503e00640 1 -- 172.21.15.5:0/2875347158 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55040ad960 msgr2=0x7f5504142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.828+0000 7f5503e00640 1 --2- 172.21.15.5:0/2875347158 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55040ad960 0x7f5504142510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.828+0000 7f5503e00640 1 -- 172.21.15.5:0/2875347158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55040add30 msgr2=0x7f55040a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.828+0000 7f5503e00640 1 --2- 172.21.15.5:0/2875347158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55040add30 0x7f55040a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.828+0000 7f5503e00640 1 -- 172.21.15.5:0/2875347158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f4009390 con 0x7f55040ca050 2024-08-17T02:23:50.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.828+0000 7f5502a00640 1 --2- 172.21.15.5:0/2875347158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55040add30 0x7f55040a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:50.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.828+0000 7f5503e00640 1 --2- 172.21.15.5:0/2875347158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55040ca050 0x7f55040a4a10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00ce10 tx=0x7f54fc001c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:50.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.828+0000 7f54faa00640 1 -- 172.21.15.5:0/2875347158 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc00a920 con 0x7f55040ca050 2024-08-17T02:23:50.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.828+0000 7f54faa00640 1 -- 172.21.15.5:0/2875347158 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54fc00aaa0 con 0x7f55040ca050 2024-08-17T02:23:50.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.828+0000 7f550a000640 1 -- 172.21.15.5:0/2875347158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55040a5040 con 0x7f55040ca050 2024-08-17T02:23:50.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.828+0000 7f54faa00640 1 -- 172.21.15.5:0/2875347158 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc00ae60 con 0x7f55040ca050 2024-08-17T02:23:50.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.829+0000 7f550a000640 1 -- 172.21.15.5:0/2875347158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55040a5600 con 0x7f55040ca050 2024-08-17T02:23:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.831+0000 7f54faa00640 1 -- 172.21.15.5:0/2875347158 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f54fc007300 con 0x7f55040ca050 2024-08-17T02:23:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.832+0000 7f54faa00640 1 --2- 172.21.15.5:0/2875347158 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f54e4065150 0x7f54e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.832+0000 7f54faa00640 1 -- 172.21.15.5:0/2875347158 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f54fc082550 con 0x7f55040ca050 2024-08-17T02:23:50.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.832+0000 7f5503400640 1 --2- 172.21.15.5:0/2875347158 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f54e4065150 0x7f54e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.833+0000 7f550c664740 1 Processor -- start 2024-08-17T02:23:50.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.833+0000 7f550c664740 1 -- start start 2024-08-17T02:23:50.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.833+0000 7f5503400640 1 --2- 172.21.15.5:0/2875347158 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f54e4065150 0x7f54e4067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f54f4034000 tx=0x7f54f4032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:50.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.834+0000 7f550c664740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d11860a30 0x564d11860e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.834+0000 7f550c664740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d1183c0a0 0x564d1187e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.834+0000 7f550c664740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d1187eb10 0x564d11835900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.834+0000 7f550c664740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d117f6380 con 0x564d1183c0a0 2024-08-17T02:23:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.834+0000 7f550c664740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d1179f9e0 con 0x564d11860a30 2024-08-17T02:23:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.834+0000 7f550c664740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d1179d170 con 0x564d1187eb10 2024-08-17T02:23:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.834+0000 7f5502a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d1183c0a0 0x564d1187e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.834+0000 7f5502a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d1183c0a0 0x564d1187e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50704/0 (socket says 172.21.15.5:50704) 2024-08-17T02:23:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.834+0000 7f5502a00640 1 -- 172.21.15.5:0/3652975506 learned_addr learned my addr 172.21.15.5:0/3652975506 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.834+0000 7f5503400640 1 --2- 172.21.15.5:0/3652975506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d11860a30 0x564d11860e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.834+0000 7f5502a00640 1 -- 172.21.15.5:0/3652975506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d1187eb10 msgr2=0x564d11835900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.834+0000 7f5502a00640 1 --2- 172.21.15.5:0/3652975506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d1187eb10 0x564d11835900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.834+0000 7f5502a00640 1 -- 172.21.15.5:0/3652975506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d11860a30 msgr2=0x564d11860e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.834+0000 7f5502a00640 1 --2- 172.21.15.5:0/3652975506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d11860a30 0x564d11860e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.834+0000 7f5502a00640 1 -- 172.21.15.5:0/3652975506 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d1174c820 con 0x564d1183c0a0 2024-08-17T02:23:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.834+0000 7f5503400640 1 --2- 172.21.15.5:0/3652975506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d11860a30 0x564d11860e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.834+0000 7f5502a00640 1 --2- 172.21.15.5:0/3652975506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d1183c0a0 0x564d1187e5d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f54f0003aa0 tx=0x7f54f0007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5822f029db004b25 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.835+0000 7f54ef400640 1 -- 172.21.15.5:0/3652975506 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f000fb50 con 0x564d1183c0a0 2024-08-17T02:23:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.835+0000 7f54ef400640 1 -- 172.21.15.5:0/3652975506 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f000fcb0 con 0x564d1183c0a0 2024-08-17T02:23:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.835+0000 7f54ef400640 1 -- 172.21.15.5:0/3652975506 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0014470 con 0x564d1183c0a0 2024-08-17T02:23:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.835+0000 7f550c664740 1 -- 172.21.15.5:0/3652975506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d1183c0a0 msgr2=0x564d1187e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.835+0000 7f550c664740 1 --2- 172.21.15.5:0/3652975506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d1183c0a0 0x564d1187e5d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f54f0003aa0 tx=0x7f54f0007cc0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.835+0000 7f550c664740 1 -- 172.21.15.5:0/3652975506 shutdown_connections 2024-08-17T02:23:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.835+0000 7f550c664740 1 --2- 172.21.15.5:0/3652975506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d1187eb10 0x564d11835900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.835+0000 7f550c664740 1 --2- 172.21.15.5:0/3652975506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d1183c0a0 0x564d1187e5d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.835+0000 7f550c664740 1 --2- 172.21.15.5:0/3652975506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d11860a30 0x564d11860e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.835+0000 7f550c664740 1 -- 172.21.15.5:0/3652975506 >> 172.21.15.5:0/3652975506 conn(0x564d117d4030 msgr2=0x564d11882c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.835+0000 7f550c664740 1 -- 172.21.15.5:0/3652975506 shutdown_connections 2024-08-17T02:23:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.835+0000 7f550c664740 1 -- 172.21.15.5:0/3652975506 wait complete. 2024-08-17T02:23:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.836+0000 7f550c664740 1 -- start start 2024-08-17T02:23:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.836+0000 7f550c664740 1 Processor -- start 2024-08-17T02:23:50.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.837+0000 7f550c664740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d1183c0a0 0x564d118669e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.837+0000 7f550c664740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d11860a30 0x564d11893770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.837+0000 7f550c664740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d1187eb10 0x564d1187d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.837+0000 7f550c664740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d11798f60 con 0x564d1187eb10 2024-08-17T02:23:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.837+0000 7f550c664740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d11741690 con 0x564d1183c0a0 2024-08-17T02:23:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.837+0000 7f550c664740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d11741330 con 0x564d11860a30 2024-08-17T02:23:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.837+0000 7f550c664740 10 client.0 _ll_register_callbacks cb 0x564d1173b2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:23:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.837+0000 7f5503e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d1187eb10 0x564d1187d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.838+0000 7f5503e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d1187eb10 0x564d1187d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50720/0 (socket says 172.21.15.5:50720) 2024-08-17T02:23:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.838+0000 7f5503e00640 1 -- 172.21.15.5:0/2441370995 learned_addr learned my addr 172.21.15.5:0/2441370995 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.838+0000 7f5503400640 1 --2- 172.21.15.5:0/2441370995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d1183c0a0 0x564d118669e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.838+0000 7f5502a00640 1 --2- 172.21.15.5:0/2441370995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d11860a30 0x564d11893770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.838+0000 7f5503e00640 1 -- 172.21.15.5:0/2441370995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d11860a30 msgr2=0x564d11893770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.838+0000 7f5503e00640 1 --2- 172.21.15.5:0/2441370995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d11860a30 0x564d11893770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.838+0000 7f5503e00640 1 -- 172.21.15.5:0/2441370995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d1183c0a0 msgr2=0x564d118669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.838+0000 7f5503e00640 1 --2- 172.21.15.5:0/2441370995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d1183c0a0 0x564d118669e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.838+0000 7f5503e00640 1 -- 172.21.15.5:0/2441370995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54fc001490 con 0x564d1187eb10 2024-08-17T02:23:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.838+0000 7f5502a00640 1 --2- 172.21.15.5:0/2441370995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d11860a30 0x564d11893770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.838+0000 7f5503e00640 1 --2- 172.21.15.5:0/2441370995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d1187eb10 0x564d1187d8a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f54fc050860 tx=0x7f54fc080930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb57b8228a97aed4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.838+0000 7f54e3e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-17T02:23:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.838+0000 7f54e3e00640 1 -- 172.21.15.5:0/2441370995 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc053850 con 0x564d1187eb10 2024-08-17T02:23:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.838+0000 7f54e3e00640 1 -- 172.21.15.5:0/2441370995 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f54fc0539b0 con 0x564d1187eb10 2024-08-17T02:23:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.838+0000 7f550c664740 1 -- 172.21.15.5:0/2441370995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d117ccd20 con 0x564d1187eb10 2024-08-17T02:23:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.838+0000 7f54e3e00640 1 -- 172.21.15.5:0/2441370995 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54fc05afd0 con 0x564d1187eb10 2024-08-17T02:23:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.839+0000 7f550c664740 10 client.4692 fetch_fsmap learned FSMap version 7 2024-08-17T02:23:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.839+0000 7f550c664740 1 -- 172.21.15.5:0/2441370995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x564d11762ab0 con 0x564d1187eb10 2024-08-17T02:23:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.839+0000 7f54e3e00640 1 -- 172.21.15.5:0/2441370995 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d117ccd20 con 0x564d1187eb10 2024-08-17T02:23:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.839+0000 7f54e3e00640 1 -- 172.21.15.5:0/2441370995 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f54fc019020 con 0x564d1187eb10 2024-08-17T02:23:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.839+0000 7f550c664740 10 client.4692 fetch_fsmap finished waiting for FSMap version 7 2024-08-17T02:23:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.839+0000 7f550c664740 10 client.4692 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:23:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.839+0000 7f550c664740 20 client.4692 populate_metadata read hostname 'smithi005' 2024-08-17T02:23:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.839+0000 7f550c664740 1 --2- 172.21.15.5:0/2441370995 >> [v2:172.21.15.87:6833/3443816405,v1:172.21.15.87:6835/3443816405] conn(0x564d11894ee0 0x564d118952b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.839+0000 7f550c664740 4 client.4692 mds_command: new command op to 4273 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:23:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.839+0000 7f550c664740 1 -- 172.21.15.5:0/2441370995 --> [v2:172.21.15.87:6833/3443816405,v1:172.21.15.87:6835/3443816405] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d114a03c0 con 0x564d11894ee0 2024-08-17T02:23:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.839+0000 7f5503400640 1 --2- 172.21.15.5:0/2441370995 >> [v2:172.21.15.87:6833/3443816405,v1:172.21.15.87:6835/3443816405] conn(0x564d11894ee0 0x564d118952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.840+0000 7f54e3e00640 10 client.4692 ms_handle_connect on v2:172.21.15.87:6833/3443816405 2024-08-17T02:23:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.840+0000 7f5503400640 1 --2- 172.21.15.5:0/2441370995 >> [v2:172.21.15.87:6833/3443816405,v1:172.21.15.87:6835/3443816405] conn(0x564d11894ee0 0x564d118952b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e50a93ac9eadf46 server_cookie=ec19542735660c96 in_seq=0 out_seq=0 2024-08-17T02:23:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.841+0000 7f54e3e00640 1 -- 172.21.15.5:0/2441370995 <== mds.0 v2:172.21.15.87:6833/3443816405 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x564d114a03c0 con 0x564d11894ee0 2024-08-17T02:23:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.841+0000 7f54e3e00640 10 client.4692 handle_command_reply: tid=0 2024-08-17T02:23:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.841+0000 7f550c664740 1 client.4692 shutdown 2024-08-17T02:23:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.841+0000 7f550c664740 1 -- 172.21.15.5:0/2441370995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d1187eb10 msgr2=0x564d1187d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.841+0000 7f550c664740 1 --2- 172.21.15.5:0/2441370995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d1187eb10 0x564d1187d8a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f54fc050860 tx=0x7f54fc080930 comp rx=0 tx=0).stop 2024-08-17T02:23:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.841+0000 7f550c664740 1 -- 172.21.15.5:0/2441370995 shutdown_connections 2024-08-17T02:23:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.841+0000 7f550c664740 1 --2- 172.21.15.5:0/2441370995 >> [v2:172.21.15.87:6833/3443816405,v1:172.21.15.87:6835/3443816405] conn(0x564d11894ee0 0x564d118952b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.841+0000 7f550c664740 1 --2- 172.21.15.5:0/2441370995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d11860a30 0x564d11893770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.841+0000 7f550c664740 1 --2- 172.21.15.5:0/2441370995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d1187eb10 0x564d1187d8a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.841+0000 7f550c664740 1 --2- 172.21.15.5:0/2441370995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d1183c0a0 0x564d118669e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.841+0000 7f54e3e00640 0 client.4692 ms_handle_reset on v2:172.21.15.87:6833/3443816405 2024-08-17T02:23:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.841+0000 7f550c664740 1 -- 172.21.15.5:0/2441370995 >> 172.21.15.5:0/2441370995 conn(0x564d117d4030 msgr2=0x564d118641a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:50.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.841+0000 7f550c664740 1 -- 172.21.15.5:0/2441370995 shutdown_connections 2024-08-17T02:23:50.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.841+0000 7f550c664740 1 -- 172.21.15.5:0/2441370995 wait complete. 2024-08-17T02:23:50.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.841+0000 7f550c664740 20 client.4692 trim_cache size 0 max 16384 2024-08-17T02:23:50.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.857+0000 7f550c664740 1 Processor -- start 2024-08-17T02:23:50.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.857+0000 7f550c664740 1 -- start start 2024-08-17T02:23:50.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.858+0000 7f550c664740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d1183c0a0 0x564d11882720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.858+0000 7f550c664740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d11860a30 0x564d1188ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.858+0000 7f550c664740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d1187eb10 0x564d1187c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.858+0000 7f550c664740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d1187e9d0 con 0x564d11860a30 2024-08-17T02:23:50.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.858+0000 7f550c664740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d11865530 con 0x564d1187eb10 2024-08-17T02:23:50.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.858+0000 7f550c664740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d11513f20 con 0x564d1183c0a0 2024-08-17T02:23:50.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.858+0000 7f5502a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d11860a30 0x564d1188ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.858+0000 7f5502a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d11860a30 0x564d1188ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50732/0 (socket says 172.21.15.5:50732) 2024-08-17T02:23:50.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.858+0000 7f5502a00640 1 -- 172.21.15.5:0/1543032797 learned_addr learned my addr 172.21.15.5:0/1543032797 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:50.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.858+0000 7f5502a00640 1 -- 172.21.15.5:0/1543032797 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d1183c0a0 msgr2=0x564d11882720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:50.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.858+0000 7f5502a00640 1 --2- 172.21.15.5:0/1543032797 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d1183c0a0 0x564d11882720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.858+0000 7f5502a00640 1 -- 172.21.15.5:0/1543032797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d1187eb10 msgr2=0x564d1187c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:50.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.858+0000 7f5502a00640 1 --2- 172.21.15.5:0/1543032797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d1187eb10 0x564d1187c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.858+0000 7f5502a00640 1 -- 172.21.15.5:0/1543032797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d11766490 con 0x564d11860a30 2024-08-17T02:23:50.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.859+0000 7f5502a00640 1 --2- 172.21.15.5:0/1543032797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d11860a30 0x564d1188ccc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f54f0016000 tx=0x7f54f001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb9dd6168072e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:50.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.859+0000 7f54efe00640 1 -- 172.21.15.5:0/1543032797 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0023070 con 0x564d11860a30 2024-08-17T02:23:50.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.859+0000 7f54efe00640 1 -- 172.21.15.5:0/1543032797 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f000fe20 con 0x564d11860a30 2024-08-17T02:23:50.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.859+0000 7f54efe00640 1 -- 172.21.15.5:0/1543032797 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f00079f0 con 0x564d11860a30 2024-08-17T02:23:50.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.859+0000 7f550c664740 1 -- 172.21.15.5:0/1543032797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d11860a30 msgr2=0x564d1188ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:50.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.859+0000 7f550c664740 1 --2- 172.21.15.5:0/1543032797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d11860a30 0x564d1188ccc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f54f0016000 tx=0x7f54f001a000 comp rx=0 tx=0).stop 2024-08-17T02:23:50.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.859+0000 7f550c664740 1 -- 172.21.15.5:0/1543032797 shutdown_connections 2024-08-17T02:23:50.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.859+0000 7f550c664740 1 --2- 172.21.15.5:0/1543032797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d1187eb10 0x564d1187c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.859+0000 7f550c664740 1 --2- 172.21.15.5:0/1543032797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d11860a30 0x564d1188ccc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.859+0000 7f550c664740 1 --2- 172.21.15.5:0/1543032797 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d1183c0a0 0x564d11882720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.859+0000 7f550c664740 1 -- 172.21.15.5:0/1543032797 >> 172.21.15.5:0/1543032797 conn(0x564d117d4030 msgr2=0x564d11830580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:50.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.860+0000 7f550c664740 1 -- 172.21.15.5:0/1543032797 shutdown_connections 2024-08-17T02:23:50.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.860+0000 7f550c664740 1 -- 172.21.15.5:0/1543032797 wait complete. 2024-08-17T02:23:50.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.860+0000 7f550c664740 1 -- start start 2024-08-17T02:23:50.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.860+0000 7f550c664740 1 Processor -- start 2024-08-17T02:23:50.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.861+0000 7f550c664740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d1183c0a0 0x564d118e4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.861+0000 7f550c664740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d11860a30 0x564d118e45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.861+0000 7f550c664740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d1187eb10 0x564d1187d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.861+0000 7f550c664740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d118eb340 con 0x564d11860a30 2024-08-17T02:23:50.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.861+0000 7f550c664740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d118ea730 con 0x564d1183c0a0 2024-08-17T02:23:50.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.861+0000 7f550c664740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d118eaa10 con 0x564d1187eb10 2024-08-17T02:23:50.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.861+0000 7f550c664740 10 client.0 _ll_register_callbacks cb 0x7f54fc054130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:23:50.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.861+0000 7f5502a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d11860a30 0x564d118e45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.862+0000 7f5502a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d11860a30 0x564d118e45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50738/0 (socket says 172.21.15.5:50738) 2024-08-17T02:23:50.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.862+0000 7f5503400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d1183c0a0 0x564d118e4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.862+0000 7f5502a00640 1 -- 172.21.15.5:0/3007783789 learned_addr learned my addr 172.21.15.5:0/3007783789 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:50.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.862+0000 7f5503e00640 1 --2- 172.21.15.5:0/3007783789 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d1187eb10 0x564d1187d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.862+0000 7f5502a00640 1 -- 172.21.15.5:0/3007783789 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d1187eb10 msgr2=0x564d1187d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:50.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.862+0000 7f5502a00640 1 --2- 172.21.15.5:0/3007783789 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d1187eb10 0x564d1187d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.862+0000 7f5502a00640 1 -- 172.21.15.5:0/3007783789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d1183c0a0 msgr2=0x564d118e4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:50.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.862+0000 7f5502a00640 1 --2- 172.21.15.5:0/3007783789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d1183c0a0 0x564d118e4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.862+0000 7f5502a00640 1 -- 172.21.15.5:0/3007783789 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d1174c820 con 0x564d11860a30 2024-08-17T02:23:50.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.862+0000 7f5503400640 1 --2- 172.21.15.5:0/3007783789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d1183c0a0 0x564d118e4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:50.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.862+0000 7f5502a00640 1 --2- 172.21.15.5:0/3007783789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d11860a30 0x564d118e45a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x564d11860ee0 tx=0x7f54f0020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1110f3249b524935 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:50.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.862+0000 7f54e3e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-17T02:23:50.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.862+0000 7f54e3e00640 1 -- 172.21.15.5:0/3007783789 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0023040 con 0x564d11860a30 2024-08-17T02:23:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.862+0000 7f54e3e00640 1 -- 172.21.15.5:0/3007783789 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f54f0007030 con 0x564d11860a30 2024-08-17T02:23:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.862+0000 7f550c664740 1 -- 172.21.15.5:0/3007783789 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f54f000fcb0 con 0x564d11860a30 2024-08-17T02:23:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.863+0000 7f54e3e00640 1 -- 172.21.15.5:0/3007783789 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54f0007400 con 0x564d11860a30 2024-08-17T02:23:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.863+0000 7f550c664740 10 client.4698 fetch_fsmap learned FSMap version 7 2024-08-17T02:23:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.863+0000 7f550c664740 1 -- 172.21.15.5:0/3007783789 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x564d117661e0 con 0x564d11860a30 2024-08-17T02:23:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.863+0000 7f54e3e00640 1 -- 172.21.15.5:0/3007783789 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f000fcb0 con 0x564d11860a30 2024-08-17T02:23:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.863+0000 7f54e3e00640 1 -- 172.21.15.5:0/3007783789 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f54f0012070 con 0x564d11860a30 2024-08-17T02:23:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.863+0000 7f550c664740 10 client.4698 fetch_fsmap finished waiting for FSMap version 7 2024-08-17T02:23:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.863+0000 7f550c664740 10 client.4698 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:23:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.863+0000 7f550c664740 20 client.4698 populate_metadata read hostname 'smithi005' 2024-08-17T02:23:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.863+0000 7f550c664740 1 --2- 172.21.15.5:0/3007783789 >> [v2:172.21.15.87:6833/3443816405,v1:172.21.15.87:6835/3443816405] conn(0x564d118645b0 0x564d11864980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.863+0000 7f550c664740 4 client.4698 mds_command: new command op to 4273 tid=0[{"prefix": "status"}] 2024-08-17T02:23:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.863+0000 7f550c664740 1 -- 172.21.15.5:0/3007783789 --> [v2:172.21.15.87:6833/3443816405,v1:172.21.15.87:6835/3443816405] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564d114b16c0 con 0x564d118645b0 2024-08-17T02:23:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.863+0000 7f5503400640 1 --2- 172.21.15.5:0/3007783789 >> [v2:172.21.15.87:6833/3443816405,v1:172.21.15.87:6835/3443816405] conn(0x564d118645b0 0x564d11864980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.864+0000 7f5503400640 1 --2- 172.21.15.5:0/3007783789 >> [v2:172.21.15.87:6833/3443816405,v1:172.21.15.87:6835/3443816405] conn(0x564d118645b0 0x564d11864980 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=342e4a2e4557f5c4 server_cookie=343b89e290c57bd9 in_seq=0 out_seq=0 2024-08-17T02:23:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.864+0000 7f54e3e00640 10 client.4698 ms_handle_connect on v2:172.21.15.87:6833/3443816405 2024-08-17T02:23:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.864+0000 7f54e3e00640 1 -- 172.21.15.5:0/3007783789 <== mds.0 v2:172.21.15.87:6833/3443816405 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x564d114b16c0 con 0x564d118645b0 2024-08-17T02:23:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.864+0000 7f54e3e00640 10 client.4698 handle_command_reply: tid=0 2024-08-17T02:23:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.864+0000 7f550c664740 1 client.4698 shutdown 2024-08-17T02:23:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.864+0000 7f550c664740 1 -- 172.21.15.5:0/3007783789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d11860a30 msgr2=0x564d118e45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.864+0000 7f550c664740 1 --2- 172.21.15.5:0/3007783789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d11860a30 0x564d118e45a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x564d11860ee0 tx=0x7f54f0020070 comp rx=0 tx=0).stop 2024-08-17T02:23:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.864+0000 7f550c664740 1 -- 172.21.15.5:0/3007783789 shutdown_connections 2024-08-17T02:23:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.864+0000 7f550c664740 1 --2- 172.21.15.5:0/3007783789 >> [v2:172.21.15.87:6833/3443816405,v1:172.21.15.87:6835/3443816405] conn(0x564d118645b0 0x564d11864980 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.864+0000 7f550c664740 1 --2- 172.21.15.5:0/3007783789 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564d1187eb10 0x564d1187d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.864+0000 7f550c664740 1 --2- 172.21.15.5:0/3007783789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d11860a30 0x564d118e45a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.864+0000 7f550c664740 1 --2- 172.21.15.5:0/3007783789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d1183c0a0 0x564d118e4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.864+0000 7f550c664740 1 -- 172.21.15.5:0/3007783789 >> 172.21.15.5:0/3007783789 conn(0x564d117d4030 msgr2=0x564d1187c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.864+0000 7f54e3e00640 0 client.4698 ms_handle_reset on v2:172.21.15.87:6833/3443816405 2024-08-17T02:23:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.865+0000 7f550c664740 1 -- 172.21.15.5:0/3007783789 shutdown_connections 2024-08-17T02:23:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.865+0000 7f550c664740 1 -- 172.21.15.5:0/3007783789 wait complete. 2024-08-17T02:23:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.865+0000 7f550c664740 20 client.4698 trim_cache size 0 max 16384 2024-08-17T02:23:50.871 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:23:50.871 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "9411fcb4-b308-4a27-a404-b7a846d24e75", 2024-08-17T02:23:50.871 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-17T02:23:50.871 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4273, 2024-08-17T02:23:50.871 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-17T02:23:50.871 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-17T02:23:50.871 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-17T02:23:50.871 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 15.285063333, 2024-08-17T02:23:50.871 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 7, 2024-08-17T02:23:50.871 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 22, 2024-08-17T02:23:50.871 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 22, 2024-08-17T02:23:50.871 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 22.835956834000001 2024-08-17T02:23:50.871 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:23:50.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.865+0000 7f550a000640 1 -- 172.21.15.5:0/2875347158 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f54e4065150 msgr2=0x7f54e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:50.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.865+0000 7f550a000640 1 --2- 172.21.15.5:0/2875347158 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f54e4065150 0x7f54e4067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f54f4034000 tx=0x7f54f4032000 comp rx=0 tx=0).stop 2024-08-17T02:23:50.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.865+0000 7f550a000640 1 -- 172.21.15.5:0/2875347158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55040ca050 msgr2=0x7f55040a4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:50.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.865+0000 7f550a000640 1 --2- 172.21.15.5:0/2875347158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55040ca050 0x7f55040a4a10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00ce10 tx=0x7f54fc001c50 comp rx=0 tx=0).stop 2024-08-17T02:23:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.865+0000 7f550a000640 1 -- 172.21.15.5:0/2875347158 shutdown_connections 2024-08-17T02:23:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.865+0000 7f550a000640 1 --2- 172.21.15.5:0/2875347158 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f54e4065150 0x7f54e4067600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.865+0000 7f550a000640 1 --2- 172.21.15.5:0/2875347158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55040ca050 0x7f55040a4a10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.865+0000 7f550a000640 1 --2- 172.21.15.5:0/2875347158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55040add30 0x7f55040a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.865+0000 7f550a000640 1 --2- 172.21.15.5:0/2875347158 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55040ad960 0x7f5504142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.865+0000 7f550a000640 1 -- 172.21.15.5:0/2875347158 >> 172.21.15.5:0/2875347158 conn(0x7f5504066e60 msgr2=0x7f5504153230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.866+0000 7f550a000640 1 -- 172.21.15.5:0/2875347158 shutdown_connections 2024-08-17T02:23:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:50.866+0000 7f550a000640 1 -- 172.21.15.5:0/2875347158 wait complete. 2024-08-17T02:23:50.880 INFO:teuthology.run_tasks:Running task kclient... 2024-08-17T02:23:50.904 INFO:tasks.kclient:Mounting kernel clients... 2024-08-17T02:23:50.904 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:23:50.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:50.904 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-17T02:23:50.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:50.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-08-17T02:23:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2024-08-17T02:23:51.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:23:51.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:51.043 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-17T02:23:51.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:51.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-08-17T02:23:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2024-08-17T02:23:51.179 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:23:51.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:51.180 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-08-17T02:23:51.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:51.220 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-08-17T02:23:51.323 INFO:teuthology.orchestra.run.smithi087.stderr:Cannot find device "ceph-brx" 2024-08-17T02:23:51.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:23:51.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:51.326 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-08-17T02:23:51.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:51.362 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-08-17T02:23:51.459 INFO:teuthology.orchestra.run.smithi087.stderr:Cannot find device "ceph-brx" 2024-08-17T02:23:51.461 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:23:51.462 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-08-17T02:23:51.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:23:51.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.617+0000 7f1a1ac00640 1 Processor -- start 2024-08-17T02:23:51.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.617+0000 7f1a1ac00640 1 -- start start 2024-08-17T02:23:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.619+0000 7f1a1ac00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1a140afca0 0x7f1a140b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.619+0000 7f1a1ac00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a140acf10 0x7f1a14159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.619+0000 7f1a1ac00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1415a4e0 con 0x7f1a141589a0 2024-08-17T02:23:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.619+0000 7f1a1ac00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a140b0980 con 0x7f1a140afca0 2024-08-17T02:23:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.619+0000 7f1a1ac00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a140c92b0 con 0x7f1a140acf10 2024-08-17T02:23:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.619+0000 7f1a13e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1a140afca0 0x7f1a140b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.619+0000 7f1a0be00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a140acf10 0x7f1a14159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.619+0000 7f1a0be00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a140acf10 0x7f1a14159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:33636/0 (socket says 172.21.15.5:33636) 2024-08-17T02:23:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.619+0000 7f1a13e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1a140afca0 0x7f1a140b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:47706/0 (socket says 172.21.15.5:47706) 2024-08-17T02:23:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.619+0000 7f1a0be00640 1 -- 172.21.15.5:0/1458905519 learned_addr learned my addr 172.21.15.5:0/1458905519 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.619+0000 7f1a18c00640 1 --1- 172.21.15.5:0/1458905519 >> v1:172.21.15.87:6789/0 conn(0x7f1a141589a0 0x7f1a1406d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:42272/0 (socket says 172.21.15.5:42272) 2024-08-17T02:23:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.619+0000 7f1a0be00640 1 -- 172.21.15.5:0/1458905519 >> v2:172.21.15.87:3300/0 conn(0x7f1a140afca0 msgr2=0x7f1a140b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.620+0000 7f1a0be00640 1 --2- 172.21.15.5:0/1458905519 >> v2:172.21.15.87:3300/0 conn(0x7f1a140afca0 0x7f1a140b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.620+0000 7f1a0be00640 1 -- 172.21.15.5:0/1458905519 >> v1:172.21.15.87:6789/0 conn(0x7f1a141589a0 legacy=0x7f1a1406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.620+0000 7f1a0be00640 1 -- 172.21.15.5:0/1458905519 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a140ad480 con 0x7f1a140acf10 2024-08-17T02:23:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.619+0000 7f1a13400640 1 -- 172.21.15.5:0/1458905519 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070104410 0 0) 0x7f1a0c001490 con 0x7f1a141589a0 2024-08-17T02:23:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.620+0000 7f1a0be00640 1 --2- 172.21.15.5:0/1458905519 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a140acf10 0x7f1a14159fa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009940 tx=0x7f19fc0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c74aba5cd90e51 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.621+0000 7f1a13400640 1 -- 172.21.15.5:0/1458905519 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc02ae40 con 0x7f1a140acf10 2024-08-17T02:23:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.621+0000 7f1a13400640 1 -- 172.21.15.5:0/1458905519 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc032440 con 0x7f1a140acf10 2024-08-17T02:23:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.621+0000 7f1a13400640 1 -- 172.21.15.5:0/1458905519 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0327e0 con 0x7f1a140acf10 2024-08-17T02:23:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.621+0000 7f1a1ac00640 1 -- 172.21.15.5:0/1458905519 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a140acf10 msgr2=0x7f1a14159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.621+0000 7f1a1ac00640 1 --2- 172.21.15.5:0/1458905519 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a140acf10 0x7f1a14159fa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009940 tx=0x7f19fc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.621+0000 7f1a1ac00640 1 -- 172.21.15.5:0/1458905519 shutdown_connections 2024-08-17T02:23:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.621+0000 7f1a1ac00640 1 --2- 172.21.15.5:0/1458905519 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a140acf10 0x7f1a14159fa0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.621+0000 7f1a1ac00640 1 --2- 172.21.15.5:0/1458905519 >> v2:172.21.15.87:3300/0 conn(0x7f1a140afca0 0x7f1a140b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.621+0000 7f1a1ac00640 1 -- 172.21.15.5:0/1458905519 >> 172.21.15.5:0/1458905519 conn(0x7f1a14066e60 msgr2=0x7f1a14067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.621+0000 7f1a1ac00640 1 -- 172.21.15.5:0/1458905519 shutdown_connections 2024-08-17T02:23:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.621+0000 7f1a1ac00640 1 -- 172.21.15.5:0/1458905519 wait complete. 2024-08-17T02:23:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.623+0000 7f1a1ac00640 1 Processor -- start 2024-08-17T02:23:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.623+0000 7f1a1ac00640 1 -- start start 2024-08-17T02:23:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.624+0000 7f1a1ac00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a140acf10 0x7f1a1414f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.624+0000 7f1a1ac00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a140afca0 0x7f1a14157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.624+0000 7f1a1ac00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a141589a0 0x7f1a14151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.624+0000 7f1a1ac00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14156f60 con 0x7f1a140acf10 2024-08-17T02:23:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.624+0000 7f1a1ac00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a140c4f60 con 0x7f1a140afca0 2024-08-17T02:23:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.624+0000 7f1a1ac00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1414fa80 con 0x7f1a141589a0 2024-08-17T02:23:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.624+0000 7f1a13e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a140acf10 0x7f1a1414f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.624+0000 7f1a13e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a140acf10 0x7f1a1414f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50740/0 (socket says 172.21.15.5:50740) 2024-08-17T02:23:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.624+0000 7f1a13e00640 1 -- 172.21.15.5:0/2735091640 learned_addr learned my addr 172.21.15.5:0/2735091640 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.624+0000 7f1a13e00640 1 -- 172.21.15.5:0/2735091640 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a141589a0 msgr2=0x7f1a14151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.624+0000 7f1a13e00640 1 --2- 172.21.15.5:0/2735091640 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a141589a0 0x7f1a14151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.624+0000 7f1a0be00640 1 --2- 172.21.15.5:0/2735091640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a140afca0 0x7f1a14157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.624+0000 7f1a13e00640 1 -- 172.21.15.5:0/2735091640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a140afca0 msgr2=0x7f1a14157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.624+0000 7f1a13e00640 1 --2- 172.21.15.5:0/2735091640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a140afca0 0x7f1a14157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.624+0000 7f1a13e00640 1 -- 172.21.15.5:0/2735091640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19fc009450 con 0x7f1a140acf10 2024-08-17T02:23:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.624+0000 7f1a0be00640 1 --2- 172.21.15.5:0/2735091640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a140afca0 0x7f1a14157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.625+0000 7f1a13e00640 1 --2- 172.21.15.5:0/2735091640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a140acf10 0x7f1a1414f540 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400ede0 tx=0x7f1a0400b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.625+0000 7f1a0b400640 1 -- 172.21.15.5:0/2735091640 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0400ddc0 con 0x7f1a140acf10 2024-08-17T02:23:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.625+0000 7f1a0b400640 1 -- 172.21.15.5:0/2735091640 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a04010440 con 0x7f1a140acf10 2024-08-17T02:23:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.625+0000 7f1a1ac00640 1 -- 172.21.15.5:0/2735091640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a14157150 con 0x7f1a140acf10 2024-08-17T02:23:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.625+0000 7f1a0b400640 1 -- 172.21.15.5:0/2735091640 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a040107e0 con 0x7f1a140acf10 2024-08-17T02:23:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.625+0000 7f1a1ac00640 1 -- 172.21.15.5:0/2735091640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a14157710 con 0x7f1a140acf10 2024-08-17T02:23:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.626+0000 7f1a1ac00640 1 -- 172.21.15.5:0/2735091640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a14063fb0 con 0x7f1a140acf10 2024-08-17T02:23:51.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.627+0000 7f1a0b400640 1 -- 172.21.15.5:0/2735091640 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1a04010b90 con 0x7f1a140acf10 2024-08-17T02:23:51.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.628+0000 7f1a0b400640 1 --2- 172.21.15.5:0/2735091640 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f19f0065150 0x7f19f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.628+0000 7f1a0b400640 1 -- 172.21.15.5:0/2735091640 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1a04082c80 con 0x7f1a140acf10 2024-08-17T02:23:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.628+0000 7f1a0be00640 1 --2- 172.21.15.5:0/2735091640 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f19f0065150 0x7f19f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.629+0000 7f1a0be00640 1 --2- 172.21.15.5:0/2735091640 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f19f0065150 0x7f19f0067600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f19fc034000 tx=0x7f19fc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.632+0000 7f1a0b400640 1 -- 172.21.15.5:0/2735091640 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1a04050ca0 con 0x7f1a140acf10 2024-08-17T02:23:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.852+0000 7f1a1ac00640 1 -- 172.21.15.5:0/2735091640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1a14067b70 con 0x7f1a140acf10 2024-08-17T02:23:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.852+0000 7f1a0b400640 1 -- 172.21.15.5:0/2735091640 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1a040542c0 con 0x7f1a140acf10 2024-08-17T02:23:51.853 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:23:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.854+0000 7f1a1ac00640 1 -- 172.21.15.5:0/2735091640 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f19f0065150 msgr2=0x7f19f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.854+0000 7f1a1ac00640 1 --2- 172.21.15.5:0/2735091640 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f19f0065150 0x7f19f0067600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f19fc034000 tx=0x7f19fc032000 comp rx=0 tx=0).stop 2024-08-17T02:23:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.854+0000 7f1a1ac00640 1 -- 172.21.15.5:0/2735091640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a140acf10 msgr2=0x7f1a1414f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.854+0000 7f1a1ac00640 1 --2- 172.21.15.5:0/2735091640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a140acf10 0x7f1a1414f540 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400ede0 tx=0x7f1a0400b3b0 comp rx=0 tx=0).stop 2024-08-17T02:23:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.854+0000 7f1a1ac00640 1 -- 172.21.15.5:0/2735091640 shutdown_connections 2024-08-17T02:23:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.854+0000 7f1a1ac00640 1 --2- 172.21.15.5:0/2735091640 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f19f0065150 0x7f19f0067600 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.854+0000 7f1a1ac00640 1 --2- 172.21.15.5:0/2735091640 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a141589a0 0x7f1a14151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.854+0000 7f1a1ac00640 1 --2- 172.21.15.5:0/2735091640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a140afca0 0x7f1a14157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.854+0000 7f1a1ac00640 1 --2- 172.21.15.5:0/2735091640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a140acf10 0x7f1a1414f540 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.854+0000 7f1a1ac00640 1 -- 172.21.15.5:0/2735091640 >> 172.21.15.5:0/2735091640 conn(0x7f1a14066e60 msgr2=0x7f1a140cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.854+0000 7f1a1ac00640 1 -- 172.21.15.5:0/2735091640 shutdown_connections 2024-08-17T02:23:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:51.854+0000 7f1a1ac00640 1 -- 172.21.15.5:0/2735091640 wait complete. 2024-08-17T02:23:51.870 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:23:51.870 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:23:51.870 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-17T02:23:51.870 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:23:51.870 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:23:51.870 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:23:51.870 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:23:51.870 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:23:51.870 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:23:51.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:51.871 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-17T02:23:51.906 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:23:51.906 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:23:51.907 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:23:51.907 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:51.907 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-17T02:23:51.907 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:51.907 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:51.907 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:51.907 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-17T02:23:51.907 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:51.907 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:51.907 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-17T02:23:51.907 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:23:51.907 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:51.908 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-17T02:23:51.908 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:23:51.908 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42663sec preferred_lft 42663sec 2024-08-17T02:23:51.908 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-08-17T02:23:51.908 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:51.908 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:51.908 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:51.908 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-17T02:23:51.908 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:23:51.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:51.909 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:23:51.909 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:23:51.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:23:51.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2024-08-17T02:23:51.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2024-08-17T02:23:51.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:23:51.909 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:23:52.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:52.269 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:23:52.326 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-17T02:23:52.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:52.329 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-17T02:23:52.375 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-17T02:23:52.375 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:23:52.375 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:23:52.375 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:23:52.376 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:23:52.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:52.376 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:23:52.376 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:23:52.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:23:52.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:23:52.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:23:52.376 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:23:52.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:52.967 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-17T02:23:53.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:53.003 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-08-17T02:23:53.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:53.080 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:23:53.081 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:23:53.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:23:53.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:23:53.081 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:23:53.207 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:23:53.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:53.207 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:23:53.207 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:23:53.207 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:23:53.207 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:23:53.207 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:23:53.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:23:53.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:23:53.208 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:23:53.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:53.399 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:23:53.399 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:23:53.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-17T02:23:53.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:23:53.399 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:23:53.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:23:53.515 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:23:53.550 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:23:53.550 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:23:53.550 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:23:53.625 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:23:53.625 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:23:53.625 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:53.766 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:53.766 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:23:54.356 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:54.356 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:23:54.356 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.87:3300,172.21.15.87:3301" 2024-08-17T02:23:54.356 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@9411fcb4-b308-4a27-a404-b7a846d24e75.cephfs=/ 2024-08-17T02:23:54.356 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.87:3300/172.21.15.87:3301" will pass to kernel 2024-08-17T02:23:54.357 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:23:54.357 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:23:54.357 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:23:54.357 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:23:54.357 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:23:54.360 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:23:54.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:54.361 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:23:54.418 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-08-17T02:23:54.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:23:54.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.569+0000 7f52d6000640 1 Processor -- start 2024-08-17T02:23:54.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.569+0000 7f52d6000640 1 -- start start 2024-08-17T02:23:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.570+0000 7f52d6000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52d00afca0 0x7f52d00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.570+0000 7f52d6000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52d00acf10 0x7f52d0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.570+0000 7f52d6000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f52d01589a0 0x7f52d0158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.570+0000 7f52d6000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d00b0980 con 0x7f52d00acf10 2024-08-17T02:23:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.570+0000 7f52d6000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d015a4e0 con 0x7f52d01589a0 2024-08-17T02:23:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.570+0000 7f52d6000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00c92b0 con 0x7f52d00afca0 2024-08-17T02:23:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.571+0000 7f52cea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52d00acf10 0x7f52d0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.571+0000 7f52cea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52d00acf10 0x7f52d0159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50742/0 (socket says 172.21.15.5:50742) 2024-08-17T02:23:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.571+0000 7f52cea00640 1 -- 172.21.15.5:0/2757798827 learned_addr learned my addr 172.21.15.5:0/2757798827 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.571+0000 7f52cfe00640 1 --2- 172.21.15.5:0/2757798827 >> v2:172.21.15.87:3300/0 conn(0x7f52d01589a0 0x7f52d0158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.571+0000 7f52cf400640 1 --2- 172.21.15.5:0/2757798827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52d00afca0 0x7f52d00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.571+0000 7f52cea00640 1 -- 172.21.15.5:0/2757798827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52d00afca0 msgr2=0x7f52d00b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.571+0000 7f52cea00640 1 --2- 172.21.15.5:0/2757798827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52d00afca0 0x7f52d00b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.571+0000 7f52cea00640 1 -- 172.21.15.5:0/2757798827 >> v2:172.21.15.87:3300/0 conn(0x7f52d01589a0 msgr2=0x7f52d0158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.571+0000 7f52cea00640 1 --2- 172.21.15.5:0/2757798827 >> v2:172.21.15.87:3300/0 conn(0x7f52d01589a0 0x7f52d0158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.571+0000 7f52cea00640 1 -- 172.21.15.5:0/2757798827 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d0159360 con 0x7f52d00acf10 2024-08-17T02:23:54.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.572+0000 7f52cea00640 1 --2- 172.21.15.5:0/2757798827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d00acf10 0x7f52d0159fa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00bbc0 tx=0x7f52bc00b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10447c61bf726cab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:54.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.573+0000 7f52ce000640 1 -- 172.21.15.5:0/2757798827 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc032620 con 0x7f52d00acf10 2024-08-17T02:23:54.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.573+0000 7f52ce000640 1 -- 172.21.15.5:0/2757798827 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc02e040 con 0x7f52d00acf10 2024-08-17T02:23:54.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.573+0000 7f52ce000640 1 -- 172.21.15.5:0/2757798827 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc0329f0 con 0x7f52d00acf10 2024-08-17T02:23:54.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.573+0000 7f52d6000640 1 -- 172.21.15.5:0/2757798827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d00acf10 msgr2=0x7f52d0159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:54.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.573+0000 7f52d6000640 1 --2- 172.21.15.5:0/2757798827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d00acf10 0x7f52d0159fa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00bbc0 tx=0x7f52bc00b460 comp rx=0 tx=0).stop 2024-08-17T02:23:54.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.573+0000 7f52d6000640 1 -- 172.21.15.5:0/2757798827 shutdown_connections 2024-08-17T02:23:54.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.573+0000 7f52d6000640 1 --2- 172.21.15.5:0/2757798827 >> v2:172.21.15.87:3300/0 conn(0x7f52d01589a0 0x7f52d0158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.573+0000 7f52d6000640 1 --2- 172.21.15.5:0/2757798827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d00acf10 0x7f52d0159fa0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.573+0000 7f52d6000640 1 --2- 172.21.15.5:0/2757798827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52d00afca0 0x7f52d00b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.573+0000 7f52d6000640 1 -- 172.21.15.5:0/2757798827 >> 172.21.15.5:0/2757798827 conn(0x7f52d0066e60 msgr2=0x7f52d0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:54.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.573+0000 7f52d6000640 1 -- 172.21.15.5:0/2757798827 shutdown_connections 2024-08-17T02:23:54.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.573+0000 7f52d6000640 1 -- 172.21.15.5:0/2757798827 wait complete. 2024-08-17T02:23:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.575+0000 7f52d6000640 1 Processor -- start 2024-08-17T02:23:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.575+0000 7f52d6000640 1 -- start start 2024-08-17T02:23:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.576+0000 7f52d6000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d00acf10 0x7f52d0142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.576+0000 7f52d6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d00afca0 0x7f52d00cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.576+0000 7f52d6000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52d01589a0 0x7f52d00cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.576+0000 7f52d6000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0146070 con 0x7f52d00afca0 2024-08-17T02:23:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.576+0000 7f52d6000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0146500 con 0x7f52d00acf10 2024-08-17T02:23:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.576+0000 7f52d6000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0145460 con 0x7f52d01589a0 2024-08-17T02:23:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.576+0000 7f52cea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d00afca0 0x7f52d00cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.576+0000 7f52cea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d00afca0 0x7f52d00cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50756/0 (socket says 172.21.15.5:50756) 2024-08-17T02:23:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.576+0000 7f52cea00640 1 -- 172.21.15.5:0/1911990305 learned_addr learned my addr 172.21.15.5:0/1911990305 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.576+0000 7f52cf400640 1 --2- 172.21.15.5:0/1911990305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d00acf10 0x7f52d0142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.576+0000 7f52cfe00640 1 --2- 172.21.15.5:0/1911990305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52d01589a0 0x7f52d00cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.576+0000 7f52cea00640 1 -- 172.21.15.5:0/1911990305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52d01589a0 msgr2=0x7f52d00cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.576+0000 7f52cea00640 1 --2- 172.21.15.5:0/1911990305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52d01589a0 0x7f52d00cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.576+0000 7f52cea00640 1 -- 172.21.15.5:0/1911990305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d00acf10 msgr2=0x7f52d0142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.576+0000 7f52cea00640 1 --2- 172.21.15.5:0/1911990305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d00acf10 0x7f52d0142cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.576+0000 7f52cea00640 1 -- 172.21.15.5:0/1911990305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc00b700 con 0x7f52d00afca0 2024-08-17T02:23:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.577+0000 7f52cea00640 1 --2- 172.21.15.5:0/1911990305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d00afca0 0x7f52d00cba70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00bbc0 tx=0x7f52bc03a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.577+0000 7f52c6a00640 1 -- 172.21.15.5:0/1911990305 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc03ba80 con 0x7f52d00afca0 2024-08-17T02:23:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.577+0000 7f52c6a00640 1 -- 172.21.15.5:0/1911990305 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc03bc20 con 0x7f52d00afca0 2024-08-17T02:23:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.577+0000 7f52c6a00640 1 -- 172.21.15.5:0/1911990305 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc047430 con 0x7f52d00afca0 2024-08-17T02:23:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.577+0000 7f52d6000640 1 -- 172.21.15.5:0/1911990305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d0145740 con 0x7f52d00afca0 2024-08-17T02:23:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.577+0000 7f52d6000640 1 -- 172.21.15.5:0/1911990305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d0145d00 con 0x7f52d00afca0 2024-08-17T02:23:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.578+0000 7f52d6000640 1 -- 172.21.15.5:0/1911990305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d0146220 con 0x7f52d00afca0 2024-08-17T02:23:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.579+0000 7f52c6a00640 1 -- 172.21.15.5:0/1911990305 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f52bc03c430 con 0x7f52d00afca0 2024-08-17T02:23:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.580+0000 7f52c6a00640 1 --2- 172.21.15.5:0/1911990305 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f52b0065150 0x7f52b0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.580+0000 7f52c6a00640 1 -- 172.21.15.5:0/1911990305 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f52bc042030 con 0x7f52d00afca0 2024-08-17T02:23:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.580+0000 7f52cf400640 1 --2- 172.21.15.5:0/1911990305 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f52b0065150 0x7f52b0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.581+0000 7f52cf400640 1 --2- 172.21.15.5:0/1911990305 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f52b0065150 0x7f52b0067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f52c0007ba0 tx=0x7f52c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:54.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.584+0000 7f52c6a00640 1 -- 172.21.15.5:0/1911990305 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f52d0146220 con 0x7f52d00afca0 2024-08-17T02:23:54.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.805+0000 7f52d6000640 1 -- 172.21.15.5:0/1911990305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f52d0063fb0 con 0x7f52d00afca0 2024-08-17T02:23:54.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.805+0000 7f52c6a00640 1 -- 172.21.15.5:0/1911990305 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f52bc071430 con 0x7f52d00afca0 2024-08-17T02:23:54.807 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:23:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.807+0000 7f52d6000640 1 -- 172.21.15.5:0/1911990305 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f52b0065150 msgr2=0x7f52b0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.807+0000 7f52d6000640 1 --2- 172.21.15.5:0/1911990305 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f52b0065150 0x7f52b0067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f52c0007ba0 tx=0x7f52c0008040 comp rx=0 tx=0).stop 2024-08-17T02:23:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.807+0000 7f52d6000640 1 -- 172.21.15.5:0/1911990305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d00afca0 msgr2=0x7f52d00cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.807+0000 7f52d6000640 1 --2- 172.21.15.5:0/1911990305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d00afca0 0x7f52d00cba70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00bbc0 tx=0x7f52bc03a000 comp rx=0 tx=0).stop 2024-08-17T02:23:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.807+0000 7f52d6000640 1 -- 172.21.15.5:0/1911990305 shutdown_connections 2024-08-17T02:23:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.807+0000 7f52d6000640 1 --2- 172.21.15.5:0/1911990305 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f52b0065150 0x7f52b0067600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.807+0000 7f52d6000640 1 --2- 172.21.15.5:0/1911990305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52d01589a0 0x7f52d00cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.807+0000 7f52d6000640 1 --2- 172.21.15.5:0/1911990305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d00afca0 0x7f52d00cba70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.807+0000 7f52d6000640 1 --2- 172.21.15.5:0/1911990305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d00acf10 0x7f52d0142cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:54.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.807+0000 7f52d6000640 1 -- 172.21.15.5:0/1911990305 >> 172.21.15.5:0/1911990305 conn(0x7f52d0066e60 msgr2=0x7f52d00cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:54.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.808+0000 7f52d6000640 1 -- 172.21.15.5:0/1911990305 shutdown_connections 2024-08-17T02:23:54.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:54.808+0000 7f52d6000640 1 -- 172.21.15.5:0/1911990305 wait complete. 2024-08-17T02:23:54.823 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:23:54.823 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:23:54.823 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-17T02:23:54.823 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:23:54.823 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:23:54.824 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:23:54.824 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:23:54.824 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:23:54.824 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:23:54.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:54.824 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-17T02:23:54.860 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:23:54.861 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:23:54.861 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:23:54.861 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:54.861 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-17T02:23:54.861 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:54.861 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:54.861 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:54.861 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-17T02:23:54.861 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:54.861 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:54.861 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-17T02:23:54.861 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:23:54.862 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:54.862 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-17T02:23:54.862 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:23:54.862 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42660sec preferred_lft 42660sec 2024-08-17T02:23:54.862 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-08-17T02:23:54.862 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:54.862 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:54.862 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:54.862 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-17T02:23:54.862 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:23:54.862 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether ae:97:3b:2a:da:cd brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:54.862 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:23:54.863 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:54.863 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c8fe:10ff:feb3:597a/64 scope link 2024-08-17T02:23:54.863 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:54.863 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:23:54.863 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether ae:97:3b:2a:da:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:23:54.863 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ac97:3bff:fe2a:dacd/64 scope link tentative 2024-08-17T02:23:54.863 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:54.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:54.863 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:23:54.954 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-17T02:23:54.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:54.958 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-17T02:23:54.994 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-17T02:23:54.994 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:23:54.995 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:23:54.995 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:23:54.995 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:23:54.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:54.995 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:23:54.995 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:23:54.995 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:23:54.995 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:23:54.995 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:23:54.996 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:23:55.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:55.141 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-17T02:23:55.176 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:23:55.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:55.177 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-08-17T02:23:55.252 INFO:teuthology.orchestra.run.smithi005.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:23:55.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:55.253 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:23:55.253 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:23:55.253 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:23:55.254 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:23:55.254 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:23:55.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:55.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:23:55.434 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:23:55.434 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:23:55.434 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:23:55.434 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:55.434 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-17T02:23:55.434 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:55.434 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:23:55.434 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 52:24:ff:c0:d4:c0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:23:55.434 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:23:55.434 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:55.434 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5024:ffff:fec0:d4c0/64 scope link 2024-08-17T02:23:55.435 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:55.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:55.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:23:55.492 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:23:55.492 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:23:55.492 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:23:55.492 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:55.492 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-17T02:23:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:55.493 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:23:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 52:24:ff:c0:d4:c0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:23:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:23:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5024:ffff:fec0:d4c0/64 scope link 2024-08-17T02:23:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:55.495 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:23:55.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:55.496 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:23:55.496 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:23:55.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:23:55.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:23:55.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:23:55.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:23:55.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:23:55.496 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:23:55.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:55.663 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:23:55.663 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:23:55.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.1 up 2024-08-17T02:23:55.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:23:55.664 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:23:55.783 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:23:55.783 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:23:55.821 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:23:55.822 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:23:55.822 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:23:55.899 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-08-17T02:23:55.899 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:23:55.899 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:56.023 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:56.024 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:23:56.050 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:56.050 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:23:56.051 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.87:3300,172.21.15.87:3301" 2024-08-17T02:23:56.051 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 2@9411fcb4-b308-4a27-a404-b7a846d24e75.cephfs=/ 2024-08-17T02:23:56.051 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.5:3300/172.21.15.87:3300/172.21.15.87:3301" will pass to kernel 2024-08-17T02:23:56.051 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-08-17T02:23:56.051 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:23:56.051 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:23:56.051 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:23:56.051 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:23:56.054 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:23:56.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:56.055 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:23:56.110 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-08-17T02:23:56.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:23:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.260+0000 7f3ad1000640 1 Processor -- start 2024-08-17T02:23:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.261+0000 7f3ad1000640 1 -- start start 2024-08-17T02:23:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.262+0000 7f3ad1000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3acc0b0e30 0x7f3acc0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.262+0000 7f3ad1000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3acc156f90 0x7f3acc0cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.262+0000 7f3ad1000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3acc15a590 0x7f3acc13fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.262+0000 7f3ad1000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3acc06d7c0 con 0x7f3acc0b0e30 2024-08-17T02:23:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.262+0000 7f3ad1000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3acc0cb5b0 con 0x7f3acc15a590 2024-08-17T02:23:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.262+0000 7f3ad1000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc15ab30 con 0x7f3acc156f90 2024-08-17T02:23:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.262+0000 7f3acb400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3acc0b0e30 0x7f3acc0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.262+0000 7f3acb400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3acc0b0e30 0x7f3acc0b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50762/0 (socket says 172.21.15.5:50762) 2024-08-17T02:23:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.262+0000 7f3acb400640 1 -- 172.21.15.5:0/3521229523 learned_addr learned my addr 172.21.15.5:0/3521229523 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.262+0000 7f3ac3e00640 1 --2- 172.21.15.5:0/3521229523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3acc156f90 0x7f3acc0cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.262+0000 7f3acbe00640 1 --2- 172.21.15.5:0/3521229523 >> v2:172.21.15.87:3300/0 conn(0x7f3acc15a590 0x7f3acc13fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.263+0000 7f3acb400640 1 -- 172.21.15.5:0/3521229523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3acc156f90 msgr2=0x7f3acc0cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.263+0000 7f3acb400640 1 --2- 172.21.15.5:0/3521229523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3acc156f90 0x7f3acc0cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.263+0000 7f3acb400640 1 -- 172.21.15.5:0/3521229523 >> v2:172.21.15.87:3300/0 conn(0x7f3acc15a590 msgr2=0x7f3acc13fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.263+0000 7f3acb400640 1 --2- 172.21.15.5:0/3521229523 >> v2:172.21.15.87:3300/0 conn(0x7f3acc15a590 0x7f3acc13fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.263+0000 7f3acb400640 1 -- 172.21.15.5:0/3521229523 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc15ae10 con 0x7f3acc0b0e30 2024-08-17T02:23:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.264+0000 7f3acb400640 1 --2- 172.21.15.5:0/3521229523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3acc0b0e30 0x7f3acc0b1200 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0c8150 tx=0x7f3abc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a76a75cbdf830d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.264+0000 7f3acaa00640 1 -- 172.21.15.5:0/3521229523 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc02add0 con 0x7f3acc0b0e30 2024-08-17T02:23:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.264+0000 7f3acaa00640 1 -- 172.21.15.5:0/3521229523 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc032440 con 0x7f3acc0b0e30 2024-08-17T02:23:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.264+0000 7f3acaa00640 1 -- 172.21.15.5:0/3521229523 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc032820 con 0x7f3acc0b0e30 2024-08-17T02:23:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.265+0000 7f3ad1000640 1 -- 172.21.15.5:0/3521229523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3acc0b0e30 msgr2=0x7f3acc0b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.265+0000 7f3ad1000640 1 --2- 172.21.15.5:0/3521229523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3acc0b0e30 0x7f3acc0b1200 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0c8150 tx=0x7f3abc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.265+0000 7f3ad1000640 1 -- 172.21.15.5:0/3521229523 shutdown_connections 2024-08-17T02:23:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.265+0000 7f3ad1000640 1 --2- 172.21.15.5:0/3521229523 >> v2:172.21.15.87:3300/0 conn(0x7f3acc15a590 0x7f3acc13fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.265+0000 7f3ad1000640 1 --2- 172.21.15.5:0/3521229523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3acc156f90 0x7f3acc0cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.265+0000 7f3ad1000640 1 --2- 172.21.15.5:0/3521229523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3acc0b0e30 0x7f3acc0b1200 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.265+0000 7f3ad1000640 1 -- 172.21.15.5:0/3521229523 >> 172.21.15.5:0/3521229523 conn(0x7f3acc062af0 msgr2=0x7f3acc062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.265+0000 7f3ad1000640 1 -- 172.21.15.5:0/3521229523 shutdown_connections 2024-08-17T02:23:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.265+0000 7f3ad1000640 1 -- 172.21.15.5:0/3521229523 wait complete. 2024-08-17T02:23:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.266+0000 7f3ad1000640 1 Processor -- start 2024-08-17T02:23:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.266+0000 7f3ad1000640 1 -- start start 2024-08-17T02:23:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.267+0000 7f3ad1000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3acc0b0e30 0x7f3acc136150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.267+0000 7f3ad1000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3acc156f90 0x7f3acc139820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.267+0000 7f3ad1000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3acc15a590 0x7f3acc139d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.267+0000 7f3ad1000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc13af80 con 0x7f3acc15a590 2024-08-17T02:23:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.267+0000 7f3ad1000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc13a370 con 0x7f3acc0b0e30 2024-08-17T02:23:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.267+0000 7f3ad1000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc13a650 con 0x7f3acc156f90 2024-08-17T02:23:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.268+0000 7f3acbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3acc15a590 0x7f3acc139d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.268+0000 7f3acbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3acc15a590 0x7f3acc139d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50774/0 (socket says 172.21.15.5:50774) 2024-08-17T02:23:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.268+0000 7f3acbe00640 1 -- 172.21.15.5:0/1440110380 learned_addr learned my addr 172.21.15.5:0/1440110380 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.268+0000 7f3acb400640 1 --2- 172.21.15.5:0/1440110380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3acc0b0e30 0x7f3acc136150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.268+0000 7f3ac3e00640 1 --2- 172.21.15.5:0/1440110380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3acc156f90 0x7f3acc139820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.268+0000 7f3acbe00640 1 -- 172.21.15.5:0/1440110380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3acc156f90 msgr2=0x7f3acc139820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.268+0000 7f3acbe00640 1 --2- 172.21.15.5:0/1440110380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3acc156f90 0x7f3acc139820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.268+0000 7f3acbe00640 1 -- 172.21.15.5:0/1440110380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3acc0b0e30 msgr2=0x7f3acc136150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.268+0000 7f3acbe00640 1 --2- 172.21.15.5:0/1440110380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3acc0b0e30 0x7f3acc136150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.268+0000 7f3acbe00640 1 -- 172.21.15.5:0/1440110380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc009450 con 0x7f3acc15a590 2024-08-17T02:23:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.268+0000 7f3acbe00640 1 --2- 172.21.15.5:0/1440110380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3acc15a590 0x7f3acc139d60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4009df0 tx=0x7f3ac400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.269+0000 7f3ac2a00640 1 -- 172.21.15.5:0/1440110380 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac400cd40 con 0x7f3acc15a590 2024-08-17T02:23:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.269+0000 7f3ac2a00640 1 -- 172.21.15.5:0/1440110380 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac400f040 con 0x7f3acc15a590 2024-08-17T02:23:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.269+0000 7f3ac2a00640 1 -- 172.21.15.5:0/1440110380 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac40146d0 con 0x7f3acc15a590 2024-08-17T02:23:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.269+0000 7f3ad1000640 1 -- 172.21.15.5:0/1440110380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3acc13a930 con 0x7f3acc15a590 2024-08-17T02:23:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.269+0000 7f3ad1000640 1 -- 172.21.15.5:0/1440110380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3acc13b820 con 0x7f3acc15a590 2024-08-17T02:23:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.270+0000 7f3ad1000640 1 -- 172.21.15.5:0/1440110380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3acc13b130 con 0x7f3acc15a590 2024-08-17T02:23:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.271+0000 7f3ac2a00640 1 -- 172.21.15.5:0/1440110380 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3ac4014a80 con 0x7f3acc15a590 2024-08-17T02:23:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.272+0000 7f3ac2a00640 1 --2- 172.21.15.5:0/1440110380 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3aa8065150 0x7f3aa8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.272+0000 7f3ac2a00640 1 -- 172.21.15.5:0/1440110380 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ac40830c0 con 0x7f3acc15a590 2024-08-17T02:23:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.272+0000 7f3acb400640 1 --2- 172.21.15.5:0/1440110380 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3aa8065150 0x7f3aa8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.273+0000 7f3acb400640 1 --2- 172.21.15.5:0/1440110380 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3aa8065150 0x7f3aa8067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3abc034000 tx=0x7f3abc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.276+0000 7f3ac2a00640 1 -- 172.21.15.5:0/1440110380 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3acc13b130 con 0x7f3acc15a590 2024-08-17T02:23:56.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.496+0000 7f3ad1000640 1 -- 172.21.15.5:0/1440110380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3acc070720 con 0x7f3acc15a590 2024-08-17T02:23:56.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.496+0000 7f3ac2a00640 1 -- 172.21.15.5:0/1440110380 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3ac4051230 con 0x7f3acc15a590 2024-08-17T02:23:56.497 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:23:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.498+0000 7f3ad1000640 1 -- 172.21.15.5:0/1440110380 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3aa8065150 msgr2=0x7f3aa8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.498+0000 7f3ad1000640 1 --2- 172.21.15.5:0/1440110380 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3aa8065150 0x7f3aa8067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3abc034000 tx=0x7f3abc032000 comp rx=0 tx=0).stop 2024-08-17T02:23:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.498+0000 7f3ad1000640 1 -- 172.21.15.5:0/1440110380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3acc15a590 msgr2=0x7f3acc139d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.498+0000 7f3ad1000640 1 --2- 172.21.15.5:0/1440110380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3acc15a590 0x7f3acc139d60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4009df0 tx=0x7f3ac400b040 comp rx=0 tx=0).stop 2024-08-17T02:23:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.498+0000 7f3ad1000640 1 -- 172.21.15.5:0/1440110380 shutdown_connections 2024-08-17T02:23:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.498+0000 7f3ad1000640 1 --2- 172.21.15.5:0/1440110380 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3aa8065150 0x7f3aa8067600 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.498+0000 7f3ad1000640 1 --2- 172.21.15.5:0/1440110380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3acc156f90 0x7f3acc139820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.498+0000 7f3ad1000640 1 --2- 172.21.15.5:0/1440110380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3acc15a590 0x7f3acc139d60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.498+0000 7f3ad1000640 1 --2- 172.21.15.5:0/1440110380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3acc0b0e30 0x7f3acc136150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.498+0000 7f3ad1000640 1 -- 172.21.15.5:0/1440110380 >> 172.21.15.5:0/1440110380 conn(0x7f3acc062af0 msgr2=0x7f3acc157360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.499+0000 7f3ad1000640 1 -- 172.21.15.5:0/1440110380 shutdown_connections 2024-08-17T02:23:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:56.499+0000 7f3ad1000640 1 -- 172.21.15.5:0/1440110380 wait complete. 2024-08-17T02:23:56.514 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:23:56.514 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:23:56.514 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-08-17T02:23:56.514 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:23:56.514 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:23:56.515 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:23:56.515 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:23:56.515 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:23:56.515 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:23:56.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:56.515 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-08-17T02:23:56.555 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:23:56.555 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:23:56.555 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:23:56.555 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:56.555 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-08-17T02:23:56.555 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:56.555 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:56.556 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:56.556 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-08-17T02:23:56.556 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:56.556 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:56.556 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-08-17T02:23:56.556 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:56.556 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:56.556 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:23:56.556 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:56.556 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:23:56.556 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42669sec preferred_lft 42669sec 2024-08-17T02:23:56.556 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-08-17T02:23:56.556 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:56.557 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:23:56.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:56.557 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-08-17T02:23:56.557 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-08-17T02:23:56.557 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:23:56.557 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr flush dev ceph-brx 2024-08-17T02:23:56.557 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set ceph-brx up 2024-08-17T02:23:56.557 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:23:56.557 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-08-17T02:23:56.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:56.915 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:23:56.971 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-08-17T02:23:56.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:56.974 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-08-17T02:23:57.022 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-08-17T02:23:57.023 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:23:57.023 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:23:57.023 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:23:57.023 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:23:57.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:57.023 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-08-17T02:23:57.023 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-08-17T02:23:57.024 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:23:57.024 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:23:57.024 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:23:57.024 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-08-17T02:23:57.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:57.550 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-08-17T02:23:57.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:57.585 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2024-08-17T02:23:57.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:57.660 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-08-17T02:23:57.660 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-08-17T02:23:57.660 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:23:57.660 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:23:57.660 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-08-17T02:23:57.787 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:23:57.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:57.787 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-08-17T02:23:57.787 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-08-17T02:23:57.787 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:23:57.787 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:23:57.787 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:23:57.787 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:23:57.788 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:23:57.788 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-08-17T02:23:57.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:57.972 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-08-17T02:23:57.972 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-08-17T02:23:57.972 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-08-17T02:23:57.972 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:23:57.972 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-08-17T02:23:58.086 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:23:58.087 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:23:58.122 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:23:58.123 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:23:58.123 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:23:58.197 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:23:58.197 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:23:58.197 DEBUG:teuthology.orchestra.run.smithi087:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:58.331 INFO:teuthology.orchestra.run.smithi087.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:58.331 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:23:58.987 INFO:teuthology.orchestra.run.smithi087.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:23:58.987 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:23:58.987 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.87:3300,172.21.15.87:3301" 2024-08-17T02:23:58.987 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: trying mount with new device syntax: 1@9411fcb4-b308-4a27-a404-b7a846d24e75.cephfs=/ 2024-08-17T02:23:58.987 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.87:3300/172.21.15.87:3301" will pass to kernel 2024-08-17T02:23:58.989 INFO:teuthology.orchestra.run.smithi087.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:23:58.989 INFO:teuthology.orchestra.run.smithi087.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:23:58.989 INFO:teuthology.orchestra.run.smithi087.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:23:58.989 INFO:teuthology.orchestra.run.smithi087.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:23:58.989 INFO:teuthology.orchestra.run.smithi087.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:23:58.994 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:23:58.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:58.994 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:23:59.051 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-08-17T02:23:59.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:23:59.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.213+0000 7f4d12400640 1 Processor -- start 2024-08-17T02:23:59.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.213+0000 7f4d12400640 1 -- start start 2024-08-17T02:23:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.214+0000 7f4d12400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d0c0ca430 0x7f4d0c0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.214+0000 7f4d12400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d0c1552d0 0x7f4d0c155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.214+0000 7f4d12400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0c0cb180 con 0x7f4d0c0ad790 2024-08-17T02:23:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.214+0000 7f4d12400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0c0af530 con 0x7f4d0c0ca430 2024-08-17T02:23:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.214+0000 7f4d12400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c0ca8e0 con 0x7f4d0c1552d0 2024-08-17T02:23:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.214+0000 7f4d03e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d0c0ca430 0x7f4d0c0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.214+0000 7f4d03e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d0c0ca430 0x7f4d0c0adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50790/0 (socket says 172.21.15.5:50790) 2024-08-17T02:23:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.214+0000 7f4d11a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d0c1552d0 0x7f4d0c155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.214+0000 7f4d03e00640 1 -- 172.21.15.5:0/159202537 learned_addr learned my addr 172.21.15.5:0/159202537 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.214+0000 7f4d11000640 1 --1- 172.21.15.5:0/159202537 >> v1:172.21.15.87:6789/0 conn(0x7f4d0c0ad790 0x7f4d0c0c9d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:42278/0 (socket says 172.21.15.5:42278) 2024-08-17T02:23:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.215+0000 7f4d03e00640 1 -- 172.21.15.5:0/159202537 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d0c1552d0 msgr2=0x7f4d0c155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.215+0000 7f4d03e00640 1 --2- 172.21.15.5:0/159202537 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d0c1552d0 0x7f4d0c155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.215+0000 7f4d03e00640 1 -- 172.21.15.5:0/159202537 >> v1:172.21.15.87:6789/0 conn(0x7f4d0c0ad790 legacy=0x7f4d0c0c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.215+0000 7f4d03e00640 1 -- 172.21.15.5:0/159202537 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c0cabc0 con 0x7f4d0c0ca430 2024-08-17T02:23:59.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.216+0000 7f4d03e00640 1 --2- 172.21.15.5:0/159202537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0c0ca430 0x7f4d0c0adb60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4009910 tx=0x7f4cf40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d354db71838720 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.216+0000 7f4d0be00640 1 -- 172.21.15.5:0/159202537 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf402adb0 con 0x7f4d0c0ca430 2024-08-17T02:23:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.216+0000 7f4d0be00640 1 -- 172.21.15.5:0/159202537 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf4032440 con 0x7f4d0c0ca430 2024-08-17T02:23:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.216+0000 7f4d0be00640 1 -- 172.21.15.5:0/159202537 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4032820 con 0x7f4d0c0ca430 2024-08-17T02:23:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.217+0000 7f4d12400640 1 -- 172.21.15.5:0/159202537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0c0ca430 msgr2=0x7f4d0c0adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.217+0000 7f4d12400640 1 --2- 172.21.15.5:0/159202537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0c0ca430 0x7f4d0c0adb60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4009910 tx=0x7f4cf40091d0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.217+0000 7f4d12400640 1 -- 172.21.15.5:0/159202537 shutdown_connections 2024-08-17T02:23:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.217+0000 7f4d12400640 1 --2- 172.21.15.5:0/159202537 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d0c1552d0 0x7f4d0c155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.217+0000 7f4d12400640 1 --2- 172.21.15.5:0/159202537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0c0ca430 0x7f4d0c0adb60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.217+0000 7f4d12400640 1 -- 172.21.15.5:0/159202537 >> 172.21.15.5:0/159202537 conn(0x7f4d0c062af0 msgr2=0x7f4d0c062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.217+0000 7f4d12400640 1 -- 172.21.15.5:0/159202537 shutdown_connections 2024-08-17T02:23:59.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.217+0000 7f4d12400640 1 -- 172.21.15.5:0/159202537 wait complete. 2024-08-17T02:23:59.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.218+0000 7f4d12400640 1 Processor -- start 2024-08-17T02:23:59.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.218+0000 7f4d12400640 1 -- start start 2024-08-17T02:23:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.219+0000 7f4d12400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d0c0ad790 0x7f4d0c150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.219+0000 7f4d12400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d0c0ca430 0x7f4d0c1527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.219+0000 7f4d12400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0c1552d0 0x7f4d0c16c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.219+0000 7f4d12400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c157470 con 0x7f4d0c1552d0 2024-08-17T02:23:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.219+0000 7f4d12400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c16d700 con 0x7f4d0c0ca430 2024-08-17T02:23:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.219+0000 7f4d12400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c1576f0 con 0x7f4d0c0ad790 2024-08-17T02:23:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.220+0000 7f4d11a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0c1552d0 0x7f4d0c16c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.220+0000 7f4d11a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0c1552d0 0x7f4d0c16c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50796/0 (socket says 172.21.15.5:50796) 2024-08-17T02:23:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.220+0000 7f4d11a00640 1 -- 172.21.15.5:0/1616928616 learned_addr learned my addr 172.21.15.5:0/1616928616 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:23:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.220+0000 7f4d11000640 1 --2- 172.21.15.5:0/1616928616 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d0c0ad790 0x7f4d0c150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.220+0000 7f4d03e00640 1 --2- 172.21.15.5:0/1616928616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d0c0ca430 0x7f4d0c1527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.220+0000 7f4d11a00640 1 -- 172.21.15.5:0/1616928616 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d0c0ad790 msgr2=0x7f4d0c150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.220+0000 7f4d11a00640 1 --2- 172.21.15.5:0/1616928616 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d0c0ad790 0x7f4d0c150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.220+0000 7f4d11a00640 1 -- 172.21.15.5:0/1616928616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d0c0ca430 msgr2=0x7f4d0c1527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.220+0000 7f4d11a00640 1 --2- 172.21.15.5:0/1616928616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d0c0ca430 0x7f4d0c1527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.220+0000 7f4d11a00640 1 -- 172.21.15.5:0/1616928616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf4009450 con 0x7f4d0c1552d0 2024-08-17T02:23:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.220+0000 7f4d11a00640 1 --2- 172.21.15.5:0/1616928616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0c1552d0 0x7f4d0c16c920 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009df0 tx=0x7f4d0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.221+0000 7f4d08c00640 1 -- 172.21.15.5:0/1616928616 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0400cd40 con 0x7f4d0c1552d0 2024-08-17T02:23:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.221+0000 7f4d08c00640 1 -- 172.21.15.5:0/1616928616 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0400f040 con 0x7f4d0c1552d0 2024-08-17T02:23:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.221+0000 7f4d08c00640 1 -- 172.21.15.5:0/1616928616 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d040146d0 con 0x7f4d0c1552d0 2024-08-17T02:23:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.221+0000 7f4d12400640 1 -- 172.21.15.5:0/1616928616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0c1579d0 con 0x7f4d0c1552d0 2024-08-17T02:23:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.221+0000 7f4d12400640 1 -- 172.21.15.5:0/1616928616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0c157f90 con 0x7f4d0c1552d0 2024-08-17T02:23:59.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.222+0000 7f4d12400640 1 -- 172.21.15.5:0/1616928616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0c070720 con 0x7f4d0c1552d0 2024-08-17T02:23:59.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.223+0000 7f4d08c00640 1 -- 172.21.15.5:0/1616928616 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4d04014a80 con 0x7f4d0c1552d0 2024-08-17T02:23:59.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.224+0000 7f4d08c00640 1 --2- 172.21.15.5:0/1616928616 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4ce8065150 0x7f4ce8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:59.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.224+0000 7f4d08c00640 1 -- 172.21.15.5:0/1616928616 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4d04082e40 con 0x7f4d0c1552d0 2024-08-17T02:23:59.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.224+0000 7f4d11000640 1 --2- 172.21.15.5:0/1616928616 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4ce8065150 0x7f4ce8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:59.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.224+0000 7f4d11000640 1 --2- 172.21.15.5:0/1616928616 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4ce8065150 0x7f4ce8067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc007770 tx=0x7f4cfc007e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:59.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.227+0000 7f4d08c00640 1 -- 172.21.15.5:0/1616928616 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4d04050f10 con 0x7f4d0c1552d0 2024-08-17T02:23:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.448+0000 7f4d12400640 1 -- 172.21.15.5:0/1616928616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4d0c155b80 con 0x7f4d0c1552d0 2024-08-17T02:23:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.448+0000 7f4d08c00640 1 -- 172.21.15.5:0/1616928616 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4d04018020 con 0x7f4d0c1552d0 2024-08-17T02:23:59.449 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:23:59.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.450+0000 7f4d12400640 1 -- 172.21.15.5:0/1616928616 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4ce8065150 msgr2=0x7f4ce8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.450+0000 7f4d12400640 1 --2- 172.21.15.5:0/1616928616 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4ce8065150 0x7f4ce8067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc007770 tx=0x7f4cfc007e20 comp rx=0 tx=0).stop 2024-08-17T02:23:59.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.450+0000 7f4d12400640 1 -- 172.21.15.5:0/1616928616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0c1552d0 msgr2=0x7f4d0c16c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:59.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.450+0000 7f4d12400640 1 --2- 172.21.15.5:0/1616928616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0c1552d0 0x7f4d0c16c920 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009df0 tx=0x7f4d0400b040 comp rx=0 tx=0).stop 2024-08-17T02:23:59.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.451+0000 7f4d12400640 1 -- 172.21.15.5:0/1616928616 shutdown_connections 2024-08-17T02:23:59.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.451+0000 7f4d12400640 1 --2- 172.21.15.5:0/1616928616 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4ce8065150 0x7f4ce8067600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.451+0000 7f4d12400640 1 --2- 172.21.15.5:0/1616928616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0c1552d0 0x7f4d0c16c920 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.451+0000 7f4d12400640 1 --2- 172.21.15.5:0/1616928616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d0c0ca430 0x7f4d0c1527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.451+0000 7f4d12400640 1 --2- 172.21.15.5:0/1616928616 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d0c0ad790 0x7f4d0c150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:59.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.451+0000 7f4d12400640 1 -- 172.21.15.5:0/1616928616 >> 172.21.15.5:0/1616928616 conn(0x7f4d0c062af0 msgr2=0x7f4d0c0b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:59.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.451+0000 7f4d12400640 1 -- 172.21.15.5:0/1616928616 shutdown_connections 2024-08-17T02:23:59.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:23:59.451+0000 7f4d12400640 1 -- 172.21.15.5:0/1616928616 wait complete. 2024-08-17T02:23:59.466 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:23:59.466 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:23:59.466 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-08-17T02:23:59.466 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:23:59.466 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:23:59.466 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:23:59.466 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:23:59.466 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:23:59.466 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:23:59.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:59.467 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-08-17T02:23:59.503 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:23:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:23:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:23:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-08-17T02:23:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:59.503 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-08-17T02:23:59.504 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-08-17T02:23:59.504 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:23:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:59.504 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:23:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:23:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42666sec preferred_lft 42666sec 2024-08-17T02:23:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-08-17T02:23:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:59.504 INFO:teuthology.orchestra.run.smithi087.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:23:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 9e:87:d1:dc:df:7e brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:23:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::88e7:cbff:fee8:c6b8/64 scope link 2024-08-17T02:23:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:59.505 INFO:teuthology.orchestra.run.smithi087.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:23:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 9e:87:d1:dc:df:7e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:23:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::9c87:d1ff:fedc:df7e/64 scope link 2024-08-17T02:23:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:59.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:59.506 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:23:59.599 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-08-17T02:23:59.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:59.603 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-08-17T02:23:59.641 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-08-17T02:23:59.641 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:23:59.641 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:23:59.641 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:23:59.641 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:23:59.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:59.642 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-08-17T02:23:59.642 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-08-17T02:23:59.642 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:23:59.642 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:23:59.642 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:23:59.642 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-08-17T02:23:59.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:59.789 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-08-17T02:23:59.824 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:23:59.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:59.825 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2024-08-17T02:23:59.900 INFO:teuthology.orchestra.run.smithi087.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:23:59.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:59.900 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-08-17T02:23:59.900 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-08-17T02:23:59.900 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:23:59.900 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:23:59.901 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-08-17T02:24:00.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:00.025 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:24:00.080 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:24:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:24:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:24:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-08-17T02:24:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:00.081 INFO:teuthology.orchestra.run.smithi087.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:24:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 86:27:a9:4c:e1:4b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:24:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:24:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::8427:a9ff:fe4c:e14b/64 scope link 2024-08-17T02:24:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:00.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:00.083 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:24:00.138 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:24:00.138 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:24:00.139 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:24:00.139 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:00.139 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-08-17T02:24:00.139 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:00.139 INFO:teuthology.orchestra.run.smithi087.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:24:00.139 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 86:27:a9:4c:e1:4b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:24:00.139 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:24:00.139 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:00.139 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::8427:a9ff:fe4c:e14b/64 scope link 2024-08-17T02:24:00.139 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:00.141 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:24:00.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:00.141 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-08-17T02:24:00.141 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-08-17T02:24:00.142 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:24:00.142 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:24:00.142 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:24:00.142 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:24:00.142 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:24:00.142 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-08-17T02:24:00.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:00.306 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-08-17T02:24:00.306 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-08-17T02:24:00.306 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.1 up 2024-08-17T02:24:00.306 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:24:00.306 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-08-17T02:24:00.422 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:24:00.422 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:24:00.457 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:24:00.457 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:24:00.457 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:24:00.531 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-08-17T02:24:00.531 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:24:00.531 DEBUG:teuthology.orchestra.run.smithi087:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:00.652 INFO:teuthology.orchestra.run.smithi087.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:00.652 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:24:00.678 INFO:teuthology.orchestra.run.smithi087.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:00.679 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:24:00.679 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.87:3300,172.21.15.87:3301" 2024-08-17T02:24:00.679 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: trying mount with new device syntax: 3@9411fcb4-b308-4a27-a404-b7a846d24e75.cephfs=/ 2024-08-17T02:24:00.679 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.5:3300/172.21.15.87:3300/172.21.15.87:3301" will pass to kernel 2024-08-17T02:24:00.679 INFO:teuthology.orchestra.run.smithi087.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-08-17T02:24:00.679 INFO:teuthology.orchestra.run.smithi087.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:24:00.680 INFO:teuthology.orchestra.run.smithi087.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:24:00.680 INFO:teuthology.orchestra.run.smithi087.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:24:00.680 INFO:teuthology.orchestra.run.smithi087.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:24:00.683 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:24:00.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:00.683 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:24:00.738 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:24:00.760 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.916+0000 7fa055a00640 1 Processor -- start 2024-08-17T02:24:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.916+0000 7fa055a00640 1 -- start start 2024-08-17T02:24:00.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.917+0000 7fa055a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa0500ad960 0x7fa05015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.917+0000 7fa055a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0500ca050 0x7fa050156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.917+0000 7fa055a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05015b5e0 con 0x7fa0500add30 2024-08-17T02:24:00.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.918+0000 7fa055a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0500cb160 con 0x7fa0500ad960 2024-08-17T02:24:00.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.918+0000 7fa055a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0500b0d10 con 0x7fa0500ca050 2024-08-17T02:24:00.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.918+0000 7fa04f400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa0500add30 0x7fa050156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47416/0 (socket says 172.21.15.5:47416) 2024-08-17T02:24:00.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.918+0000 7fa04f400640 1 -- 172.21.15.5:0/3537085762 learned_addr learned my addr 172.21.15.5:0/3537085762 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:00.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.918+0000 7fa04ea00640 1 --2- 172.21.15.5:0/3537085762 >> v2:172.21.15.87:3300/0 conn(0x7fa0500ad960 0x7fa05015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.918+0000 7fa04e000640 1 --2- 172.21.15.5:0/3537085762 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0500ca050 0x7fa050156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.918+0000 7fa04d600640 1 -- 172.21.15.5:0/3537085762 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727119450 0 0) 0x7fa048001490 con 0x7fa0500add30 2024-08-17T02:24:00.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.918+0000 7fa04d600640 1 -- 172.21.15.5:0/3537085762 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0340034e0 con 0x7fa0500add30 2024-08-17T02:24:00.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.918+0000 7fa04ea00640 1 -- 172.21.15.5:0/3537085762 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0500ca050 msgr2=0x7fa050156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:00.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.918+0000 7fa04ea00640 1 --2- 172.21.15.5:0/3537085762 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0500ca050 0x7fa050156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.918+0000 7fa04ea00640 1 -- 172.21.15.5:0/3537085762 >> v1:172.21.15.5:6789/0 conn(0x7fa0500add30 legacy=0x7fa050156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.918+0000 7fa04ea00640 1 -- 172.21.15.5:0/3537085762 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0500ca550 con 0x7fa0500ad960 2024-08-17T02:24:00.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.920+0000 7fa04ea00640 1 --2- 172.21.15.5:0/3537085762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0500ad960 0x7fa05015b0a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa040009850 tx=0x7fa0400090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=695bfa2e059d8f9d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:00.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.920+0000 7fa04d600640 1 -- 172.21.15.5:0/3537085762 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04002ae10 con 0x7fa0500ad960 2024-08-17T02:24:00.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.920+0000 7fa04d600640 1 -- 172.21.15.5:0/3537085762 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa040032440 con 0x7fa0500ad960 2024-08-17T02:24:00.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.920+0000 7fa04d600640 1 -- 172.21.15.5:0/3537085762 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040032800 con 0x7fa0500ad960 2024-08-17T02:24:00.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.921+0000 7fa055a00640 1 -- 172.21.15.5:0/3537085762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0500ad960 msgr2=0x7fa05015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.921+0000 7fa055a00640 1 --2- 172.21.15.5:0/3537085762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0500ad960 0x7fa05015b0a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa040009850 tx=0x7fa0400090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.921+0000 7fa055a00640 1 -- 172.21.15.5:0/3537085762 shutdown_connections 2024-08-17T02:24:00.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.921+0000 7fa055a00640 1 --2- 172.21.15.5:0/3537085762 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0500ca050 0x7fa050156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.921+0000 7fa055a00640 1 --2- 172.21.15.5:0/3537085762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0500ad960 0x7fa05015b0a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.921+0000 7fa055a00640 1 -- 172.21.15.5:0/3537085762 >> 172.21.15.5:0/3537085762 conn(0x7fa050066e60 msgr2=0x7fa050067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:00.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.921+0000 7fa055a00640 1 -- 172.21.15.5:0/3537085762 shutdown_connections 2024-08-17T02:24:00.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.921+0000 7fa055a00640 1 -- 172.21.15.5:0/3537085762 wait complete. 2024-08-17T02:24:00.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.924+0000 7fa055a00640 1 Processor -- start 2024-08-17T02:24:00.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.924+0000 7fa055a00640 1 -- start start 2024-08-17T02:24:00.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.926+0000 7fa055a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0500ad960 0x7fa05014bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.926+0000 7fa055a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0500add30 0x7fa05014b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.926+0000 7fa055a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0500ca050 0x7fa0500acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.926+0000 7fa055a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0500ab8a0 con 0x7fa0500ad960 2024-08-17T02:24:00.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.926+0000 7fa055a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0500abb80 con 0x7fa0500ca050 2024-08-17T02:24:00.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.926+0000 7fa055a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0500abe60 con 0x7fa0500add30 2024-08-17T02:24:00.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.926+0000 7fa04ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0500ad960 0x7fa05014bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.926+0000 7fa04ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0500ad960 0x7fa05014bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34586/0 (socket says 172.21.15.5:34586) 2024-08-17T02:24:00.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.926+0000 7fa04ea00640 1 -- 172.21.15.5:0/1728838863 learned_addr learned my addr 172.21.15.5:0/1728838863 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:00.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.926+0000 7fa04f400640 1 --2- 172.21.15.5:0/1728838863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0500ca050 0x7fa0500acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.926+0000 7fa04e000640 1 --2- 172.21.15.5:0/1728838863 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0500add30 0x7fa05014b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.926+0000 7fa04ea00640 1 -- 172.21.15.5:0/1728838863 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0500add30 msgr2=0x7fa05014b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.926+0000 7fa04ea00640 1 --2- 172.21.15.5:0/1728838863 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0500add30 0x7fa05014b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.926+0000 7fa04ea00640 1 -- 172.21.15.5:0/1728838863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0500ca050 msgr2=0x7fa0500acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:00.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.926+0000 7fa04ea00640 1 --2- 172.21.15.5:0/1728838863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0500ca050 0x7fa0500acd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:00.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.926+0000 7fa04ea00640 1 -- 172.21.15.5:0/1728838863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa040009390 con 0x7fa0500ad960 2024-08-17T02:24:00.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.927+0000 7fa04ea00640 1 --2- 172.21.15.5:0/1728838863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0500ad960 0x7fa05014bea0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa040009850 tx=0x7fa040032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:00.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.927+0000 7fa046000640 1 -- 172.21.15.5:0/1728838863 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0400316b0 con 0x7fa0500ad960 2024-08-17T02:24:00.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.927+0000 7fa046000640 1 -- 172.21.15.5:0/1728838863 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa040031810 con 0x7fa0500ad960 2024-08-17T02:24:00.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.927+0000 7fa046000640 1 -- 172.21.15.5:0/1728838863 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040031b90 con 0x7fa0500ad960 2024-08-17T02:24:00.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.927+0000 7fa055a00640 1 -- 172.21.15.5:0/1728838863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0500ac140 con 0x7fa0500ad960 2024-08-17T02:24:00.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.927+0000 7fa055a00640 1 -- 172.21.15.5:0/1728838863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05014b8d0 con 0x7fa0500ad960 2024-08-17T02:24:00.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.929+0000 7fa055a00640 1 -- 172.21.15.5:0/1728838863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa050063fb0 con 0x7fa0500ad960 2024-08-17T02:24:00.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.929+0000 7fa046000640 1 -- 172.21.15.5:0/1728838863 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa04003c400 con 0x7fa0500ad960 2024-08-17T02:24:00.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.930+0000 7fa046000640 1 --2- 172.21.15.5:0/1728838863 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa030065150 0x7fa030067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:00.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.930+0000 7fa046000640 1 -- 172.21.15.5:0/1728838863 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa0400a2400 con 0x7fa0500ad960 2024-08-17T02:24:00.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.930+0000 7fa04e000640 1 --2- 172.21.15.5:0/1728838863 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa030065150 0x7fa030067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:00.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.931+0000 7fa04e000640 1 --2- 172.21.15.5:0/1728838863 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa030065150 0x7fa030067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa05016c550 tx=0x7fa03c0090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:00.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:00.935+0000 7fa046000640 1 -- 172.21.15.5:0/1728838863 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa040070590 con 0x7fa0500ad960 2024-08-17T02:24:01.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.125+0000 7fa055a00640 1 -- 172.21.15.5:0/1728838863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa050150650 con 0x7fa0500ad960 2024-08-17T02:24:01.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.126+0000 7fa046000640 1 -- 172.21.15.5:0/1728838863 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fa040073bb0 con 0x7fa0500ad960 2024-08-17T02:24:01.126 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:01.127 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:36.575545+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:32.642845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:33.982937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:01.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.128+0000 7fa055a00640 1 -- 172.21.15.5:0/1728838863 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa030065150 msgr2=0x7fa030067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.128+0000 7fa055a00640 1 --2- 172.21.15.5:0/1728838863 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa030065150 0x7fa030067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa05016c550 tx=0x7fa03c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.128+0000 7fa055a00640 1 -- 172.21.15.5:0/1728838863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0500ad960 msgr2=0x7fa05014bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.128+0000 7fa055a00640 1 --2- 172.21.15.5:0/1728838863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0500ad960 0x7fa05014bea0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa040009850 tx=0x7fa040032000 comp rx=0 tx=0).stop 2024-08-17T02:24:01.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.128+0000 7fa055a00640 1 -- 172.21.15.5:0/1728838863 shutdown_connections 2024-08-17T02:24:01.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.128+0000 7fa055a00640 1 --2- 172.21.15.5:0/1728838863 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa030065150 0x7fa030067600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.128+0000 7fa055a00640 1 --2- 172.21.15.5:0/1728838863 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0500add30 0x7fa05014b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.128+0000 7fa055a00640 1 --2- 172.21.15.5:0/1728838863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0500ca050 0x7fa0500acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.128+0000 7fa055a00640 1 --2- 172.21.15.5:0/1728838863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0500ad960 0x7fa05014bea0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.128+0000 7fa055a00640 1 -- 172.21.15.5:0/1728838863 >> 172.21.15.5:0/1728838863 conn(0x7fa050066e60 msgr2=0x7fa0501544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:01.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.128+0000 7fa055a00640 1 -- 172.21.15.5:0/1728838863 shutdown_connections 2024-08-17T02:24:01.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.128+0000 7fa055a00640 1 -- 172.21.15.5:0/1728838863 wait complete. 2024-08-17T02:24:01.144 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:28.773677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:23:32.642845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:23:33.982937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:24:01.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:01.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.298+0000 7ff2cec00640 1 Processor -- start 2024-08-17T02:24:01.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.298+0000 7ff2cec00640 1 -- start start 2024-08-17T02:24:01.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.299+0000 7ff2cec00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2c8156730 0x7ff2c80ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.299+0000 7ff2cec00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff2c8156b00 0x7ff2c80caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.299+0000 7ff2cec00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff2c80cc6a0 0x7ff2c80ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.299+0000 7ff2cec00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c80ce6a0 con 0x7ff2c80cc6a0 2024-08-17T02:24:01.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.299+0000 7ff2cec00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c80cd080 con 0x7ff2c8156b00 2024-08-17T02:24:01.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.299+0000 7ff2cec00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c80cddb0 con 0x7ff2c8156730 2024-08-17T02:24:01.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.299+0000 7ff2ccc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff2c80cc6a0 0x7ff2c80ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.299+0000 7ff2ccc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff2c80cc6a0 0x7ff2c80ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34594/0 (socket says 172.21.15.5:34594) 2024-08-17T02:24:01.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.299+0000 7ff2ccc00640 1 -- 172.21.15.5:0/2670418756 learned_addr learned my addr 172.21.15.5:0/2670418756 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:01.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.299+0000 7ff2c7e00640 1 --2- 172.21.15.5:0/2670418756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2c8156730 0x7ff2c80ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.299+0000 7ff2c7400640 1 --2- 172.21.15.5:0/2670418756 >> v2:172.21.15.87:3300/0 conn(0x7ff2c8156b00 0x7ff2c80caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.300+0000 7ff2ccc00640 1 -- 172.21.15.5:0/2670418756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2c8156730 msgr2=0x7ff2c80ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:01.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.300+0000 7ff2ccc00640 1 --2- 172.21.15.5:0/2670418756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2c8156730 0x7ff2c80ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.300+0000 7ff2ccc00640 1 -- 172.21.15.5:0/2670418756 >> v2:172.21.15.87:3300/0 conn(0x7ff2c8156b00 msgr2=0x7ff2c80caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:01.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.300+0000 7ff2ccc00640 1 --2- 172.21.15.5:0/2670418756 >> v2:172.21.15.87:3300/0 conn(0x7ff2c8156b00 0x7ff2c80caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.300+0000 7ff2ccc00640 1 -- 172.21.15.5:0/2670418756 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c815a2c0 con 0x7ff2c80cc6a0 2024-08-17T02:24:01.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.300+0000 7ff2c7e00640 1 --2- 172.21.15.5:0/2670418756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2c8156730 0x7ff2c80ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:01.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.301+0000 7ff2ccc00640 1 --2- 172.21.15.5:0/2670418756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2c80cc6a0 0x7ff2c80ccb40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff2c80885d0 tx=0x7ff2c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbad5b6e961decd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:01.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.301+0000 7ff2c6a00640 1 -- 172.21.15.5:0/2670418756 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0031400 con 0x7ff2c80cc6a0 2024-08-17T02:24:01.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.301+0000 7ff2c6a00640 1 -- 172.21.15.5:0/2670418756 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c002d050 con 0x7ff2c80cc6a0 2024-08-17T02:24:01.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.301+0000 7ff2c6a00640 1 -- 172.21.15.5:0/2670418756 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c00317d0 con 0x7ff2c80cc6a0 2024-08-17T02:24:01.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.302+0000 7ff2cec00640 1 -- 172.21.15.5:0/2670418756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2c80cc6a0 msgr2=0x7ff2c80ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.302+0000 7ff2cec00640 1 --2- 172.21.15.5:0/2670418756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2c80cc6a0 0x7ff2c80ccb40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff2c80885d0 tx=0x7ff2c0009840 comp rx=0 tx=0).stop 2024-08-17T02:24:01.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.302+0000 7ff2cec00640 1 -- 172.21.15.5:0/2670418756 shutdown_connections 2024-08-17T02:24:01.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.302+0000 7ff2cec00640 1 --2- 172.21.15.5:0/2670418756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2c80cc6a0 0x7ff2c80ccb40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.302+0000 7ff2cec00640 1 --2- 172.21.15.5:0/2670418756 >> v2:172.21.15.87:3300/0 conn(0x7ff2c8156b00 0x7ff2c80caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.302+0000 7ff2cec00640 1 --2- 172.21.15.5:0/2670418756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2c8156730 0x7ff2c80ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.302+0000 7ff2cec00640 1 -- 172.21.15.5:0/2670418756 >> 172.21.15.5:0/2670418756 conn(0x7ff2c806e590 msgr2=0x7ff2c806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:01.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.302+0000 7ff2cec00640 1 -- 172.21.15.5:0/2670418756 shutdown_connections 2024-08-17T02:24:01.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.302+0000 7ff2cec00640 1 -- 172.21.15.5:0/2670418756 wait complete. 2024-08-17T02:24:01.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.303+0000 7ff2cec00640 1 Processor -- start 2024-08-17T02:24:01.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.303+0000 7ff2cec00640 1 -- start start 2024-08-17T02:24:01.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.304+0000 7ff2cec00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2c80cc6a0 0x7ff2c8153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.304+0000 7ff2cec00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2c8156730 0x7ff2c80c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.304+0000 7ff2cec00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2c8156b00 0x7ff2c80b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.304+0000 7ff2cec00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c80c6e10 con 0x7ff2c8156730 2024-08-17T02:24:01.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.304+0000 7ff2cec00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c8154110 con 0x7ff2c8156b00 2024-08-17T02:24:01.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.304+0000 7ff2cec00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c80c7060 con 0x7ff2c80cc6a0 2024-08-17T02:24:01.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.305+0000 7ff2c7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2c8156730 0x7ff2c80c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.305+0000 7ff2c7e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2c80cc6a0 0x7ff2c8153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.305+0000 7ff2c7e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2c80cc6a0 0x7ff2c8153bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:58956/0 (socket says 172.21.15.5:58956) 2024-08-17T02:24:01.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.305+0000 7ff2c7e00640 1 -- 172.21.15.5:0/2076587909 learned_addr learned my addr 172.21.15.5:0/2076587909 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:01.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.305+0000 7ff2ccc00640 1 --2- 172.21.15.5:0/2076587909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2c8156b00 0x7ff2c80b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.305+0000 7ff2c7e00640 1 -- 172.21.15.5:0/2076587909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2c8156b00 msgr2=0x7ff2c80b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.305+0000 7ff2c7e00640 1 --2- 172.21.15.5:0/2076587909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2c8156b00 0x7ff2c80b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.305+0000 7ff2c7e00640 1 -- 172.21.15.5:0/2076587909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2c8156730 msgr2=0x7ff2c80c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.305+0000 7ff2c7e00640 1 --2- 172.21.15.5:0/2076587909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2c8156730 0x7ff2c80c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.305+0000 7ff2c7e00640 1 -- 172.21.15.5:0/2076587909 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b8009390 con 0x7ff2c80cc6a0 2024-08-17T02:24:01.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.305+0000 7ff2c7400640 1 --2- 172.21.15.5:0/2076587909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2c8156730 0x7ff2c80c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:01.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.305+0000 7ff2c7e00640 1 --2- 172.21.15.5:0/2076587909 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2c80cc6a0 0x7ff2c8153bd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800ec80 tx=0x7ff2b80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:01.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.306+0000 7ff2bf400640 1 -- 172.21.15.5:0/2076587909 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b800eec0 con 0x7ff2c80cc6a0 2024-08-17T02:24:01.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.306+0000 7ff2bf400640 1 -- 172.21.15.5:0/2076587909 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b800cbc0 con 0x7ff2c80cc6a0 2024-08-17T02:24:01.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.306+0000 7ff2bf400640 1 -- 172.21.15.5:0/2076587909 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8013470 con 0x7ff2c80cc6a0 2024-08-17T02:24:01.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.306+0000 7ff2cec00640 1 -- 172.21.15.5:0/2076587909 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c0009ae0 con 0x7ff2c80cc6a0 2024-08-17T02:24:01.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.306+0000 7ff2cec00640 1 -- 172.21.15.5:0/2076587909 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c80c7620 con 0x7ff2c80cc6a0 2024-08-17T02:24:01.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.307+0000 7ff2cec00640 1 -- 172.21.15.5:0/2076587909 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c80b2b00 con 0x7ff2c80cc6a0 2024-08-17T02:24:01.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.308+0000 7ff2bf400640 1 -- 172.21.15.5:0/2076587909 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff2b80137e0 con 0x7ff2c80cc6a0 2024-08-17T02:24:01.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.308+0000 7ff2bf400640 1 --2- 172.21.15.5:0/2076587909 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff2a8065220 0x7ff2a80676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.309+0000 7ff2bf400640 1 -- 172.21.15.5:0/2076587909 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff2b8082740 con 0x7ff2c80cc6a0 2024-08-17T02:24:01.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.309+0000 7ff2c7400640 1 --2- 172.21.15.5:0/2076587909 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff2a8065220 0x7ff2a80676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.309+0000 7ff2c7400640 1 --2- 172.21.15.5:0/2076587909 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff2a8065220 0x7ff2a80676d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8160850 tx=0x7ff2b40090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:01.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.313+0000 7ff2bf400640 1 -- 172.21.15.5:0/2076587909 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff2c80b2b00 con 0x7ff2c80cc6a0 2024-08-17T02:24:01.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.493+0000 7ff2cec00640 1 -- 172.21.15.5:0/2076587909 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2c80b2b00 con 0x7ff2c80cc6a0 2024-08-17T02:24:01.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.494+0000 7ff2bf400640 1 -- 172.21.15.5:0/2076587909 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2c80b2b00 con 0x7ff2c80cc6a0 2024-08-17T02:24:01.494 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:24:01.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.496+0000 7ff2cec00640 1 -- 172.21.15.5:0/2076587909 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff2a8065220 msgr2=0x7ff2a80676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.496+0000 7ff2cec00640 1 --2- 172.21.15.5:0/2076587909 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff2a8065220 0x7ff2a80676d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8160850 tx=0x7ff2b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.496+0000 7ff2cec00640 1 -- 172.21.15.5:0/2076587909 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2c80cc6a0 msgr2=0x7ff2c8153bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.496+0000 7ff2cec00640 1 --2- 172.21.15.5:0/2076587909 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2c80cc6a0 0x7ff2c8153bd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800ec80 tx=0x7ff2b80090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.496+0000 7ff2cec00640 1 -- 172.21.15.5:0/2076587909 shutdown_connections 2024-08-17T02:24:01.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.496+0000 7ff2cec00640 1 --2- 172.21.15.5:0/2076587909 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff2a8065220 0x7ff2a80676d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.496+0000 7ff2cec00640 1 --2- 172.21.15.5:0/2076587909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2c8156b00 0x7ff2c80b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.496+0000 7ff2cec00640 1 --2- 172.21.15.5:0/2076587909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2c8156730 0x7ff2c80c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.496+0000 7ff2cec00640 1 --2- 172.21.15.5:0/2076587909 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2c80cc6a0 0x7ff2c8153bd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.496+0000 7ff2cec00640 1 -- 172.21.15.5:0/2076587909 >> 172.21.15.5:0/2076587909 conn(0x7ff2c806e590 msgr2=0x7ff2c8156f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:01.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.496+0000 7ff2cec00640 1 -- 172.21.15.5:0/2076587909 shutdown_connections 2024-08-17T02:24:01.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.496+0000 7ff2cec00640 1 -- 172.21.15.5:0/2076587909 wait complete. 2024-08-17T02:24:01.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:24:01.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.665+0000 7fe20de00640 1 Processor -- start 2024-08-17T02:24:01.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.665+0000 7fe20de00640 1 -- start start 2024-08-17T02:24:01.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.666+0000 7fe20de00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe208158a00 0x7fe208158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.666+0000 7fe20de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2080cb190 0x7fe2080cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.666+0000 7fe20de00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2080cbc50 con 0x7fe20806e590 2024-08-17T02:24:01.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.666+0000 7fe20de00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2080cbf30 con 0x7fe2080cb190 2024-08-17T02:24:01.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.666+0000 7fe20de00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2080cc210 con 0x7fe208158a00 2024-08-17T02:24:01.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.666+0000 7fe207e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2080cb190 0x7fe2080cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.666+0000 7fe207e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2080cb190 0x7fe2080cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34610/0 (socket says 172.21.15.5:34610) 2024-08-17T02:24:01.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.666+0000 7fe207e00640 1 -- 172.21.15.5:0/1000947999 learned_addr learned my addr 172.21.15.5:0/1000947999 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:01.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.666+0000 7fe20ca00640 1 --2- 172.21.15.5:0/1000947999 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe208158a00 0x7fe208158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.667+0000 7fe207e00640 1 -- 172.21.15.5:0/1000947999 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe208158a00 msgr2=0x7fe208158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:01.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.667+0000 7fe207e00640 1 --2- 172.21.15.5:0/1000947999 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe208158a00 0x7fe208158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.667+0000 7fe207e00640 1 -- 172.21.15.5:0/1000947999 >> v1:172.21.15.87:6789/0 conn(0x7fe20806e590 legacy=0x7fe2080683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:01.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.667+0000 7fe207e00640 1 -- 172.21.15.5:0/1000947999 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2080b2930 con 0x7fe2080cb190 2024-08-17T02:24:01.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.668+0000 7fe207e00640 1 --2- 172.21.15.5:0/1000947999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2080cb190 0x7fe2080cb5c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4009910 tx=0x7fe1f40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f97119d0fb02917 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:01.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.668+0000 7fe207400640 1 -- 172.21.15.5:0/1000947999 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f402ae40 con 0x7fe2080cb190 2024-08-17T02:24:01.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.668+0000 7fe207400640 1 -- 172.21.15.5:0/1000947999 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f4032440 con 0x7fe2080cb190 2024-08-17T02:24:01.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.668+0000 7fe207400640 1 -- 172.21.15.5:0/1000947999 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4032820 con 0x7fe2080cb190 2024-08-17T02:24:01.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.668+0000 7fe20de00640 1 -- 172.21.15.5:0/1000947999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2080cb190 msgr2=0x7fe2080cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.668+0000 7fe20de00640 1 --2- 172.21.15.5:0/1000947999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2080cb190 0x7fe2080cb5c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4009910 tx=0x7fe1f40091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.668+0000 7fe20de00640 1 -- 172.21.15.5:0/1000947999 shutdown_connections 2024-08-17T02:24:01.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.669+0000 7fe20de00640 1 --2- 172.21.15.5:0/1000947999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2080cb190 0x7fe2080cb5c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.669+0000 7fe20de00640 1 --2- 172.21.15.5:0/1000947999 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe208158a00 0x7fe208158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.669+0000 7fe20de00640 1 -- 172.21.15.5:0/1000947999 >> 172.21.15.5:0/1000947999 conn(0x7fe2080cfb80 msgr2=0x7fe2080cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:01.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.669+0000 7fe20de00640 1 -- 172.21.15.5:0/1000947999 shutdown_connections 2024-08-17T02:24:01.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.669+0000 7fe20de00640 1 -- 172.21.15.5:0/1000947999 wait complete. 2024-08-17T02:24:01.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.670+0000 7fe20de00640 1 Processor -- start 2024-08-17T02:24:01.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.670+0000 7fe20de00640 1 -- start start 2024-08-17T02:24:01.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.671+0000 7fe20de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe20806e590 0x7fe208159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.671+0000 7fe20de00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2080cb190 0x7fe208154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.671+0000 7fe20de00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe208158a00 0x7fe20814e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.671+0000 7fe20de00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20815dcc0 con 0x7fe20806e590 2024-08-17T02:24:01.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.671+0000 7fe20de00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20815aea0 con 0x7fe208158a00 2024-08-17T02:24:01.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.671+0000 7fe20de00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20815d700 con 0x7fe2080cb190 2024-08-17T02:24:01.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.671+0000 7fe20ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe20806e590 0x7fe208159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.671+0000 7fe20ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe20806e590 0x7fe208159370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34626/0 (socket says 172.21.15.5:34626) 2024-08-17T02:24:01.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.671+0000 7fe20ca00640 1 -- 172.21.15.5:0/1565119541 learned_addr learned my addr 172.21.15.5:0/1565119541 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:01.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.672+0000 7fe207e00640 1 --2- 172.21.15.5:0/1565119541 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2080cb190 0x7fe208154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.672+0000 7fe20d400640 1 --2- 172.21.15.5:0/1565119541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe208158a00 0x7fe20814e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.672+0000 7fe20ca00640 1 -- 172.21.15.5:0/1565119541 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2080cb190 msgr2=0x7fe208154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.672+0000 7fe20ca00640 1 --2- 172.21.15.5:0/1565119541 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2080cb190 0x7fe208154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.672+0000 7fe20ca00640 1 -- 172.21.15.5:0/1565119541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe208158a00 msgr2=0x7fe20814e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.672+0000 7fe20ca00640 1 --2- 172.21.15.5:0/1565119541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe208158a00 0x7fe20814e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.672+0000 7fe20ca00640 1 -- 172.21.15.5:0/1565119541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f4009450 con 0x7fe20806e590 2024-08-17T02:24:01.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.672+0000 7fe20d400640 1 --2- 172.21.15.5:0/1565119541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe208158a00 0x7fe20814e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:01.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.672+0000 7fe20ca00640 1 --2- 172.21.15.5:0/1565119541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe20806e590 0x7fe208159370 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00d8c0 tx=0x7fe1fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:01.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.672+0000 7fe1fbe00640 1 -- 172.21.15.5:0/1565119541 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc00de50 con 0x7fe20806e590 2024-08-17T02:24:01.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.672+0000 7fe1fbe00640 1 -- 172.21.15.5:0/1565119541 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1fc0098b0 con 0x7fe20806e590 2024-08-17T02:24:01.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.672+0000 7fe1fbe00640 1 -- 172.21.15.5:0/1565119541 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc009c50 con 0x7fe20806e590 2024-08-17T02:24:01.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.672+0000 7fe20de00640 1 -- 172.21.15.5:0/1565119541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20815d9e0 con 0x7fe20806e590 2024-08-17T02:24:01.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.672+0000 7fe20de00640 1 -- 172.21.15.5:0/1565119541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe208154b10 con 0x7fe20806e590 2024-08-17T02:24:01.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.674+0000 7fe20de00640 1 -- 172.21.15.5:0/1565119541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe208070720 con 0x7fe20806e590 2024-08-17T02:24:01.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.674+0000 7fe1fbe00640 1 -- 172.21.15.5:0/1565119541 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe1fc014620 con 0x7fe20806e590 2024-08-17T02:24:01.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.675+0000 7fe1fbe00640 1 --2- 172.21.15.5:0/1565119541 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe1e8065150 0x7fe1e8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:01.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.675+0000 7fe1fbe00640 1 -- 172.21.15.5:0/1565119541 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe1fc082ca0 con 0x7fe20806e590 2024-08-17T02:24:01.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.675+0000 7fe207e00640 1 --2- 172.21.15.5:0/1565119541 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe1e8065150 0x7fe1e8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:01.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.676+0000 7fe207e00640 1 --2- 172.21.15.5:0/1565119541 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe1e8065150 0x7fe1e8067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4034000 tx=0x7fe1f4032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.679+0000 7fe1fbe00640 1 -- 172.21.15.5:0/1565119541 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe1fc050cc0 con 0x7fe20806e590 2024-08-17T02:24:01.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.861+0000 7fe20de00640 1 -- 172.21.15.5:0/1565119541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe2080b2160 con 0x7fe20806e590 2024-08-17T02:24:01.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.862+0000 7fe1fbe00640 1 -- 172.21.15.5:0/1565119541 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe1fc0542e0 con 0x7fe20806e590 2024-08-17T02:24:01.862 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:24:01.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.864+0000 7fe20de00640 1 -- 172.21.15.5:0/1565119541 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe1e8065150 msgr2=0x7fe1e8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.864+0000 7fe20de00640 1 --2- 172.21.15.5:0/1565119541 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe1e8065150 0x7fe1e8067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4034000 tx=0x7fe1f4032000 comp rx=0 tx=0).stop 2024-08-17T02:24:01.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.864+0000 7fe20de00640 1 -- 172.21.15.5:0/1565119541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe20806e590 msgr2=0x7fe208159370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:01.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.864+0000 7fe20de00640 1 --2- 172.21.15.5:0/1565119541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe20806e590 0x7fe208159370 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00d8c0 tx=0x7fe1fc008040 comp rx=0 tx=0).stop 2024-08-17T02:24:01.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.864+0000 7fe20de00640 1 -- 172.21.15.5:0/1565119541 shutdown_connections 2024-08-17T02:24:01.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.864+0000 7fe20de00640 1 --2- 172.21.15.5:0/1565119541 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe1e8065150 0x7fe1e8067600 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.864+0000 7fe20de00640 1 --2- 172.21.15.5:0/1565119541 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2080cb190 0x7fe208154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.864+0000 7fe20de00640 1 --2- 172.21.15.5:0/1565119541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe208158a00 0x7fe20814e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.864+0000 7fe20de00640 1 --2- 172.21.15.5:0/1565119541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe20806e590 0x7fe208159370 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:01.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.864+0000 7fe20de00640 1 -- 172.21.15.5:0/1565119541 >> 172.21.15.5:0/1565119541 conn(0x7fe2080cfb80 msgr2=0x7fe2080ca780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:01.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.864+0000 7fe20de00640 1 -- 172.21.15.5:0/1565119541 shutdown_connections 2024-08-17T02:24:01.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:01.864+0000 7fe20de00640 1 -- 172.21.15.5:0/1565119541 wait complete. 2024-08-17T02:24:01.879 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:02.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.034+0000 7f7b86000640 1 Processor -- start 2024-08-17T02:24:02.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.034+0000 7f7b86000640 1 -- start start 2024-08-17T02:24:02.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.035+0000 7f7b86000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7b80158b90 0x7f7b800b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.036+0000 7f7b86000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800af130 0x7f7b800ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.036+0000 7f7b86000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b800afd20 con 0x7f7b800b2370 2024-08-17T02:24:02.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.036+0000 7f7b86000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b800affe0 con 0x7f7b80158b90 2024-08-17T02:24:02.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.036+0000 7f7b86000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b800b02c0 con 0x7f7b800af130 2024-08-17T02:24:02.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.036+0000 7f7b7fe00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800af130 0x7f7b800ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.036+0000 7f7b7f400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7b80158b90 0x7f7b800b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.036+0000 7f7b77e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7b800b2370 0x7f7b800aea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:54770/0 (socket says 172.21.15.5:54770) 2024-08-17T02:24:02.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.036+0000 7f7b77e00640 1 -- 172.21.15.5:0/1062935745 learned_addr learned my addr 172.21.15.5:0/1062935745 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:02.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.037+0000 7f7b7f400640 1 -- 172.21.15.5:0/1062935745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800af130 msgr2=0x7f7b800ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:02.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.037+0000 7f7b7f400640 1 --2- 172.21.15.5:0/1062935745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800af130 0x7f7b800ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.037+0000 7f7b7f400640 1 -- 172.21.15.5:0/1062935745 >> v1:172.21.15.87:6789/0 conn(0x7f7b800b2370 legacy=0x7f7b800aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.037+0000 7f7b7f400640 1 -- 172.21.15.5:0/1062935745 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b800ca3c0 con 0x7f7b80158b90 2024-08-17T02:24:02.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.037+0000 7f7b7ea00640 1 -- 172.21.15.5:0/1062935745 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682658981 0 0) 0x7f7b800afd20 con 0x7f7b800b2370 2024-08-17T02:24:02.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.037+0000 7f7b7fe00640 1 --2- 172.21.15.5:0/1062935745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800af130 0x7f7b800ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:02.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.038+0000 7f7b7f400640 1 --2- 172.21.15.5:0/1062935745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b80158b90 0x7f7b800b1e30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7b70009850 tx=0x7f7b700090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e362ea77d896a86b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:02.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.038+0000 7f7b7ea00640 1 -- 172.21.15.5:0/1062935745 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7002ad80 con 0x7f7b80158b90 2024-08-17T02:24:02.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.038+0000 7f7b7ea00640 1 -- 172.21.15.5:0/1062935745 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b70032440 con 0x7f7b80158b90 2024-08-17T02:24:02.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.038+0000 7f7b7ea00640 1 -- 172.21.15.5:0/1062935745 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b700327e0 con 0x7f7b80158b90 2024-08-17T02:24:02.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.038+0000 7f7b86000640 1 -- 172.21.15.5:0/1062935745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b80158b90 msgr2=0x7f7b800b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.038+0000 7f7b86000640 1 --2- 172.21.15.5:0/1062935745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b80158b90 0x7f7b800b1e30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7b70009850 tx=0x7f7b700090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.039+0000 7f7b86000640 1 -- 172.21.15.5:0/1062935745 shutdown_connections 2024-08-17T02:24:02.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.039+0000 7f7b86000640 1 --2- 172.21.15.5:0/1062935745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800af130 0x7f7b800ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.039+0000 7f7b86000640 1 --2- 172.21.15.5:0/1062935745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b80158b90 0x7f7b800b1e30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.039+0000 7f7b86000640 1 -- 172.21.15.5:0/1062935745 >> 172.21.15.5:0/1062935745 conn(0x7f7b8006e590 msgr2=0x7f7b8006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.039+0000 7f7b86000640 1 -- 172.21.15.5:0/1062935745 shutdown_connections 2024-08-17T02:24:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.039+0000 7f7b86000640 1 -- 172.21.15.5:0/1062935745 wait complete. 2024-08-17T02:24:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.040+0000 7f7b86000640 1 Processor -- start 2024-08-17T02:24:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.040+0000 7f7b86000640 1 -- start start 2024-08-17T02:24:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.041+0000 7f7b86000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b800af130 0x7f7b800c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.041+0000 7f7b86000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800b2370 0x7f7b8016c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.041+0000 7f7b86000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b80158b90 0x7f7b8016cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.041+0000 7f7b86000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8015e1b0 con 0x7f7b800af130 2024-08-17T02:24:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.041+0000 7f7b86000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8015bdb0 con 0x7f7b80158b90 2024-08-17T02:24:02.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.041+0000 7f7b86000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8015e450 con 0x7f7b800b2370 2024-08-17T02:24:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.041+0000 7f7b7f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b800af130 0x7f7b800c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.041+0000 7f7b7f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b800af130 0x7f7b800c58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34632/0 (socket says 172.21.15.5:34632) 2024-08-17T02:24:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.041+0000 7f7b7f400640 1 -- 172.21.15.5:0/1635704230 learned_addr learned my addr 172.21.15.5:0/1635704230 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.042+0000 7f7b7fe00640 1 --2- 172.21.15.5:0/1635704230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b80158b90 0x7f7b8016cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.042+0000 7f7b77e00640 1 --2- 172.21.15.5:0/1635704230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800b2370 0x7f7b8016c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.042+0000 7f7b7f400640 1 -- 172.21.15.5:0/1635704230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800b2370 msgr2=0x7f7b8016c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.042+0000 7f7b7f400640 1 --2- 172.21.15.5:0/1635704230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800b2370 0x7f7b8016c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.042+0000 7f7b7f400640 1 -- 172.21.15.5:0/1635704230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b80158b90 msgr2=0x7f7b8016cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.042+0000 7f7b7f400640 1 --2- 172.21.15.5:0/1635704230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b80158b90 0x7f7b8016cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.042+0000 7f7b7f400640 1 -- 172.21.15.5:0/1635704230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b78009a20 con 0x7f7b800af130 2024-08-17T02:24:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.042+0000 7f7b7f400640 1 --2- 172.21.15.5:0/1635704230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b800af130 0x7f7b800c58d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7b70009850 tx=0x7f7b70032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.042+0000 7f7b76a00640 1 -- 172.21.15.5:0/1635704230 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b70000d10 con 0x7f7b800af130 2024-08-17T02:24:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.042+0000 7f7b76a00640 1 -- 172.21.15.5:0/1635704230 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b70031a60 con 0x7f7b800af130 2024-08-17T02:24:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.042+0000 7f7b86000640 1 -- 172.21.15.5:0/1635704230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b70009390 con 0x7f7b800af130 2024-08-17T02:24:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.042+0000 7f7b76a00640 1 -- 172.21.15.5:0/1635704230 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b70031e20 con 0x7f7b800af130 2024-08-17T02:24:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.043+0000 7f7b86000640 1 -- 172.21.15.5:0/1635704230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8015ea10 con 0x7f7b800af130 2024-08-17T02:24:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.044+0000 7f7b86000640 1 -- 172.21.15.5:0/1635704230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8015ec30 con 0x7f7b800af130 2024-08-17T02:24:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.044+0000 7f7b76a00640 1 -- 172.21.15.5:0/1635704230 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7b7003c610 con 0x7f7b800af130 2024-08-17T02:24:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.045+0000 7f7b76a00640 1 --2- 172.21.15.5:0/1635704230 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7b5c065150 0x7f7b5c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.045+0000 7f7b76a00640 1 -- 172.21.15.5:0/1635704230 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b700a3060 con 0x7f7b800af130 2024-08-17T02:24:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.045+0000 7f7b77e00640 1 --2- 172.21.15.5:0/1635704230 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7b5c065150 0x7f7b5c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.046+0000 7f7b77e00640 1 --2- 172.21.15.5:0/1635704230 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7b5c065150 0x7f7b5c067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7b800c9bd0 tx=0x7f7b68007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.049+0000 7f7b76a00640 1 -- 172.21.15.5:0/1635704230 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7b700711b0 con 0x7f7b800af130 2024-08-17T02:24:02.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.234+0000 7f7b86000640 1 -- 172.21.15.5:0/1635704230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7b80063fb0 con 0x7f7b800af130 2024-08-17T02:24:02.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.234+0000 7f7b76a00640 1 -- 172.21.15.5:0/1635704230 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7b700747d0 con 0x7f7b800af130 2024-08-17T02:24:02.235 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-17T02:24:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.236+0000 7f7b86000640 1 -- 172.21.15.5:0/1635704230 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7b5c065150 msgr2=0x7f7b5c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.236+0000 7f7b86000640 1 --2- 172.21.15.5:0/1635704230 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7b5c065150 0x7f7b5c067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7b800c9bd0 tx=0x7f7b68007ec0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.236+0000 7f7b86000640 1 -- 172.21.15.5:0/1635704230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b800af130 msgr2=0x7f7b800c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.236+0000 7f7b86000640 1 --2- 172.21.15.5:0/1635704230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b800af130 0x7f7b800c58d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7b70009850 tx=0x7f7b70032000 comp rx=0 tx=0).stop 2024-08-17T02:24:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.236+0000 7f7b86000640 1 -- 172.21.15.5:0/1635704230 shutdown_connections 2024-08-17T02:24:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.236+0000 7f7b86000640 1 --2- 172.21.15.5:0/1635704230 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7b5c065150 0x7f7b5c067600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.236+0000 7f7b86000640 1 --2- 172.21.15.5:0/1635704230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800b2370 0x7f7b8016c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.236+0000 7f7b86000640 1 --2- 172.21.15.5:0/1635704230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b80158b90 0x7f7b8016cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.236+0000 7f7b86000640 1 --2- 172.21.15.5:0/1635704230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b800af130 0x7f7b800c58d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.236+0000 7f7b86000640 1 -- 172.21.15.5:0/1635704230 >> 172.21.15.5:0/1635704230 conn(0x7f7b8006e590 msgr2=0x7f7b800d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.237+0000 7f7b86000640 1 -- 172.21.15.5:0/1635704230 shutdown_connections 2024-08-17T02:24:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.237+0000 7f7b86000640 1 -- 172.21.15.5:0/1635704230 wait complete. 2024-08-17T02:24:02.254 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:02.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.406+0000 7ff496000640 1 Processor -- start 2024-08-17T02:24:02.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.406+0000 7ff496000640 1 -- start start 2024-08-17T02:24:02.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.407+0000 7ff496000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff4900ad960 0x7ff49015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.407+0000 7ff496000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4900add30 0x7ff490156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.407+0000 7ff496000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49015b5e0 con 0x7ff4900ca050 2024-08-17T02:24:02.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.407+0000 7ff496000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4900cb160 con 0x7ff4900ad960 2024-08-17T02:24:02.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.407+0000 7ff496000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4900b0d10 con 0x7ff4900add30 2024-08-17T02:24:02.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.407+0000 7ff487e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff4900ca050 0x7ff490156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47432/0 (socket says 172.21.15.5:47432) 2024-08-17T02:24:02.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.407+0000 7ff487e00640 1 -- 172.21.15.5:0/762068138 learned_addr learned my addr 172.21.15.5:0/762068138 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:02.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.408+0000 7ff48fe00640 1 --2- 172.21.15.5:0/762068138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4900add30 0x7ff490156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.408+0000 7ff48f400640 1 --2- 172.21.15.5:0/762068138 >> v2:172.21.15.87:3300/0 conn(0x7ff4900ad960 0x7ff49015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.408+0000 7ff48ea00640 1 -- 172.21.15.5:0/762068138 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931185693 0 0) 0x7ff478001110 con 0x7ff4900ca050 2024-08-17T02:24:02.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.408+0000 7ff48ea00640 1 -- 172.21.15.5:0/762068138 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4740034e0 con 0x7ff4900ca050 2024-08-17T02:24:02.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.408+0000 7ff48fe00640 1 -- 172.21.15.5:0/762068138 >> v2:172.21.15.87:3300/0 conn(0x7ff4900ad960 msgr2=0x7ff49015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:02.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.408+0000 7ff48fe00640 1 --2- 172.21.15.5:0/762068138 >> v2:172.21.15.87:3300/0 conn(0x7ff4900ad960 0x7ff49015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.408+0000 7ff48fe00640 1 -- 172.21.15.5:0/762068138 >> v1:172.21.15.5:6789/0 conn(0x7ff4900ca050 legacy=0x7ff490156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.408+0000 7ff48fe00640 1 -- 172.21.15.5:0/762068138 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4900ca550 con 0x7ff4900add30 2024-08-17T02:24:02.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.408+0000 7ff48f400640 1 --2- 172.21.15.5:0/762068138 >> v2:172.21.15.87:3300/0 conn(0x7ff4900ad960 0x7ff49015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:02.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.409+0000 7ff48fe00640 1 --2- 172.21.15.5:0/762068138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4900add30 0x7ff490156b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff488009e60 tx=0x7ff488009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8835f4337b9148a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:02.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.410+0000 7ff48ea00640 1 -- 172.21.15.5:0/762068138 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488007550 con 0x7ff4900add30 2024-08-17T02:24:02.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.410+0000 7ff48ea00640 1 -- 172.21.15.5:0/762068138 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48802d050 con 0x7ff4900add30 2024-08-17T02:24:02.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.410+0000 7ff48ea00640 1 -- 172.21.15.5:0/762068138 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488007900 con 0x7ff4900add30 2024-08-17T02:24:02.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.410+0000 7ff496000640 1 -- 172.21.15.5:0/762068138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4900add30 msgr2=0x7ff490156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.410+0000 7ff496000640 1 --2- 172.21.15.5:0/762068138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4900add30 0x7ff490156b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff488009e60 tx=0x7ff488009780 comp rx=0 tx=0).stop 2024-08-17T02:24:02.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.410+0000 7ff496000640 1 -- 172.21.15.5:0/762068138 shutdown_connections 2024-08-17T02:24:02.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.410+0000 7ff496000640 1 --2- 172.21.15.5:0/762068138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4900add30 0x7ff490156b30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.410+0000 7ff496000640 1 --2- 172.21.15.5:0/762068138 >> v2:172.21.15.87:3300/0 conn(0x7ff4900ad960 0x7ff49015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.410+0000 7ff496000640 1 -- 172.21.15.5:0/762068138 >> 172.21.15.5:0/762068138 conn(0x7ff490066e60 msgr2=0x7ff490067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:02.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.410+0000 7ff496000640 1 -- 172.21.15.5:0/762068138 shutdown_connections 2024-08-17T02:24:02.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.410+0000 7ff496000640 1 -- 172.21.15.5:0/762068138 wait complete. 2024-08-17T02:24:02.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.412+0000 7ff496000640 1 Processor -- start 2024-08-17T02:24:02.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.412+0000 7ff496000640 1 -- start start 2024-08-17T02:24:02.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.413+0000 7ff496000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4900ad960 0x7ff490150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.413+0000 7ff496000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4900add30 0x7ff49014b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.413+0000 7ff496000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4900ca050 0x7ff490157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.413+0000 7ff496000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff490157300 con 0x7ff4900ca050 2024-08-17T02:24:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.413+0000 7ff496000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff490151190 con 0x7ff4900ad960 2024-08-17T02:24:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.413+0000 7ff496000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff490151470 con 0x7ff4900add30 2024-08-17T02:24:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.413+0000 7ff48fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4900ca050 0x7ff490157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.413+0000 7ff48fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4900ca050 0x7ff490157f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34638/0 (socket says 172.21.15.5:34638) 2024-08-17T02:24:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.413+0000 7ff48fe00640 1 -- 172.21.15.5:0/1733428619 learned_addr learned my addr 172.21.15.5:0/1733428619 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.413+0000 7ff48fe00640 1 -- 172.21.15.5:0/1733428619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4900add30 msgr2=0x7ff49014b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.413+0000 7ff487e00640 1 --2- 172.21.15.5:0/1733428619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4900add30 0x7ff49014b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.413+0000 7ff48f400640 1 --2- 172.21.15.5:0/1733428619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4900ad960 0x7ff490150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.413+0000 7ff48fe00640 1 --2- 172.21.15.5:0/1733428619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4900add30 0x7ff49014b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.413+0000 7ff48fe00640 1 -- 172.21.15.5:0/1733428619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4900ad960 msgr2=0x7ff490150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.413+0000 7ff48fe00640 1 --2- 172.21.15.5:0/1733428619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4900ad960 0x7ff490150b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.413+0000 7ff48fe00640 1 -- 172.21.15.5:0/1733428619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff480009390 con 0x7ff4900ca050 2024-08-17T02:24:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.413+0000 7ff487e00640 1 --2- 172.21.15.5:0/1733428619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4900add30 0x7ff49014b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.414+0000 7ff48fe00640 1 --2- 172.21.15.5:0/1733428619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4900ca050 0x7ff490157f90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff4880097c0 tx=0x7ff488037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.414+0000 7ff486a00640 1 -- 172.21.15.5:0/1733428619 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488031aa0 con 0x7ff4900ca050 2024-08-17T02:24:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.414+0000 7ff486a00640 1 -- 172.21.15.5:0/1733428619 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff488031c20 con 0x7ff4900ca050 2024-08-17T02:24:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.414+0000 7ff496000640 1 -- 172.21.15.5:0/1733428619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff488009a20 con 0x7ff4900ca050 2024-08-17T02:24:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.414+0000 7ff486a00640 1 -- 172.21.15.5:0/1733428619 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48803d430 con 0x7ff4900ca050 2024-08-17T02:24:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.414+0000 7ff496000640 1 -- 172.21.15.5:0/1733428619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49015bb00 con 0x7ff4900ca050 2024-08-17T02:24:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.415+0000 7ff496000640 1 -- 172.21.15.5:0/1733428619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff490063fb0 con 0x7ff4900ca050 2024-08-17T02:24:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.416+0000 7ff486a00640 1 -- 172.21.15.5:0/1733428619 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff488003040 con 0x7ff4900ca050 2024-08-17T02:24:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.417+0000 7ff486a00640 1 --2- 172.21.15.5:0/1733428619 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff46c065150 0x7ff46c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.417+0000 7ff486a00640 1 -- 172.21.15.5:0/1733428619 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff4880a3ad0 con 0x7ff4900ca050 2024-08-17T02:24:02.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.417+0000 7ff48f400640 1 --2- 172.21.15.5:0/1733428619 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff46c065150 0x7ff46c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.418+0000 7ff48f400640 1 --2- 172.21.15.5:0/1733428619 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff46c065150 0x7ff46c067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff480006e70 tx=0x7ff480008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:02.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.421+0000 7ff486a00640 1 -- 172.21.15.5:0/1733428619 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff488071af0 con 0x7ff4900ca050 2024-08-17T02:24:02.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.609+0000 7ff496000640 1 -- 172.21.15.5:0/1733428619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff49006eb80 con 0x7ff4900ca050 2024-08-17T02:24:02.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.610+0000 7ff486a00640 1 -- 172.21.15.5:0/1733428619 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15254 (secure 0 0 0) 0x7ff488075110 con 0x7ff4900ca050 2024-08-17T02:24:02.611 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:02.611 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:36.575545+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:32.642845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:33.982937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:02.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.612+0000 7ff496000640 1 -- 172.21.15.5:0/1733428619 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff46c065150 msgr2=0x7ff46c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.613+0000 7ff496000640 1 --2- 172.21.15.5:0/1733428619 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff46c065150 0x7ff46c067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff480006e70 tx=0x7ff480008040 comp rx=0 tx=0).stop 2024-08-17T02:24:02.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.613+0000 7ff496000640 1 -- 172.21.15.5:0/1733428619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4900ca050 msgr2=0x7ff490157f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.613+0000 7ff496000640 1 --2- 172.21.15.5:0/1733428619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4900ca050 0x7ff490157f90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff4880097c0 tx=0x7ff488037000 comp rx=0 tx=0).stop 2024-08-17T02:24:02.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.613+0000 7ff496000640 1 -- 172.21.15.5:0/1733428619 shutdown_connections 2024-08-17T02:24:02.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.613+0000 7ff496000640 1 --2- 172.21.15.5:0/1733428619 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff46c065150 0x7ff46c067600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.613+0000 7ff496000640 1 --2- 172.21.15.5:0/1733428619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4900add30 0x7ff49014b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.613+0000 7ff496000640 1 --2- 172.21.15.5:0/1733428619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4900ca050 0x7ff490157f90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.613+0000 7ff496000640 1 --2- 172.21.15.5:0/1733428619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4900ad960 0x7ff490150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.613+0000 7ff496000640 1 -- 172.21.15.5:0/1733428619 >> 172.21.15.5:0/1733428619 conn(0x7ff490066e60 msgr2=0x7ff490153300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:02.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.613+0000 7ff496000640 1 -- 172.21.15.5:0/1733428619 shutdown_connections 2024-08-17T02:24:02.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.613+0000 7ff496000640 1 -- 172.21.15.5:0/1733428619 wait complete. 2024-08-17T02:24:02.629 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:28.773677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:23:32.642845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:23:33.982937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:24:02.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:02.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.785+0000 7f8e39200640 1 Processor -- start 2024-08-17T02:24:02.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.785+0000 7f8e39200640 1 -- start start 2024-08-17T02:24:02.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.787+0000 7f8e39200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8e34067aa0 0x7f8e340acb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.787+0000 7f8e39200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e340a8dd0 con 0x7f8e34158b60 2024-08-17T02:24:02.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.787+0000 7f8e39200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e340abbc0 con 0x7f8e34158f30 2024-08-17T02:24:02.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.787+0000 7f8e39200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e340abe60 con 0x7f8e34067aa0 2024-08-17T02:24:02.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.787+0000 7f8e31e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8e34158b60 0x7f8e340ac420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47436/0 (socket says 172.21.15.5:47436) 2024-08-17T02:24:02.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.787+0000 7f8e31e00640 1 -- 172.21.15.5:0/4031669319 learned_addr learned my addr 172.21.15.5:0/4031669319 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:02.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.787+0000 7f8e32800640 1 --2- 172.21.15.5:0/4031669319 >> v2:172.21.15.5:3300/0 conn(0x7f8e34067aa0 0x7f8e340acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.787+0000 7f8e31400640 1 -- 172.21.15.5:0/4031669319 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833835162 0 0) 0x7f8e340a8dd0 con 0x7f8e34158b60 2024-08-17T02:24:02.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.787+0000 7f8e31400640 1 -- 172.21.15.5:0/4031669319 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e180034e0 con 0x7f8e34158b60 2024-08-17T02:24:02.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.787+0000 7f8e32800640 1 -- 172.21.15.5:0/4031669319 >> v1:172.21.15.87:6789/0 conn(0x7f8e34158f30 legacy=0x7f8e340a9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.787+0000 7f8e32800640 1 -- 172.21.15.5:0/4031669319 >> v1:172.21.15.5:6789/0 conn(0x7f8e34158b60 legacy=0x7f8e340ac420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.787+0000 7f8e32800640 1 -- 172.21.15.5:0/4031669319 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e340ac140 con 0x7f8e34067aa0 2024-08-17T02:24:02.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.788+0000 7f8e32800640 1 --2- 172.21.15.5:0/4031669319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e34067aa0 0x7f8e340acb30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009e60 tx=0x7f8e2c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77497b24954308a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:02.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.789+0000 7f8e31400640 1 -- 172.21.15.5:0/4031669319 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c007550 con 0x7f8e34067aa0 2024-08-17T02:24:02.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.789+0000 7f8e31400640 1 -- 172.21.15.5:0/4031669319 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c02d050 con 0x7f8e34067aa0 2024-08-17T02:24:02.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.789+0000 7f8e31400640 1 -- 172.21.15.5:0/4031669319 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c007900 con 0x7f8e34067aa0 2024-08-17T02:24:02.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.789+0000 7f8e39200640 1 -- 172.21.15.5:0/4031669319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e34067aa0 msgr2=0x7f8e340acb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.789+0000 7f8e39200640 1 --2- 172.21.15.5:0/4031669319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e34067aa0 0x7f8e340acb30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009e60 tx=0x7f8e2c009780 comp rx=0 tx=0).stop 2024-08-17T02:24:02.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.789+0000 7f8e39200640 1 -- 172.21.15.5:0/4031669319 shutdown_connections 2024-08-17T02:24:02.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.789+0000 7f8e39200640 1 --2- 172.21.15.5:0/4031669319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e34067aa0 0x7f8e340acb30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.789+0000 7f8e39200640 1 -- 172.21.15.5:0/4031669319 >> 172.21.15.5:0/4031669319 conn(0x7f8e340cc390 msgr2=0x7f8e34066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:02.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.789+0000 7f8e39200640 1 -- 172.21.15.5:0/4031669319 shutdown_connections 2024-08-17T02:24:02.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.789+0000 7f8e39200640 1 -- 172.21.15.5:0/4031669319 wait complete. 2024-08-17T02:24:02.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.791+0000 7f8e39200640 1 Processor -- start 2024-08-17T02:24:02.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.791+0000 7f8e39200640 1 -- start start 2024-08-17T02:24:02.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.792+0000 7f8e39200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e34067aa0 0x7f8e34155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.792+0000 7f8e39200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e34158b60 0x7f8e340c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.792+0000 7f8e39200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e34158f30 0x7f8e34168f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.792+0000 7f8e39200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e34155b90 con 0x7f8e34158f30 2024-08-17T02:24:02.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.792+0000 7f8e39200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3415ad50 con 0x7f8e34067aa0 2024-08-17T02:24:02.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.792+0000 7f8e39200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3415a420 con 0x7f8e34158b60 2024-08-17T02:24:02.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.792+0000 7f8e32800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e34158f30 0x7f8e34168f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.792+0000 7f8e32800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e34158f30 0x7f8e34168f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34650/0 (socket says 172.21.15.5:34650) 2024-08-17T02:24:02.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.792+0000 7f8e32800640 1 -- 172.21.15.5:0/3697929521 learned_addr learned my addr 172.21.15.5:0/3697929521 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:02.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.792+0000 7f8e31e00640 1 --2- 172.21.15.5:0/3697929521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e34067aa0 0x7f8e34155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.792+0000 7f8e2be00640 1 --2- 172.21.15.5:0/3697929521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e34158b60 0x7f8e340c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.793+0000 7f8e32800640 1 -- 172.21.15.5:0/3697929521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e34158b60 msgr2=0x7f8e340c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.793+0000 7f8e32800640 1 --2- 172.21.15.5:0/3697929521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e34158b60 0x7f8e340c07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.793+0000 7f8e32800640 1 -- 172.21.15.5:0/3697929521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e34067aa0 msgr2=0x7f8e34155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.793+0000 7f8e32800640 1 --2- 172.21.15.5:0/3697929521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e34067aa0 0x7f8e34155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.793+0000 7f8e32800640 1 -- 172.21.15.5:0/3697929521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c009a20 con 0x7f8e34158f30 2024-08-17T02:24:02.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.793+0000 7f8e32800640 1 --2- 172.21.15.5:0/3697929521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e34158f30 0x7f8e34168f80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009e60 tx=0x7f8e2c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:02.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.793+0000 7f8e29600640 1 -- 172.21.15.5:0/3697929521 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c031b70 con 0x7f8e34158f30 2024-08-17T02:24:02.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.793+0000 7f8e29600640 1 -- 172.21.15.5:0/3697929521 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c031cd0 con 0x7f8e34158f30 2024-08-17T02:24:02.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.793+0000 7f8e29600640 1 -- 172.21.15.5:0/3697929521 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c03d680 con 0x7f8e34158f30 2024-08-17T02:24:02.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.793+0000 7f8e39200640 1 -- 172.21.15.5:0/3697929521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3415a700 con 0x7f8e34158f30 2024-08-17T02:24:02.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.793+0000 7f8e39200640 1 -- 172.21.15.5:0/3697929521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e341694c0 con 0x7f8e34158f30 2024-08-17T02:24:02.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.794+0000 7f8e39200640 1 -- 172.21.15.5:0/3697929521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3415aee0 con 0x7f8e34158f30 2024-08-17T02:24:02.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.796+0000 7f8e29600640 1 -- 172.21.15.5:0/3697929521 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8e2c003040 con 0x7f8e34158f30 2024-08-17T02:24:02.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.796+0000 7f8e29600640 1 --2- 172.21.15.5:0/3697929521 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8e10065180 0x7f8e10067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:02.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.797+0000 7f8e29600640 1 -- 172.21.15.5:0/3697929521 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e2c0a3a80 con 0x7f8e34158f30 2024-08-17T02:24:02.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.797+0000 7f8e31e00640 1 --2- 172.21.15.5:0/3697929521 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8e10065180 0x7f8e10067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:02.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.797+0000 7f8e31e00640 1 --2- 172.21.15.5:0/3697929521 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8e10065180 0x7f8e10067630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8e24005840 tx=0x7f8e24009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:02.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.802+0000 7f8e29600640 1 -- 172.21.15.5:0/3697929521 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8e2c071bf0 con 0x7f8e34158f30 2024-08-17T02:24:02.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.984+0000 7f8e39200640 1 -- 172.21.15.5:0/3697929521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8e34063fb0 con 0x7f8e34158f30 2024-08-17T02:24:02.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.984+0000 7f8e29600640 1 -- 172.21.15.5:0/3697929521 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8e2c075210 con 0x7f8e34158f30 2024-08-17T02:24:02.985 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:24:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.986+0000 7f8e39200640 1 -- 172.21.15.5:0/3697929521 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8e10065180 msgr2=0x7f8e10067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.986+0000 7f8e39200640 1 --2- 172.21.15.5:0/3697929521 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8e10065180 0x7f8e10067630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8e24005840 tx=0x7f8e24009040 comp rx=0 tx=0).stop 2024-08-17T02:24:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.986+0000 7f8e39200640 1 -- 172.21.15.5:0/3697929521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e34158f30 msgr2=0x7f8e34168f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.986+0000 7f8e39200640 1 --2- 172.21.15.5:0/3697929521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e34158f30 0x7f8e34168f80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009e60 tx=0x7f8e2c037000 comp rx=0 tx=0).stop 2024-08-17T02:24:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.986+0000 7f8e39200640 1 -- 172.21.15.5:0/3697929521 shutdown_connections 2024-08-17T02:24:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.986+0000 7f8e39200640 1 --2- 172.21.15.5:0/3697929521 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8e10065180 0x7f8e10067630 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.986+0000 7f8e39200640 1 --2- 172.21.15.5:0/3697929521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e34158b60 0x7f8e340c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.986+0000 7f8e39200640 1 --2- 172.21.15.5:0/3697929521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e34158f30 0x7f8e34168f80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.986+0000 7f8e39200640 1 --2- 172.21.15.5:0/3697929521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e34067aa0 0x7f8e34155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.986+0000 7f8e39200640 1 -- 172.21.15.5:0/3697929521 >> 172.21.15.5:0/3697929521 conn(0x7f8e340cc390 msgr2=0x7f8e34069fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.987+0000 7f8e39200640 1 -- 172.21.15.5:0/3697929521 shutdown_connections 2024-08-17T02:24:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:02.987+0000 7f8e39200640 1 -- 172.21.15.5:0/3697929521 wait complete. 2024-08-17T02:24:03.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:24:03.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.157+0000 7f6011200640 1 Processor -- start 2024-08-17T02:24:03.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.157+0000 7f6011200640 1 -- start start 2024-08-17T02:24:03.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.158+0000 7f6011200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f600c0afca0 0x7f600c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.158+0000 7f6011200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f600c0acf10 0x7f600c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.158+0000 7f6011200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f600c1589a0 0x7f600c158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.158+0000 7f6011200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600c0b0980 con 0x7f600c0afca0 2024-08-17T02:24:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.158+0000 7f6011200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600c15a4e0 con 0x7f600c0acf10 2024-08-17T02:24:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.158+0000 7f6011200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600c0c92b0 con 0x7f600c1589a0 2024-08-17T02:24:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.158+0000 7f6009e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f600c0afca0 0x7f600c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.158+0000 7f6009e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f600c0afca0 0x7f600c0b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34654/0 (socket says 172.21.15.5:34654) 2024-08-17T02:24:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.158+0000 7f6009e00640 1 -- 172.21.15.5:0/2271562632 learned_addr learned my addr 172.21.15.5:0/2271562632 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.159+0000 7f600a800640 1 --2- 172.21.15.5:0/2271562632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f600c1589a0 0x7f600c158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.159+0000 7f6003e00640 1 --2- 172.21.15.5:0/2271562632 >> v2:172.21.15.87:3300/0 conn(0x7f600c0acf10 0x7f600c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.159+0000 7f6009e00640 1 -- 172.21.15.5:0/2271562632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f600c1589a0 msgr2=0x7f600c158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.159+0000 7f6009e00640 1 --2- 172.21.15.5:0/2271562632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f600c1589a0 0x7f600c158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.159+0000 7f6009e00640 1 -- 172.21.15.5:0/2271562632 >> v2:172.21.15.87:3300/0 conn(0x7f600c0acf10 msgr2=0x7f600c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:03.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.159+0000 7f6009e00640 1 --2- 172.21.15.5:0/2271562632 >> v2:172.21.15.87:3300/0 conn(0x7f600c0acf10 0x7f600c159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.159+0000 7f6009e00640 1 -- 172.21.15.5:0/2271562632 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c159360 con 0x7f600c0afca0 2024-08-17T02:24:03.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.159+0000 7f6003e00640 1 --2- 172.21.15.5:0/2271562632 >> v2:172.21.15.87:3300/0 conn(0x7f600c0acf10 0x7f600c159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:03.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.159+0000 7f600a800640 1 --2- 172.21.15.5:0/2271562632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f600c1589a0 0x7f600c158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:03.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.160+0000 7f6009e00640 1 --2- 172.21.15.5:0/2271562632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600c0afca0 0x7f600c0b0070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f600c0c83b0 tx=0x7f5ffc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419d0adad3f43c8f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:03.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.160+0000 7f6009400640 1 -- 172.21.15.5:0/2271562632 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc02add0 con 0x7f600c0afca0 2024-08-17T02:24:03.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.160+0000 7f6009400640 1 -- 172.21.15.5:0/2271562632 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ffc032440 con 0x7f600c0afca0 2024-08-17T02:24:03.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.160+0000 7f6009400640 1 -- 172.21.15.5:0/2271562632 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc032820 con 0x7f600c0afca0 2024-08-17T02:24:03.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.161+0000 7f6011200640 1 -- 172.21.15.5:0/2271562632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600c0afca0 msgr2=0x7f600c0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.161+0000 7f6011200640 1 --2- 172.21.15.5:0/2271562632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600c0afca0 0x7f600c0b0070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f600c0c83b0 tx=0x7f5ffc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.161+0000 7f6011200640 1 -- 172.21.15.5:0/2271562632 shutdown_connections 2024-08-17T02:24:03.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.161+0000 7f6011200640 1 --2- 172.21.15.5:0/2271562632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f600c1589a0 0x7f600c158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.161+0000 7f6011200640 1 --2- 172.21.15.5:0/2271562632 >> v2:172.21.15.87:3300/0 conn(0x7f600c0acf10 0x7f600c159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.161+0000 7f6011200640 1 --2- 172.21.15.5:0/2271562632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600c0afca0 0x7f600c0b0070 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.161+0000 7f6011200640 1 -- 172.21.15.5:0/2271562632 >> 172.21.15.5:0/2271562632 conn(0x7f600c066e60 msgr2=0x7f600c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:03.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.161+0000 7f6011200640 1 -- 172.21.15.5:0/2271562632 shutdown_connections 2024-08-17T02:24:03.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.161+0000 7f6011200640 1 -- 172.21.15.5:0/2271562632 wait complete. 2024-08-17T02:24:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.162+0000 7f6011200640 1 Processor -- start 2024-08-17T02:24:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.162+0000 7f6011200640 1 -- start start 2024-08-17T02:24:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.163+0000 7f6011200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f600c0acf10 0x7f600c136e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.163+0000 7f6011200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f600c0afca0 0x7f600c14d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.163+0000 7f6011200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600c1589a0 0x7f600c0c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.163+0000 7f6011200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c16c740 con 0x7f600c1589a0 2024-08-17T02:24:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.163+0000 7f6011200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c14dbd0 con 0x7f600c0afca0 2024-08-17T02:24:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.163+0000 7f6011200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600c14deb0 con 0x7f600c0acf10 2024-08-17T02:24:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.164+0000 7f600a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600c1589a0 0x7f600c0c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.164+0000 7f600a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600c1589a0 0x7f600c0c3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34666/0 (socket says 172.21.15.5:34666) 2024-08-17T02:24:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.164+0000 7f600a800640 1 -- 172.21.15.5:0/990106515 learned_addr learned my addr 172.21.15.5:0/990106515 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.164+0000 7f6003e00640 1 --2- 172.21.15.5:0/990106515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f600c0afca0 0x7f600c14d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.164+0000 7f6009e00640 1 --2- 172.21.15.5:0/990106515 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f600c0acf10 0x7f600c136e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.164+0000 7f600a800640 1 -- 172.21.15.5:0/990106515 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f600c0acf10 msgr2=0x7f600c136e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.164+0000 7f600a800640 1 --2- 172.21.15.5:0/990106515 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f600c0acf10 0x7f600c136e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.164+0000 7f600a800640 1 -- 172.21.15.5:0/990106515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f600c0afca0 msgr2=0x7f600c14d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.164+0000 7f600a800640 1 --2- 172.21.15.5:0/990106515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f600c0afca0 0x7f600c14d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.164+0000 7f600a800640 1 -- 172.21.15.5:0/990106515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc009450 con 0x7f600c1589a0 2024-08-17T02:24:03.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.164+0000 7f600a800640 1 --2- 172.21.15.5:0/990106515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600c1589a0 0x7f600c0c3df0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6004007f30 tx=0x7f6004009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:03.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.165+0000 7f6001600640 1 -- 172.21.15.5:0/990106515 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600400de20 con 0x7f600c1589a0 2024-08-17T02:24:03.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.165+0000 7f6001600640 1 -- 172.21.15.5:0/990106515 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600400f040 con 0x7f600c1589a0 2024-08-17T02:24:03.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.165+0000 7f6001600640 1 -- 172.21.15.5:0/990106515 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004015690 con 0x7f600c1589a0 2024-08-17T02:24:03.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.165+0000 7f6011200640 1 -- 172.21.15.5:0/990106515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600c14e190 con 0x7f600c1589a0 2024-08-17T02:24:03.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.165+0000 7f6011200640 1 -- 172.21.15.5:0/990106515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600c14e750 con 0x7f600c1589a0 2024-08-17T02:24:03.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.166+0000 7f6011200640 1 -- 172.21.15.5:0/990106515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f600c14e970 con 0x7f600c1589a0 2024-08-17T02:24:03.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.167+0000 7f6001600640 1 -- 172.21.15.5:0/990106515 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f600401e3b0 con 0x7f600c1589a0 2024-08-17T02:24:03.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.167+0000 7f6001600640 1 --2- 172.21.15.5:0/990106515 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5fe8065150 0x7f5fe8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.168+0000 7f6001600640 1 -- 172.21.15.5:0/990106515 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6004082960 con 0x7f600c1589a0 2024-08-17T02:24:03.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.168+0000 7f6009e00640 1 --2- 172.21.15.5:0/990106515 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5fe8065150 0x7f5fe8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.168+0000 7f6009e00640 1 --2- 172.21.15.5:0/990106515 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5fe8065150 0x7f5fe8067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc034000 tx=0x7f5ffc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:03.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.171+0000 7f6001600640 1 -- 172.21.15.5:0/990106515 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6004050a20 con 0x7f600c1589a0 2024-08-17T02:24:03.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.350+0000 7f6011200640 1 -- 172.21.15.5:0/990106515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f600c063fb0 con 0x7f600c1589a0 2024-08-17T02:24:03.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.351+0000 7f6001600640 1 -- 172.21.15.5:0/990106515 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6004054040 con 0x7f600c1589a0 2024-08-17T02:24:03.352 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:24:03.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.353+0000 7f6011200640 1 -- 172.21.15.5:0/990106515 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5fe8065150 msgr2=0x7f5fe8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.353+0000 7f6011200640 1 --2- 172.21.15.5:0/990106515 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5fe8065150 0x7f5fe8067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc034000 tx=0x7f5ffc032000 comp rx=0 tx=0).stop 2024-08-17T02:24:03.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.353+0000 7f6011200640 1 -- 172.21.15.5:0/990106515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600c1589a0 msgr2=0x7f600c0c3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.353+0000 7f6011200640 1 --2- 172.21.15.5:0/990106515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600c1589a0 0x7f600c0c3df0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6004007f30 tx=0x7f6004009930 comp rx=0 tx=0).stop 2024-08-17T02:24:03.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.353+0000 7f6011200640 1 -- 172.21.15.5:0/990106515 shutdown_connections 2024-08-17T02:24:03.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.353+0000 7f6011200640 1 --2- 172.21.15.5:0/990106515 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5fe8065150 0x7f5fe8067600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.353+0000 7f6011200640 1 --2- 172.21.15.5:0/990106515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600c1589a0 0x7f600c0c3df0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.353+0000 7f6011200640 1 --2- 172.21.15.5:0/990106515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f600c0afca0 0x7f600c14d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.353+0000 7f6011200640 1 --2- 172.21.15.5:0/990106515 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f600c0acf10 0x7f600c136e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.353+0000 7f6011200640 1 -- 172.21.15.5:0/990106515 >> 172.21.15.5:0/990106515 conn(0x7f600c066e60 msgr2=0x7f600c069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:03.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.353+0000 7f6011200640 1 -- 172.21.15.5:0/990106515 shutdown_connections 2024-08-17T02:24:03.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.353+0000 7f6011200640 1 -- 172.21.15.5:0/990106515 wait complete. 2024-08-17T02:24:03.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:03.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.522+0000 7f36fe600640 1 Processor -- start 2024-08-17T02:24:03.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.522+0000 7f36fe600640 1 -- start start 2024-08-17T02:24:03.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.523+0000 7f36fe600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36f80ad960 0x7f36f815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.523+0000 7f36fe600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f80add30 0x7f36f8156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.523+0000 7f36fe600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f815b5e0 con 0x7f36f80ca050 2024-08-17T02:24:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.523+0000 7f36fe600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f80cb160 con 0x7f36f80ad960 2024-08-17T02:24:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.523+0000 7f36fe600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80b0d10 con 0x7f36f80add30 2024-08-17T02:24:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.524+0000 7f36f7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36f80ad960 0x7f36f815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.524+0000 7f36f7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36f80ad960 0x7f36f815b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34678/0 (socket says 172.21.15.5:34678) 2024-08-17T02:24:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.524+0000 7f36f7400640 1 -- 172.21.15.5:0/1818595703 learned_addr learned my addr 172.21.15.5:0/1818595703 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.524+0000 7f36f7e00640 1 --2- 172.21.15.5:0/1818595703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f80add30 0x7f36f8156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.524+0000 7f36f7400640 1 -- 172.21.15.5:0/1818595703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f80add30 msgr2=0x7f36f8156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.524+0000 7f36f7400640 1 --2- 172.21.15.5:0/1818595703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f80add30 0x7f36f8156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.524+0000 7f36f7400640 1 -- 172.21.15.5:0/1818595703 >> v1:172.21.15.87:6789/0 conn(0x7f36f80ca050 legacy=0x7f36f8156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.524+0000 7f36f7400640 1 -- 172.21.15.5:0/1818595703 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f80ca550 con 0x7f36f80ad960 2024-08-17T02:24:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.524+0000 7f36f6a00640 1 -- 172.21.15.5:0/1818595703 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458052003 0 0) 0x7f36e0001110 con 0x7f36f80ca050 2024-08-17T02:24:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.525+0000 7f36f7400640 1 --2- 172.21.15.5:0/1818595703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f80ad960 0x7f36f815b0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009910 tx=0x7f36e80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1449f5a636158c18 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.525+0000 7f36f6a00640 1 -- 172.21.15.5:0/1818595703 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8032440 con 0x7f36f80ad960 2024-08-17T02:24:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.526+0000 7f36f6a00640 1 -- 172.21.15.5:0/1818595703 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e80325a0 con 0x7f36f80ad960 2024-08-17T02:24:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.526+0000 7f36f6a00640 1 -- 172.21.15.5:0/1818595703 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8032940 con 0x7f36f80ad960 2024-08-17T02:24:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.526+0000 7f36fe600640 1 -- 172.21.15.5:0/1818595703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f80ad960 msgr2=0x7f36f815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.526+0000 7f36fe600640 1 --2- 172.21.15.5:0/1818595703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f80ad960 0x7f36f815b0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009910 tx=0x7f36e80091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.526+0000 7f36fe600640 1 -- 172.21.15.5:0/1818595703 shutdown_connections 2024-08-17T02:24:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.526+0000 7f36fe600640 1 --2- 172.21.15.5:0/1818595703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f80add30 0x7f36f8156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.526+0000 7f36fe600640 1 --2- 172.21.15.5:0/1818595703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f80ad960 0x7f36f815b0a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.526+0000 7f36fe600640 1 -- 172.21.15.5:0/1818595703 >> 172.21.15.5:0/1818595703 conn(0x7f36f8066e60 msgr2=0x7f36f8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.526+0000 7f36fe600640 1 -- 172.21.15.5:0/1818595703 shutdown_connections 2024-08-17T02:24:03.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.526+0000 7f36fe600640 1 -- 172.21.15.5:0/1818595703 wait complete. 2024-08-17T02:24:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.528+0000 7f36fe600640 1 Processor -- start 2024-08-17T02:24:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.528+0000 7f36fe600640 1 -- start start 2024-08-17T02:24:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.529+0000 7f36fe600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f80ad960 0x7f36f8159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.529+0000 7f36fe600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36f80add30 0x7f36f8159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.529+0000 7f36fe600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f80ca050 0x7f36f8145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.529+0000 7f36fe600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f8159980 con 0x7f36f80ad960 2024-08-17T02:24:03.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.529+0000 7f36fe600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f8157c90 con 0x7f36f80add30 2024-08-17T02:24:03.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.529+0000 7f36fe600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f8157f70 con 0x7f36f80ca050 2024-08-17T02:24:03.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.529+0000 7f36f7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f80ad960 0x7f36f8159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.529+0000 7f36f7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f80ad960 0x7f36f8159dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34690/0 (socket says 172.21.15.5:34690) 2024-08-17T02:24:03.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.529+0000 7f36f7400640 1 -- 172.21.15.5:0/1184905747 learned_addr learned my addr 172.21.15.5:0/1184905747 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:03.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.529+0000 7f36f7e00640 1 --2- 172.21.15.5:0/1184905747 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f80ca050 0x7f36f8145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.529+0000 7f36efe00640 1 --2- 172.21.15.5:0/1184905747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36f80add30 0x7f36f8159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.529+0000 7f36f7400640 1 -- 172.21.15.5:0/1184905747 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f80ca050 msgr2=0x7f36f8145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.529+0000 7f36f7400640 1 --2- 172.21.15.5:0/1184905747 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f80ca050 0x7f36f8145330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.529+0000 7f36f7400640 1 -- 172.21.15.5:0/1184905747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36f80add30 msgr2=0x7f36f8159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.529+0000 7f36f7400640 1 --2- 172.21.15.5:0/1184905747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36f80add30 0x7f36f8159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.529+0000 7f36f7400640 1 -- 172.21.15.5:0/1184905747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e8009450 con 0x7f36f80ad960 2024-08-17T02:24:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.529+0000 7f36f7e00640 1 --2- 172.21.15.5:0/1184905747 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f80ca050 0x7f36f8145330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.530+0000 7f36f7400640 1 --2- 172.21.15.5:0/1184905747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f80ad960 0x7f36f8159dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f36e8035040 tx=0x7f36e8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.530+0000 7f36eea00640 1 -- 172.21.15.5:0/1184905747 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8031b30 con 0x7f36f80ad960 2024-08-17T02:24:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.530+0000 7f36eea00640 1 -- 172.21.15.5:0/1184905747 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e8031cb0 con 0x7f36f80ad960 2024-08-17T02:24:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.530+0000 7f36fe600640 1 -- 172.21.15.5:0/1184905747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f8158250 con 0x7f36f80ad960 2024-08-17T02:24:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.530+0000 7f36eea00640 1 -- 172.21.15.5:0/1184905747 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e803d670 con 0x7f36f80ad960 2024-08-17T02:24:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.530+0000 7f36fe600640 1 -- 172.21.15.5:0/1184905747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f8145870 con 0x7f36f80ad960 2024-08-17T02:24:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.531+0000 7f36fe600640 1 -- 172.21.15.5:0/1184905747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f8063fb0 con 0x7f36f80ad960 2024-08-17T02:24:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.532+0000 7f36eea00640 1 -- 172.21.15.5:0/1184905747 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f36e8039040 con 0x7f36f80ad960 2024-08-17T02:24:03.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.532+0000 7f36eea00640 1 --2- 172.21.15.5:0/1184905747 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f36d4065150 0x7f36d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.533+0000 7f36eea00640 1 -- 172.21.15.5:0/1184905747 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f36e80a2590 con 0x7f36f80ad960 2024-08-17T02:24:03.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.533+0000 7f36efe00640 1 --2- 172.21.15.5:0/1184905747 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f36d4065150 0x7f36d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.533+0000 7f36efe00640 1 --2- 172.21.15.5:0/1184905747 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f36d4065150 0x7f36d4067600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f36f8153700 tx=0x7f36e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:03.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.537+0000 7f36eea00640 1 -- 172.21.15.5:0/1184905747 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f36e8070670 con 0x7f36f80ad960 2024-08-17T02:24:03.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.719+0000 7f36fe600640 1 -- 172.21.15.5:0/1184905747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36f806dc50 con 0x7f36f80ad960 2024-08-17T02:24:03.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.720+0000 7f36eea00640 1 -- 172.21.15.5:0/1184905747 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f36e8031e60 con 0x7f36f80ad960 2024-08-17T02:24:03.720 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-17T02:24:03.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.722+0000 7f36fe600640 1 -- 172.21.15.5:0/1184905747 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f36d4065150 msgr2=0x7f36d4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.722+0000 7f36fe600640 1 --2- 172.21.15.5:0/1184905747 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f36d4065150 0x7f36d4067600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f36f8153700 tx=0x7f36e0009040 comp rx=0 tx=0).stop 2024-08-17T02:24:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.722+0000 7f36fe600640 1 -- 172.21.15.5:0/1184905747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f80ad960 msgr2=0x7f36f8159dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.722+0000 7f36fe600640 1 --2- 172.21.15.5:0/1184905747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f80ad960 0x7f36f8159dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f36e8035040 tx=0x7f36e8032000 comp rx=0 tx=0).stop 2024-08-17T02:24:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.722+0000 7f36fe600640 1 -- 172.21.15.5:0/1184905747 shutdown_connections 2024-08-17T02:24:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.722+0000 7f36fe600640 1 --2- 172.21.15.5:0/1184905747 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f36d4065150 0x7f36d4067600 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.722+0000 7f36fe600640 1 --2- 172.21.15.5:0/1184905747 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f80ca050 0x7f36f8145330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.722+0000 7f36fe600640 1 --2- 172.21.15.5:0/1184905747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36f80add30 0x7f36f8159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.722+0000 7f36fe600640 1 --2- 172.21.15.5:0/1184905747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f80ad960 0x7f36f8159dd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.722+0000 7f36fe600640 1 -- 172.21.15.5:0/1184905747 >> 172.21.15.5:0/1184905747 conn(0x7f36f8066e60 msgr2=0x7f36f80b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.722+0000 7f36fe600640 1 -- 172.21.15.5:0/1184905747 shutdown_connections 2024-08-17T02:24:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.722+0000 7f36fe600640 1 -- 172.21.15.5:0/1184905747 wait complete. 2024-08-17T02:24:03.737 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:03.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.889+0000 7f912c000640 1 Processor -- start 2024-08-17T02:24:03.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.889+0000 7f912c000640 1 -- start start 2024-08-17T02:24:03.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.890+0000 7f912c000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91240afca0 0x7f91240b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.890+0000 7f912c000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91240acf10 0x7f9124159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.890+0000 7f912c000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91241589a0 0x7f9124158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.890+0000 7f912c000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91240b0980 con 0x7f91241589a0 2024-08-17T02:24:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.890+0000 7f912c000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912415a4e0 con 0x7f91240afca0 2024-08-17T02:24:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.890+0000 7f912c000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91240c92b0 con 0x7f91240acf10 2024-08-17T02:24:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.890+0000 7f912a000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91241589a0 0x7f9124158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.891+0000 7f912a000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91241589a0 0x7f9124158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34706/0 (socket says 172.21.15.5:34706) 2024-08-17T02:24:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.891+0000 7f912a000640 1 -- 172.21.15.5:0/202867130 learned_addr learned my addr 172.21.15.5:0/202867130 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.891+0000 7f9129600640 1 --2- 172.21.15.5:0/202867130 >> v2:172.21.15.87:3300/0 conn(0x7f91240afca0 0x7f91240b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.891+0000 7f9128c00640 1 --2- 172.21.15.5:0/202867130 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91240acf10 0x7f9124159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.891+0000 7f912a000640 1 -- 172.21.15.5:0/202867130 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91240acf10 msgr2=0x7f9124159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.891+0000 7f912a000640 1 --2- 172.21.15.5:0/202867130 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91240acf10 0x7f9124159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.891+0000 7f912a000640 1 -- 172.21.15.5:0/202867130 >> v2:172.21.15.87:3300/0 conn(0x7f91240afca0 msgr2=0x7f91240b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.891+0000 7f912a000640 1 --2- 172.21.15.5:0/202867130 >> v2:172.21.15.87:3300/0 conn(0x7f91240afca0 0x7f91240b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.891+0000 7f912a000640 1 -- 172.21.15.5:0/202867130 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9124159360 con 0x7f91241589a0 2024-08-17T02:24:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.892+0000 7f912a000640 1 --2- 172.21.15.5:0/202867130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91241589a0 0x7f9124158e20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f911c00d1a0 tx=0x7f911c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a909ad42d2f9b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.892+0000 7f9123e00640 1 -- 172.21.15.5:0/202867130 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c00b0d0 con 0x7f91241589a0 2024-08-17T02:24:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.892+0000 7f9123e00640 1 -- 172.21.15.5:0/202867130 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c00b230 con 0x7f91241589a0 2024-08-17T02:24:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.892+0000 7f9123e00640 1 -- 172.21.15.5:0/202867130 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c009610 con 0x7f91241589a0 2024-08-17T02:24:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.893+0000 7f912c000640 1 -- 172.21.15.5:0/202867130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91241589a0 msgr2=0x7f9124158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.893+0000 7f912c000640 1 --2- 172.21.15.5:0/202867130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91241589a0 0x7f9124158e20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f911c00d1a0 tx=0x7f911c00ba50 comp rx=0 tx=0).stop 2024-08-17T02:24:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.893+0000 7f912c000640 1 -- 172.21.15.5:0/202867130 shutdown_connections 2024-08-17T02:24:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.893+0000 7f912c000640 1 --2- 172.21.15.5:0/202867130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91241589a0 0x7f9124158e20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.893+0000 7f912c000640 1 --2- 172.21.15.5:0/202867130 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91240acf10 0x7f9124159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.893+0000 7f912c000640 1 --2- 172.21.15.5:0/202867130 >> v2:172.21.15.87:3300/0 conn(0x7f91240afca0 0x7f91240b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.893+0000 7f912c000640 1 -- 172.21.15.5:0/202867130 >> 172.21.15.5:0/202867130 conn(0x7f9124066e60 msgr2=0x7f9124067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:03.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.893+0000 7f912c000640 1 -- 172.21.15.5:0/202867130 shutdown_connections 2024-08-17T02:24:03.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.893+0000 7f912c000640 1 -- 172.21.15.5:0/202867130 wait complete. 2024-08-17T02:24:03.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.894+0000 7f912c000640 1 Processor -- start 2024-08-17T02:24:03.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.894+0000 7f912c000640 1 -- start start 2024-08-17T02:24:03.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.895+0000 7f912c000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91240acf10 0x7f912415a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.895+0000 7f912c000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91240afca0 0x7f91240c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.895+0000 7f912c000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91241589a0 0x7f9124154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.895+0000 7f912c000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91240c7df0 con 0x7f91240acf10 2024-08-17T02:24:03.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.895+0000 7f912c000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91240c53e0 con 0x7f91241589a0 2024-08-17T02:24:03.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.895+0000 7f912c000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91240ac230 con 0x7f91240afca0 2024-08-17T02:24:03.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.895+0000 7f9129600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91240acf10 0x7f912415a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.896+0000 7f9129600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91240acf10 0x7f912415a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34712/0 (socket says 172.21.15.5:34712) 2024-08-17T02:24:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.896+0000 7f9129600640 1 -- 172.21.15.5:0/3372362090 learned_addr learned my addr 172.21.15.5:0/3372362090 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.896+0000 7f9128c00640 1 --2- 172.21.15.5:0/3372362090 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91240afca0 0x7f91240c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.896+0000 7f912a000640 1 --2- 172.21.15.5:0/3372362090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91241589a0 0x7f9124154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.896+0000 7f9129600640 1 -- 172.21.15.5:0/3372362090 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91240afca0 msgr2=0x7f91240c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.896+0000 7f9129600640 1 --2- 172.21.15.5:0/3372362090 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91240afca0 0x7f91240c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.896+0000 7f9129600640 1 -- 172.21.15.5:0/3372362090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91241589a0 msgr2=0x7f9124154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.896+0000 7f9129600640 1 --2- 172.21.15.5:0/3372362090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91241589a0 0x7f9124154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.896+0000 7f9129600640 1 -- 172.21.15.5:0/3372362090 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c00bcf0 con 0x7f91240acf10 2024-08-17T02:24:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.896+0000 7f9129600640 1 --2- 172.21.15.5:0/3372362090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91240acf10 0x7f912415a620 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f911800ea50 tx=0x7f91180090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:03.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.896+0000 7f9120c00640 1 -- 172.21.15.5:0/3372362090 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911800ca10 con 0x7f91240acf10 2024-08-17T02:24:03.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.897+0000 7f9120c00640 1 -- 172.21.15.5:0/3372362090 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911800cb70 con 0x7f91240acf10 2024-08-17T02:24:03.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.897+0000 7f9120c00640 1 -- 172.21.15.5:0/3372362090 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118013470 con 0x7f91240acf10 2024-08-17T02:24:03.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.897+0000 7f912c000640 1 -- 172.21.15.5:0/3372362090 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91241549d0 con 0x7f91240acf10 2024-08-17T02:24:03.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.897+0000 7f912c000640 1 -- 172.21.15.5:0/3372362090 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91240c4d90 con 0x7f91240acf10 2024-08-17T02:24:03.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.898+0000 7f912c000640 1 -- 172.21.15.5:0/3372362090 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91240c4bf0 con 0x7f91240acf10 2024-08-17T02:24:03.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.899+0000 7f9120c00640 1 -- 172.21.15.5:0/3372362090 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9118013860 con 0x7f91240acf10 2024-08-17T02:24:03.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.899+0000 7f9120c00640 1 --2- 172.21.15.5:0/3372362090 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9104065180 0x7f9104067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:03.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.899+0000 7f9120c00640 1 -- 172.21.15.5:0/3372362090 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91180826d0 con 0x7f91240acf10 2024-08-17T02:24:03.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.900+0000 7f9128c00640 1 --2- 172.21.15.5:0/3372362090 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9104065180 0x7f9104067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:03.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.900+0000 7f9128c00640 1 --2- 172.21.15.5:0/3372362090 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9104065180 0x7f9104067630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f91240c8ef0 tx=0x7f9110008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:03.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:03.903+0000 7f9120c00640 1 -- 172.21.15.5:0/3372362090 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f91240c4bf0 con 0x7f91240acf10 2024-08-17T02:24:04.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.086+0000 7f912c000640 1 -- 172.21.15.5:0/3372362090 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91240c4bf0 con 0x7f91240acf10 2024-08-17T02:24:04.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.087+0000 7f9120c00640 1 -- 172.21.15.5:0/3372362090 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f91240c4bf0 con 0x7f91240acf10 2024-08-17T02:24:04.087 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:04.087 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:36.575545+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:32.642845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:33.982937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:04.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.089+0000 7f912c000640 1 -- 172.21.15.5:0/3372362090 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9104065180 msgr2=0x7f9104067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.089+0000 7f912c000640 1 --2- 172.21.15.5:0/3372362090 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9104065180 0x7f9104067630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f91240c8ef0 tx=0x7f9110008040 comp rx=0 tx=0).stop 2024-08-17T02:24:04.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.089+0000 7f912c000640 1 -- 172.21.15.5:0/3372362090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91240acf10 msgr2=0x7f912415a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.089+0000 7f912c000640 1 --2- 172.21.15.5:0/3372362090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91240acf10 0x7f912415a620 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f911800ea50 tx=0x7f91180090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.089+0000 7f912c000640 1 -- 172.21.15.5:0/3372362090 shutdown_connections 2024-08-17T02:24:04.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.089+0000 7f912c000640 1 --2- 172.21.15.5:0/3372362090 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9104065180 0x7f9104067630 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.089+0000 7f912c000640 1 --2- 172.21.15.5:0/3372362090 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91240afca0 0x7f91240c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.089+0000 7f912c000640 1 --2- 172.21.15.5:0/3372362090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91241589a0 0x7f9124154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.089+0000 7f912c000640 1 --2- 172.21.15.5:0/3372362090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91240acf10 0x7f912415a620 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.089+0000 7f912c000640 1 -- 172.21.15.5:0/3372362090 >> 172.21.15.5:0/3372362090 conn(0x7f9124066e60 msgr2=0x7f91240ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:04.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.089+0000 7f912c000640 1 -- 172.21.15.5:0/3372362090 shutdown_connections 2024-08-17T02:24:04.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.089+0000 7f912c000640 1 -- 172.21.15.5:0/3372362090 wait complete. 2024-08-17T02:24:04.104 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:28.773677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:23:32.642845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:23:33.982937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:24:04.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.259+0000 7f14daa00640 1 Processor -- start 2024-08-17T02:24:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.260+0000 7f14daa00640 1 -- start start 2024-08-17T02:24:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.261+0000 7f14daa00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f14d4158e60 0x7f14d40add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.261+0000 7f14daa00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d40ae860 0x7f14d40ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.261+0000 7f14daa00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d40ad8a0 con 0x7f14d40b03b0 2024-08-17T02:24:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.261+0000 7f14daa00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d406edf0 con 0x7f14d4158e60 2024-08-17T02:24:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.261+0000 7f14daa00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d40acc90 con 0x7f14d40ae860 2024-08-17T02:24:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.261+0000 7f14d8a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f14d40b03b0 0x7f14d4159610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47442/0 (socket says 172.21.15.5:47442) 2024-08-17T02:24:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.261+0000 7f14d8a00640 1 -- 172.21.15.5:0/434027272 learned_addr learned my addr 172.21.15.5:0/434027272 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.261+0000 7f14d3400640 1 --2- 172.21.15.5:0/434027272 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d40ae860 0x7f14d40ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.261+0000 7f14d3e00640 1 --2- 172.21.15.5:0/434027272 >> v2:172.21.15.87:3300/0 conn(0x7f14d4158e60 0x7f14d40add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.262+0000 7f14d2a00640 1 -- 172.21.15.5:0/434027272 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418466138 0 0) 0x7f14d40ad8a0 con 0x7f14d40b03b0 2024-08-17T02:24:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.262+0000 7f14d3400640 1 -- 172.21.15.5:0/434027272 >> v2:172.21.15.87:3300/0 conn(0x7f14d4158e60 msgr2=0x7f14d40add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.262+0000 7f14d3400640 1 --2- 172.21.15.5:0/434027272 >> v2:172.21.15.87:3300/0 conn(0x7f14d4158e60 0x7f14d40add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.262+0000 7f14d3400640 1 -- 172.21.15.5:0/434027272 >> v1:172.21.15.5:6789/0 conn(0x7f14d40b03b0 legacy=0x7f14d4159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.262+0000 7f14d3400640 1 -- 172.21.15.5:0/434027272 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d40acf70 con 0x7f14d40ae860 2024-08-17T02:24:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.263+0000 7f14d3400640 1 --2- 172.21.15.5:0/434027272 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d40ae860 0x7f14d40ac5d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009850 tx=0x7f14c00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f41c96ed318badc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.263+0000 7f14d2a00640 1 -- 172.21.15.5:0/434027272 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0034440 con 0x7f14d40ae860 2024-08-17T02:24:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.263+0000 7f14d2a00640 1 -- 172.21.15.5:0/434027272 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c00345a0 con 0x7f14d40ae860 2024-08-17T02:24:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.263+0000 7f14d2a00640 1 -- 172.21.15.5:0/434027272 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0034940 con 0x7f14d40ae860 2024-08-17T02:24:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.264+0000 7f14daa00640 1 -- 172.21.15.5:0/434027272 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d40ae860 msgr2=0x7f14d40ac5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.264+0000 7f14daa00640 1 --2- 172.21.15.5:0/434027272 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d40ae860 0x7f14d40ac5d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009850 tx=0x7f14c00090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.264+0000 7f14daa00640 1 -- 172.21.15.5:0/434027272 shutdown_connections 2024-08-17T02:24:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.264+0000 7f14daa00640 1 --2- 172.21.15.5:0/434027272 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d40ae860 0x7f14d40ac5d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.264+0000 7f14daa00640 1 --2- 172.21.15.5:0/434027272 >> v2:172.21.15.87:3300/0 conn(0x7f14d4158e60 0x7f14d40add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.264+0000 7f14daa00640 1 -- 172.21.15.5:0/434027272 >> 172.21.15.5:0/434027272 conn(0x7f14d40cc390 msgr2=0x7f14d4066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.264+0000 7f14daa00640 1 -- 172.21.15.5:0/434027272 shutdown_connections 2024-08-17T02:24:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.264+0000 7f14daa00640 1 -- 172.21.15.5:0/434027272 wait complete. 2024-08-17T02:24:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.266+0000 7f14daa00640 1 Processor -- start 2024-08-17T02:24:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.266+0000 7f14daa00640 1 -- start start 2024-08-17T02:24:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.267+0000 7f14daa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d40ae860 0x7f14d40c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.267+0000 7f14daa00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d40b03b0 0x7f14d40a8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.267+0000 7f14daa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d4158e60 0x7f14d4069920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.267+0000 7f14daa00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d40ca120 con 0x7f14d4158e60 2024-08-17T02:24:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.267+0000 7f14daa00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d40cac60 con 0x7f14d40ae860 2024-08-17T02:24:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.267+0000 7f14daa00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d40ca330 con 0x7f14d40b03b0 2024-08-17T02:24:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.267+0000 7f14d8a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d4158e60 0x7f14d4069920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.267+0000 7f14d8a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d4158e60 0x7f14d4069920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34724/0 (socket says 172.21.15.5:34724) 2024-08-17T02:24:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.267+0000 7f14d8a00640 1 -- 172.21.15.5:0/1982051637 learned_addr learned my addr 172.21.15.5:0/1982051637 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.267+0000 7f14d3400640 1 --2- 172.21.15.5:0/1982051637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d40b03b0 0x7f14d40a8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.267+0000 7f14d3e00640 1 --2- 172.21.15.5:0/1982051637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d40ae860 0x7f14d40c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.267+0000 7f14d8a00640 1 -- 172.21.15.5:0/1982051637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d40b03b0 msgr2=0x7f14d40a8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.267+0000 7f14d8a00640 1 --2- 172.21.15.5:0/1982051637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d40b03b0 0x7f14d40a8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.267+0000 7f14d8a00640 1 -- 172.21.15.5:0/1982051637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d40ae860 msgr2=0x7f14d40c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.267+0000 7f14d8a00640 1 --2- 172.21.15.5:0/1982051637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d40ae860 0x7f14d40c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.267+0000 7f14d8a00640 1 -- 172.21.15.5:0/1982051637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c0009390 con 0x7f14d4158e60 2024-08-17T02:24:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.268+0000 7f14d8a00640 1 --2- 172.21.15.5:0/1982051637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d4158e60 0x7f14d4069920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00cc90 tx=0x7f14cc001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.268+0000 7f14cb400640 1 -- 172.21.15.5:0/1982051637 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc00a850 con 0x7f14d4158e60 2024-08-17T02:24:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.268+0000 7f14cb400640 1 -- 172.21.15.5:0/1982051637 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc00a9b0 con 0x7f14d4158e60 2024-08-17T02:24:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.268+0000 7f14cb400640 1 -- 172.21.15.5:0/1982051637 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc00ad70 con 0x7f14d4158e60 2024-08-17T02:24:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.268+0000 7f14daa00640 1 -- 172.21.15.5:0/1982051637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d40ca610 con 0x7f14d4158e60 2024-08-17T02:24:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.268+0000 7f14daa00640 1 -- 172.21.15.5:0/1982051637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d40c7370 con 0x7f14d4158e60 2024-08-17T02:24:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.269+0000 7f14daa00640 1 -- 172.21.15.5:0/1982051637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d40cadf0 con 0x7f14d4158e60 2024-08-17T02:24:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.270+0000 7f14cb400640 1 -- 172.21.15.5:0/1982051637 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f14cc007300 con 0x7f14d4158e60 2024-08-17T02:24:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.271+0000 7f14cb400640 1 --2- 172.21.15.5:0/1982051637 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14b4065150 0x7f14b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.271+0000 7f14cb400640 1 -- 172.21.15.5:0/1982051637 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14cc0824f0 con 0x7f14d4158e60 2024-08-17T02:24:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.271+0000 7f14d3e00640 1 --2- 172.21.15.5:0/1982051637 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14b4065150 0x7f14b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.272+0000 7f14d3e00640 1 --2- 172.21.15.5:0/1982051637 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14b4065150 0x7f14b4067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f14d4150730 tx=0x7f14c40090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:04.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.275+0000 7f14cb400640 1 -- 172.21.15.5:0/1982051637 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f14cc050700 con 0x7f14d4158e60 2024-08-17T02:24:04.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.458+0000 7f14daa00640 1 -- 172.21.15.5:0/1982051637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14d4063fb0 con 0x7f14d4158e60 2024-08-17T02:24:04.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.458+0000 7f14cb400640 1 -- 172.21.15.5:0/1982051637 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f14cc053d20 con 0x7f14d4158e60 2024-08-17T02:24:04.459 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:24:04.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.460+0000 7f14daa00640 1 -- 172.21.15.5:0/1982051637 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14b4065150 msgr2=0x7f14b4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.460+0000 7f14daa00640 1 --2- 172.21.15.5:0/1982051637 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14b4065150 0x7f14b4067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f14d4150730 tx=0x7f14c40090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.460+0000 7f14daa00640 1 -- 172.21.15.5:0/1982051637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d4158e60 msgr2=0x7f14d4069920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.460+0000 7f14daa00640 1 --2- 172.21.15.5:0/1982051637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d4158e60 0x7f14d4069920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00cc90 tx=0x7f14cc001a20 comp rx=0 tx=0).stop 2024-08-17T02:24:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.461+0000 7f14daa00640 1 -- 172.21.15.5:0/1982051637 shutdown_connections 2024-08-17T02:24:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.461+0000 7f14daa00640 1 --2- 172.21.15.5:0/1982051637 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14b4065150 0x7f14b4067600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.461+0000 7f14daa00640 1 --2- 172.21.15.5:0/1982051637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14d40b03b0 0x7f14d40a8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.461+0000 7f14daa00640 1 --2- 172.21.15.5:0/1982051637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d4158e60 0x7f14d4069920 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.461+0000 7f14daa00640 1 --2- 172.21.15.5:0/1982051637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d40ae860 0x7f14d40c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.461+0000 7f14daa00640 1 -- 172.21.15.5:0/1982051637 >> 172.21.15.5:0/1982051637 conn(0x7f14d40cc390 msgr2=0x7f14d4150900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:04.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.461+0000 7f14daa00640 1 -- 172.21.15.5:0/1982051637 shutdown_connections 2024-08-17T02:24:04.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.461+0000 7f14daa00640 1 -- 172.21.15.5:0/1982051637 wait complete. 2024-08-17T02:24:04.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:24:04.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.628+0000 7ff323600640 1 Processor -- start 2024-08-17T02:24:04.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.628+0000 7ff323600640 1 -- start start 2024-08-17T02:24:04.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.629+0000 7ff323600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff31c0ad960 0x7ff31c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.629+0000 7ff323600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31c15b5e0 con 0x7ff31c0add30 2024-08-17T02:24:04.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.629+0000 7ff323600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31c0cb160 con 0x7ff31c0ca050 2024-08-17T02:24:04.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.629+0000 7ff323600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff31c0b0d10 con 0x7ff31c0ad960 2024-08-17T02:24:04.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.629+0000 7ff320c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff31c0ad960 0x7ff31c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.629+0000 7ff320c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff31c0ad960 0x7ff31c15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34726/0 (socket says 172.21.15.5:34726) 2024-08-17T02:24:04.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.629+0000 7ff320c00640 1 -- 172.21.15.5:0/525662875 learned_addr learned my addr 172.21.15.5:0/525662875 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:04.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.629+0000 7ff321600640 1 --1- 172.21.15.5:0/525662875 >> v1:172.21.15.5:6789/0 conn(0x7ff31c0add30 0x7ff31c0aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47450/0 (socket says 172.21.15.5:47450) 2024-08-17T02:24:04.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.630+0000 7ff320c00640 1 -- 172.21.15.5:0/525662875 >> v1:172.21.15.87:6789/0 conn(0x7ff31c0ca050 legacy=0x7ff31c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.630+0000 7ff320c00640 1 -- 172.21.15.5:0/525662875 >> v1:172.21.15.5:6789/0 conn(0x7ff31c0add30 legacy=0x7ff31c0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.630+0000 7ff320c00640 1 -- 172.21.15.5:0/525662875 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c0ca550 con 0x7ff31c0ad960 2024-08-17T02:24:04.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.630+0000 7ff31b400640 1 -- 172.21.15.5:0/525662875 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2805267673 0 0) 0x7ff314001490 con 0x7ff31c0add30 2024-08-17T02:24:04.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.631+0000 7ff320c00640 1 --2- 172.21.15.5:0/525662875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff31c0ad960 0x7ff31c15b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff310009910 tx=0x7ff3100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b3eaefa53c3394 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:04.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.631+0000 7ff31b400640 1 -- 172.21.15.5:0/525662875 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31002f510 con 0x7ff31c0ad960 2024-08-17T02:24:04.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.631+0000 7ff31b400640 1 -- 172.21.15.5:0/525662875 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31002d050 con 0x7ff31c0ad960 2024-08-17T02:24:04.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.631+0000 7ff31b400640 1 -- 172.21.15.5:0/525662875 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31002f8a0 con 0x7ff31c0ad960 2024-08-17T02:24:04.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.632+0000 7ff323600640 1 -- 172.21.15.5:0/525662875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff31c0ad960 msgr2=0x7ff31c15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.632+0000 7ff323600640 1 --2- 172.21.15.5:0/525662875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff31c0ad960 0x7ff31c15b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff310009910 tx=0x7ff3100091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.632+0000 7ff323600640 1 -- 172.21.15.5:0/525662875 shutdown_connections 2024-08-17T02:24:04.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.632+0000 7ff323600640 1 --2- 172.21.15.5:0/525662875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff31c0ad960 0x7ff31c15b0a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.632+0000 7ff323600640 1 -- 172.21.15.5:0/525662875 >> 172.21.15.5:0/525662875 conn(0x7ff31c066e60 msgr2=0x7ff31c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:04.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.632+0000 7ff323600640 1 -- 172.21.15.5:0/525662875 shutdown_connections 2024-08-17T02:24:04.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.632+0000 7ff323600640 1 -- 172.21.15.5:0/525662875 wait complete. 2024-08-17T02:24:04.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.633+0000 7ff323600640 1 Processor -- start 2024-08-17T02:24:04.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.633+0000 7ff323600640 1 -- start start 2024-08-17T02:24:04.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.634+0000 7ff323600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff31c0ad960 0x7ff31c141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.634+0000 7ff323600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff31c0add30 0x7ff31c06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.634+0000 7ff323600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff31c0ca050 0x7ff31c06dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.634+0000 7ff323600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c1448f0 con 0x7ff31c0ca050 2024-08-17T02:24:04.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.634+0000 7ff323600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c144bd0 con 0x7ff31c0ad960 2024-08-17T02:24:04.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.634+0000 7ff323600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c144eb0 con 0x7ff31c0add30 2024-08-17T02:24:04.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.634+0000 7ff321600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff31c0ca050 0x7ff31c06dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.635+0000 7ff321600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff31c0ca050 0x7ff31c06dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34734/0 (socket says 172.21.15.5:34734) 2024-08-17T02:24:04.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.635+0000 7ff321600640 1 -- 172.21.15.5:0/4142460086 learned_addr learned my addr 172.21.15.5:0/4142460086 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:04.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.635+0000 7ff320c00640 1 --2- 172.21.15.5:0/4142460086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff31c0ad960 0x7ff31c141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.635+0000 7ff31be00640 1 --2- 172.21.15.5:0/4142460086 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff31c0add30 0x7ff31c06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.635+0000 7ff321600640 1 -- 172.21.15.5:0/4142460086 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff31c0add30 msgr2=0x7ff31c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.635+0000 7ff321600640 1 --2- 172.21.15.5:0/4142460086 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff31c0add30 0x7ff31c06d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.635+0000 7ff321600640 1 -- 172.21.15.5:0/4142460086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff31c0ad960 msgr2=0x7ff31c141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.635+0000 7ff321600640 1 --2- 172.21.15.5:0/4142460086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff31c0ad960 0x7ff31c141ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.635+0000 7ff321600640 1 -- 172.21.15.5:0/4142460086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff310009450 con 0x7ff31c0ca050 2024-08-17T02:24:04.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.635+0000 7ff31be00640 1 --2- 172.21.15.5:0/4142460086 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff31c0add30 0x7ff31c06d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:04.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.635+0000 7ff320c00640 1 --2- 172.21.15.5:0/4142460086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff31c0ad960 0x7ff31c141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:04.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.635+0000 7ff321600640 1 --2- 172.21.15.5:0/4142460086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff31c0ca050 0x7ff31c06dd10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff31400c880 tx=0x7ff314007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:04.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.635+0000 7ff30fe00640 1 -- 172.21.15.5:0/4142460086 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31400ce70 con 0x7ff31c0ca050 2024-08-17T02:24:04.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.635+0000 7ff30fe00640 1 -- 172.21.15.5:0/4142460086 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff314005d60 con 0x7ff31c0ca050 2024-08-17T02:24:04.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.635+0000 7ff30fe00640 1 -- 172.21.15.5:0/4142460086 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31400a8b0 con 0x7ff31c0ca050 2024-08-17T02:24:04.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.636+0000 7ff323600640 1 -- 172.21.15.5:0/4142460086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31c145190 con 0x7ff31c0ca050 2024-08-17T02:24:04.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.636+0000 7ff323600640 1 -- 172.21.15.5:0/4142460086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31c142220 con 0x7ff31c0ca050 2024-08-17T02:24:04.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.637+0000 7ff323600640 1 -- 172.21.15.5:0/4142460086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31c145610 con 0x7ff31c0ca050 2024-08-17T02:24:04.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.637+0000 7ff30fe00640 1 -- 172.21.15.5:0/4142460086 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff31400aca0 con 0x7ff31c0ca050 2024-08-17T02:24:04.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.638+0000 7ff30fe00640 1 --2- 172.21.15.5:0/4142460086 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff2fc065150 0x7ff2fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.638+0000 7ff30fe00640 1 -- 172.21.15.5:0/4142460086 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff3140820b0 con 0x7ff31c0ca050 2024-08-17T02:24:04.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.639+0000 7ff320c00640 1 --2- 172.21.15.5:0/4142460086 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff2fc065150 0x7ff2fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.639+0000 7ff320c00640 1 --2- 172.21.15.5:0/4142460086 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff2fc065150 0x7ff2fc067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff310034000 tx=0x7ff310035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:04.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.642+0000 7ff30fe00640 1 -- 172.21.15.5:0/4142460086 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff314050150 con 0x7ff31c0ca050 2024-08-17T02:24:04.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.823+0000 7ff323600640 1 -- 172.21.15.5:0/4142460086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff31c15b5e0 con 0x7ff31c0ca050 2024-08-17T02:24:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.823+0000 7ff30fe00640 1 -- 172.21.15.5:0/4142460086 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff31c15b5e0 con 0x7ff31c0ca050 2024-08-17T02:24:04.824 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:24:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.825+0000 7ff323600640 1 -- 172.21.15.5:0/4142460086 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff2fc065150 msgr2=0x7ff2fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.825+0000 7ff323600640 1 --2- 172.21.15.5:0/4142460086 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff2fc065150 0x7ff2fc067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff310034000 tx=0x7ff310035000 comp rx=0 tx=0).stop 2024-08-17T02:24:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.825+0000 7ff323600640 1 -- 172.21.15.5:0/4142460086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff31c0ca050 msgr2=0x7ff31c06dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.825+0000 7ff323600640 1 --2- 172.21.15.5:0/4142460086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff31c0ca050 0x7ff31c06dd10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff31400c880 tx=0x7ff314007e80 comp rx=0 tx=0).stop 2024-08-17T02:24:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.826+0000 7ff323600640 1 -- 172.21.15.5:0/4142460086 shutdown_connections 2024-08-17T02:24:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.826+0000 7ff323600640 1 --2- 172.21.15.5:0/4142460086 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff2fc065150 0x7ff2fc067600 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.826+0000 7ff323600640 1 --2- 172.21.15.5:0/4142460086 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff31c0add30 0x7ff31c06d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.826+0000 7ff323600640 1 --2- 172.21.15.5:0/4142460086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff31c0ca050 0x7ff31c06dd10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.826+0000 7ff323600640 1 --2- 172.21.15.5:0/4142460086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff31c0ad960 0x7ff31c141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.826+0000 7ff323600640 1 -- 172.21.15.5:0/4142460086 >> 172.21.15.5:0/4142460086 conn(0x7ff31c066e60 msgr2=0x7ff31c152510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.826+0000 7ff323600640 1 -- 172.21.15.5:0/4142460086 shutdown_connections 2024-08-17T02:24:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.826+0000 7ff323600640 1 -- 172.21.15.5:0/4142460086 wait complete. 2024-08-17T02:24:04.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:04.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.995+0000 7fcf25c00640 1 Processor -- start 2024-08-17T02:24:04.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.995+0000 7fcf25c00640 1 -- start start 2024-08-17T02:24:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.996+0000 7fcf25c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf200afca0 0x7fcf200b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.996+0000 7fcf25c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf200acf10 0x7fcf20159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.996+0000 7fcf25c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcf201589a0 0x7fcf20158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.996+0000 7fcf25c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf200b0980 con 0x7fcf200afca0 2024-08-17T02:24:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.996+0000 7fcf25c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2015a4e0 con 0x7fcf201589a0 2024-08-17T02:24:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.996+0000 7fcf25c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf200c92b0 con 0x7fcf200acf10 2024-08-17T02:24:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.996+0000 7fcf1ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf200afca0 0x7fcf200b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.996+0000 7fcf1ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf200afca0 0x7fcf200b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34750/0 (socket says 172.21.15.5:34750) 2024-08-17T02:24:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.996+0000 7fcf1ea00640 1 -- 172.21.15.5:0/993410142 learned_addr learned my addr 172.21.15.5:0/993410142 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.996+0000 7fcf17e00640 1 --2- 172.21.15.5:0/993410142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf200acf10 0x7fcf20159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.996+0000 7fcf1f400640 1 --2- 172.21.15.5:0/993410142 >> v2:172.21.15.87:3300/0 conn(0x7fcf201589a0 0x7fcf20158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.997+0000 7fcf1ea00640 1 -- 172.21.15.5:0/993410142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf200acf10 msgr2=0x7fcf20159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.997+0000 7fcf1ea00640 1 --2- 172.21.15.5:0/993410142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf200acf10 0x7fcf20159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.997+0000 7fcf1ea00640 1 -- 172.21.15.5:0/993410142 >> v2:172.21.15.87:3300/0 conn(0x7fcf201589a0 msgr2=0x7fcf20158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.997+0000 7fcf1ea00640 1 --2- 172.21.15.5:0/993410142 >> v2:172.21.15.87:3300/0 conn(0x7fcf201589a0 0x7fcf20158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.997+0000 7fcf1ea00640 1 -- 172.21.15.5:0/993410142 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf20159360 con 0x7fcf200afca0 2024-08-17T02:24:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.998+0000 7fcf1ea00640 1 --2- 172.21.15.5:0/993410142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf200afca0 0x7fcf200b0070 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000bbc0 tx=0x7fcf1000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99aa57b1161f5554 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:04.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.998+0000 7fcf1e000640 1 -- 172.21.15.5:0/993410142 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10032620 con 0x7fcf200afca0 2024-08-17T02:24:04.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.998+0000 7fcf1e000640 1 -- 172.21.15.5:0/993410142 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1002e040 con 0x7fcf200afca0 2024-08-17T02:24:05.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.998+0000 7fcf1e000640 1 -- 172.21.15.5:0/993410142 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf100329f0 con 0x7fcf200afca0 2024-08-17T02:24:05.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.998+0000 7fcf25c00640 1 -- 172.21.15.5:0/993410142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf200afca0 msgr2=0x7fcf200b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.998+0000 7fcf25c00640 1 --2- 172.21.15.5:0/993410142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf200afca0 0x7fcf200b0070 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000bbc0 tx=0x7fcf1000b460 comp rx=0 tx=0).stop 2024-08-17T02:24:05.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.999+0000 7fcf25c00640 1 -- 172.21.15.5:0/993410142 shutdown_connections 2024-08-17T02:24:05.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.999+0000 7fcf25c00640 1 --2- 172.21.15.5:0/993410142 >> v2:172.21.15.87:3300/0 conn(0x7fcf201589a0 0x7fcf20158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.999+0000 7fcf25c00640 1 --2- 172.21.15.5:0/993410142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf200acf10 0x7fcf20159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.999+0000 7fcf25c00640 1 --2- 172.21.15.5:0/993410142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf200afca0 0x7fcf200b0070 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.999+0000 7fcf25c00640 1 -- 172.21.15.5:0/993410142 >> 172.21.15.5:0/993410142 conn(0x7fcf20066e60 msgr2=0x7fcf20067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:05.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.999+0000 7fcf25c00640 1 -- 172.21.15.5:0/993410142 shutdown_connections 2024-08-17T02:24:05.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:04.999+0000 7fcf25c00640 1 -- 172.21.15.5:0/993410142 wait complete. 2024-08-17T02:24:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.000+0000 7fcf25c00640 1 Processor -- start 2024-08-17T02:24:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.000+0000 7fcf25c00640 1 -- start start 2024-08-17T02:24:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.001+0000 7fcf25c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf200acf10 0x7fcf200c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.001+0000 7fcf25c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf200afca0 0x7fcf20147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.001+0000 7fcf25c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf201589a0 0x7fcf200c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.001+0000 7fcf25c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf200c54f0 con 0x7fcf200afca0 2024-08-17T02:24:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.001+0000 7fcf25c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf200c57d0 con 0x7fcf201589a0 2024-08-17T02:24:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.001+0000 7fcf25c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf200c5ab0 con 0x7fcf200acf10 2024-08-17T02:24:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.001+0000 7fcf17e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf200afca0 0x7fcf20147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.001+0000 7fcf17e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf200afca0 0x7fcf20147660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34766/0 (socket says 172.21.15.5:34766) 2024-08-17T02:24:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.001+0000 7fcf17e00640 1 -- 172.21.15.5:0/1898572635 learned_addr learned my addr 172.21.15.5:0/1898572635 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.002+0000 7fcf1ea00640 1 --2- 172.21.15.5:0/1898572635 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf200acf10 0x7fcf200c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.002+0000 7fcf1f400640 1 --2- 172.21.15.5:0/1898572635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf201589a0 0x7fcf200c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.002+0000 7fcf17e00640 1 -- 172.21.15.5:0/1898572635 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf200acf10 msgr2=0x7fcf200c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.002+0000 7fcf17e00640 1 --2- 172.21.15.5:0/1898572635 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf200acf10 0x7fcf200c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.002+0000 7fcf17e00640 1 -- 172.21.15.5:0/1898572635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf201589a0 msgr2=0x7fcf200c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.002+0000 7fcf17e00640 1 --2- 172.21.15.5:0/1898572635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf201589a0 0x7fcf200c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.002+0000 7fcf17e00640 1 -- 172.21.15.5:0/1898572635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1000b700 con 0x7fcf200afca0 2024-08-17T02:24:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.002+0000 7fcf1f400640 1 --2- 172.21.15.5:0/1898572635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf201589a0 0x7fcf200c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.002+0000 7fcf17e00640 1 --2- 172.21.15.5:0/1898572635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf200afca0 0x7fcf20147660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800d890 tx=0x7fcf08008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.002+0000 7fcf16000640 1 -- 172.21.15.5:0/1898572635 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0800de20 con 0x7fcf200afca0 2024-08-17T02:24:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.002+0000 7fcf16000640 1 -- 172.21.15.5:0/1898572635 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf080098b0 con 0x7fcf200afca0 2024-08-17T02:24:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.002+0000 7fcf16000640 1 -- 172.21.15.5:0/1898572635 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf08009c50 con 0x7fcf200afca0 2024-08-17T02:24:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.002+0000 7fcf25c00640 1 -- 172.21.15.5:0/1898572635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf200c5e90 con 0x7fcf200afca0 2024-08-17T02:24:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.003+0000 7fcf25c00640 1 -- 172.21.15.5:0/1898572635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf200c5130 con 0x7fcf200afca0 2024-08-17T02:24:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.004+0000 7fcf25c00640 1 -- 172.21.15.5:0/1898572635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf20063fb0 con 0x7fcf200afca0 2024-08-17T02:24:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.004+0000 7fcf16000640 1 -- 172.21.15.5:0/1898572635 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcf08014620 con 0x7fcf200afca0 2024-08-17T02:24:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.005+0000 7fcf16000640 1 --2- 172.21.15.5:0/1898572635 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcefc065150 0x7fcefc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.005+0000 7fcf16000640 1 -- 172.21.15.5:0/1898572635 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf08082c90 con 0x7fcf200afca0 2024-08-17T02:24:05.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.005+0000 7fcf1ea00640 1 --2- 172.21.15.5:0/1898572635 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcefc065150 0x7fcefc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.006+0000 7fcf1ea00640 1 --2- 172.21.15.5:0/1898572635 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcefc065150 0x7fcefc067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcf10037000 tx=0x7fcf1003a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:05.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.009+0000 7fcf16000640 1 -- 172.21.15.5:0/1898572635 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcf08050cb0 con 0x7fcf200afca0 2024-08-17T02:24:05.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.192+0000 7fcf25c00640 1 -- 172.21.15.5:0/1898572635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcf20067b70 con 0x7fcf200afca0 2024-08-17T02:24:05.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.192+0000 7fcf16000640 1 -- 172.21.15.5:0/1898572635 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcf080542d0 con 0x7fcf200afca0 2024-08-17T02:24:05.193 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-17T02:24:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.195+0000 7fcf25c00640 1 -- 172.21.15.5:0/1898572635 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcefc065150 msgr2=0x7fcefc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.195+0000 7fcf25c00640 1 --2- 172.21.15.5:0/1898572635 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcefc065150 0x7fcefc067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcf10037000 tx=0x7fcf1003a000 comp rx=0 tx=0).stop 2024-08-17T02:24:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.195+0000 7fcf25c00640 1 -- 172.21.15.5:0/1898572635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf200afca0 msgr2=0x7fcf20147660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.195+0000 7fcf25c00640 1 --2- 172.21.15.5:0/1898572635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf200afca0 0x7fcf20147660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800d890 tx=0x7fcf08008040 comp rx=0 tx=0).stop 2024-08-17T02:24:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.195+0000 7fcf25c00640 1 -- 172.21.15.5:0/1898572635 shutdown_connections 2024-08-17T02:24:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.195+0000 7fcf25c00640 1 --2- 172.21.15.5:0/1898572635 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcefc065150 0x7fcefc067600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.195+0000 7fcf25c00640 1 --2- 172.21.15.5:0/1898572635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf201589a0 0x7fcf200c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.195+0000 7fcf25c00640 1 --2- 172.21.15.5:0/1898572635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf200afca0 0x7fcf20147660 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.195+0000 7fcf25c00640 1 --2- 172.21.15.5:0/1898572635 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf200acf10 0x7fcf200c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.195+0000 7fcf25c00640 1 -- 172.21.15.5:0/1898572635 >> 172.21.15.5:0/1898572635 conn(0x7fcf20066e60 msgr2=0x7fcf201524c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.195+0000 7fcf25c00640 1 -- 172.21.15.5:0/1898572635 shutdown_connections 2024-08-17T02:24:05.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.195+0000 7fcf25c00640 1 -- 172.21.15.5:0/1898572635 wait complete. 2024-08-17T02:24:05.211 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:05.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.361+0000 7eff7d400640 1 Processor -- start 2024-08-17T02:24:05.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.361+0000 7eff7d400640 1 -- start start 2024-08-17T02:24:05.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.363+0000 7eff7d400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7eff780ca050 0x7eff78156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.363+0000 7eff7d400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff780add30 0x7eff7815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.363+0000 7eff7d400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7815b5e0 con 0x7eff780ad960 2024-08-17T02:24:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.363+0000 7eff7d400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff780cb160 con 0x7eff780add30 2024-08-17T02:24:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.363+0000 7eff7d400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff780b0d10 con 0x7eff780ca050 2024-08-17T02:24:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.363+0000 7eff76800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7eff780ad960 0x7eff78156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47452/0 (socket says 172.21.15.5:47452) 2024-08-17T02:24:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.363+0000 7eff76800640 1 -- 172.21.15.5:0/2788561421 learned_addr learned my addr 172.21.15.5:0/2788561421 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.363+0000 7eff77200640 1 --2- 172.21.15.5:0/2788561421 >> v2:172.21.15.5:3300/0 conn(0x7eff780add30 0x7eff7815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.363+0000 7eff6fe00640 1 --2- 172.21.15.5:0/2788561421 >> v2:172.21.15.87:3300/0 conn(0x7eff780ca050 0x7eff78156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.363+0000 7eff77200640 1 -- 172.21.15.5:0/2788561421 >> v2:172.21.15.87:3300/0 conn(0x7eff780ca050 msgr2=0x7eff78156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.363+0000 7eff77200640 1 --2- 172.21.15.5:0/2788561421 >> v2:172.21.15.87:3300/0 conn(0x7eff780ca050 0x7eff78156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.363+0000 7eff77200640 1 -- 172.21.15.5:0/2788561421 >> v1:172.21.15.5:6789/0 conn(0x7eff780ad960 legacy=0x7eff78156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.363+0000 7eff77200640 1 -- 172.21.15.5:0/2788561421 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff780ca550 con 0x7eff780add30 2024-08-17T02:24:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.363+0000 7eff75e00640 1 -- 172.21.15.5:0/2788561421 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731642489 0 0) 0x7eff68001110 con 0x7eff780ad960 2024-08-17T02:24:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.364+0000 7eff77200640 1 --2- 172.21.15.5:0/2788561421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff780add30 0x7eff7815b0a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7eff78063600 tx=0x7eff70009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff31c4643be60a74 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.365+0000 7eff75e00640 1 -- 172.21.15.5:0/2788561421 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70007550 con 0x7eff780add30 2024-08-17T02:24:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.365+0000 7eff75e00640 1 -- 172.21.15.5:0/2788561421 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7002d050 con 0x7eff780add30 2024-08-17T02:24:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.365+0000 7eff75e00640 1 -- 172.21.15.5:0/2788561421 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff700078e0 con 0x7eff780add30 2024-08-17T02:24:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.365+0000 7eff7d400640 1 -- 172.21.15.5:0/2788561421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff780add30 msgr2=0x7eff7815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.365+0000 7eff7d400640 1 --2- 172.21.15.5:0/2788561421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff780add30 0x7eff7815b0a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7eff78063600 tx=0x7eff70009780 comp rx=0 tx=0).stop 2024-08-17T02:24:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.365+0000 7eff7d400640 1 -- 172.21.15.5:0/2788561421 shutdown_connections 2024-08-17T02:24:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.365+0000 7eff7d400640 1 --2- 172.21.15.5:0/2788561421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff780add30 0x7eff7815b0a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.365+0000 7eff7d400640 1 --2- 172.21.15.5:0/2788561421 >> v2:172.21.15.87:3300/0 conn(0x7eff780ca050 0x7eff78156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.365+0000 7eff7d400640 1 -- 172.21.15.5:0/2788561421 >> 172.21.15.5:0/2788561421 conn(0x7eff78066e60 msgr2=0x7eff78067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.365+0000 7eff7d400640 1 -- 172.21.15.5:0/2788561421 shutdown_connections 2024-08-17T02:24:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.365+0000 7eff7d400640 1 -- 172.21.15.5:0/2788561421 wait complete. 2024-08-17T02:24:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.367+0000 7eff7d400640 1 Processor -- start 2024-08-17T02:24:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.367+0000 7eff7d400640 1 -- start start 2024-08-17T02:24:05.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.368+0000 7eff7d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff780ad960 0x7eff78158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.368+0000 7eff7d400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff780add30 0x7eff781693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.368+0000 7eff7d400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff780ca050 0x7eff78169930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.368+0000 7eff7d400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff781537f0 con 0x7eff780ad960 2024-08-17T02:24:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.368+0000 7eff7d400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff78152b70 con 0x7eff780add30 2024-08-17T02:24:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.368+0000 7eff7d400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff78152e50 con 0x7eff780ca050 2024-08-17T02:24:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.368+0000 7eff76800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff780ad960 0x7eff78158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.368+0000 7eff76800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff780ad960 0x7eff78158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34784/0 (socket says 172.21.15.5:34784) 2024-08-17T02:24:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.368+0000 7eff76800640 1 -- 172.21.15.5:0/900421583 learned_addr learned my addr 172.21.15.5:0/900421583 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.368+0000 7eff76800640 1 -- 172.21.15.5:0/900421583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff780ca050 msgr2=0x7eff78169930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.368+0000 7eff76800640 1 --2- 172.21.15.5:0/900421583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff780ca050 0x7eff78169930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.368+0000 7eff76800640 1 -- 172.21.15.5:0/900421583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff780add30 msgr2=0x7eff781693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.368+0000 7eff76800640 1 --2- 172.21.15.5:0/900421583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff780add30 0x7eff781693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.368+0000 7eff76800640 1 -- 172.21.15.5:0/900421583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff70009a20 con 0x7eff780ad960 2024-08-17T02:24:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.369+0000 7eff76800640 1 --2- 172.21.15.5:0/900421583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff780ad960 0x7eff78158300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7eff6800c510 tx=0x7eff6800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.369+0000 7eff6e000640 1 -- 172.21.15.5:0/900421583 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff68005aa0 con 0x7eff780ad960 2024-08-17T02:24:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.369+0000 7eff6e000640 1 -- 172.21.15.5:0/900421583 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff68005c00 con 0x7eff780ad960 2024-08-17T02:24:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.369+0000 7eff6e000640 1 -- 172.21.15.5:0/900421583 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff680070d0 con 0x7eff780ad960 2024-08-17T02:24:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.369+0000 7eff7d400640 1 -- 172.21.15.5:0/900421583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff78153130 con 0x7eff780ad960 2024-08-17T02:24:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.369+0000 7eff7d400640 1 -- 172.21.15.5:0/900421583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff78152100 con 0x7eff780ad960 2024-08-17T02:24:05.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.370+0000 7eff7d400640 1 -- 172.21.15.5:0/900421583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff78153930 con 0x7eff780ad960 2024-08-17T02:24:05.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.371+0000 7eff6e000640 1 -- 172.21.15.5:0/900421583 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7eff68007500 con 0x7eff780ad960 2024-08-17T02:24:05.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.372+0000 7eff6e000640 1 --2- 172.21.15.5:0/900421583 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7eff54065150 0x7eff54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.372+0000 7eff6e000640 1 -- 172.21.15.5:0/900421583 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff680818b0 con 0x7eff780ad960 2024-08-17T02:24:05.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.372+0000 7eff6fe00640 1 --2- 172.21.15.5:0/900421583 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7eff54065150 0x7eff54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.373+0000 7eff6fe00640 1 --2- 172.21.15.5:0/900421583 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7eff54065150 0x7eff54067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7eff60009b20 tx=0x7eff600090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:05.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.375+0000 7eff6e000640 1 -- 172.21.15.5:0/900421583 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7eff6804f990 con 0x7eff780ad960 2024-08-17T02:24:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.557+0000 7eff7d400640 1 -- 172.21.15.5:0/900421583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff7815b5e0 con 0x7eff780ad960 2024-08-17T02:24:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.558+0000 7eff6e000640 1 -- 172.21.15.5:0/900421583 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15254 (secure 0 0 0) 0x7eff7815b5e0 con 0x7eff780ad960 2024-08-17T02:24:05.559 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:05.559 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:36.575545+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:32.642845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:33.982937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.560+0000 7eff7d400640 1 -- 172.21.15.5:0/900421583 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7eff54065150 msgr2=0x7eff54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.560+0000 7eff7d400640 1 --2- 172.21.15.5:0/900421583 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7eff54065150 0x7eff54067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7eff60009b20 tx=0x7eff600090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.560+0000 7eff7d400640 1 -- 172.21.15.5:0/900421583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff780ad960 msgr2=0x7eff78158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.560+0000 7eff7d400640 1 --2- 172.21.15.5:0/900421583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff780ad960 0x7eff78158300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7eff6800c510 tx=0x7eff6800c910 comp rx=0 tx=0).stop 2024-08-17T02:24:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.560+0000 7eff7d400640 1 -- 172.21.15.5:0/900421583 shutdown_connections 2024-08-17T02:24:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.560+0000 7eff7d400640 1 --2- 172.21.15.5:0/900421583 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7eff54065150 0x7eff54067600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.560+0000 7eff7d400640 1 --2- 172.21.15.5:0/900421583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff780ca050 0x7eff78169930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.560+0000 7eff7d400640 1 --2- 172.21.15.5:0/900421583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff780add30 0x7eff781693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.560+0000 7eff7d400640 1 --2- 172.21.15.5:0/900421583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff780ad960 0x7eff78158300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.560+0000 7eff7d400640 1 -- 172.21.15.5:0/900421583 >> 172.21.15.5:0/900421583 conn(0x7eff78066e60 msgr2=0x7eff7806d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.560+0000 7eff7d400640 1 -- 172.21.15.5:0/900421583 shutdown_connections 2024-08-17T02:24:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.561+0000 7eff7d400640 1 -- 172.21.15.5:0/900421583 wait complete. 2024-08-17T02:24:05.577 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:28.773677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:23:32.642845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:23:33.982937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:24:05.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.731+0000 7f950cc00640 1 Processor -- start 2024-08-17T02:24:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.732+0000 7f950cc00640 1 -- start start 2024-08-17T02:24:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.733+0000 7f950cc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f950814d780 0x7f950815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.733+0000 7f950cc00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95080ae060 con 0x7f95080b10e0 2024-08-17T02:24:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.733+0000 7f950cc00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95080c9ce0 con 0x7f950814db50 2024-08-17T02:24:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.733+0000 7f950cc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f950815b440 con 0x7f950814d780 2024-08-17T02:24:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.733+0000 7f9507400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f950814d780 0x7f950815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.733+0000 7f9507400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f950814d780 0x7f950815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34788/0 (socket says 172.21.15.5:34788) 2024-08-17T02:24:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.733+0000 7f9507400640 1 -- 172.21.15.5:0/4109952515 learned_addr learned my addr 172.21.15.5:0/4109952515 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.733+0000 7f9507e00640 1 --1- 172.21.15.5:0/4109952515 >> v1:172.21.15.5:6789/0 conn(0x7f95080b10e0 0x7f95080ca170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47468/0 (socket says 172.21.15.5:47468) 2024-08-17T02:24:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.734+0000 7f9507400640 1 -- 172.21.15.5:0/4109952515 >> v1:172.21.15.87:6789/0 conn(0x7f950814db50 legacy=0x7f95080b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.734+0000 7f9507400640 1 -- 172.21.15.5:0/4109952515 >> v1:172.21.15.5:6789/0 conn(0x7f95080b10e0 legacy=0x7f95080ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.734+0000 7f9506000640 1 -- 172.21.15.5:0/4109952515 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4179533948 0 0) 0x7f95080ae060 con 0x7f95080b10e0 2024-08-17T02:24:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.734+0000 7f9507400640 1 -- 172.21.15.5:0/4109952515 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95081574b0 con 0x7f950814d780 2024-08-17T02:24:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.735+0000 7f9507400640 1 --2- 172.21.15.5:0/4109952515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f950814d780 0x7f950815af00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009910 tx=0x7f94f80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481f25f7496faef9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.735+0000 7f9506000640 1 -- 172.21.15.5:0/4109952515 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f802ae60 con 0x7f950814d780 2024-08-17T02:24:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.735+0000 7f9506000640 1 -- 172.21.15.5:0/4109952515 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f8032440 con 0x7f950814d780 2024-08-17T02:24:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.735+0000 7f9506000640 1 -- 172.21.15.5:0/4109952515 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f80327e0 con 0x7f950814d780 2024-08-17T02:24:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.735+0000 7f950cc00640 1 -- 172.21.15.5:0/4109952515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f950814d780 msgr2=0x7f950815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.735+0000 7f950cc00640 1 --2- 172.21.15.5:0/4109952515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f950814d780 0x7f950815af00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009910 tx=0x7f94f80091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.736+0000 7f950cc00640 1 -- 172.21.15.5:0/4109952515 shutdown_connections 2024-08-17T02:24:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.736+0000 7f950cc00640 1 --2- 172.21.15.5:0/4109952515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f950814d780 0x7f950815af00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.736+0000 7f950cc00640 1 -- 172.21.15.5:0/4109952515 >> 172.21.15.5:0/4109952515 conn(0x7f95080cb770 msgr2=0x7f95080cbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.736+0000 7f950cc00640 1 -- 172.21.15.5:0/4109952515 shutdown_connections 2024-08-17T02:24:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.736+0000 7f950cc00640 1 -- 172.21.15.5:0/4109952515 wait complete. 2024-08-17T02:24:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.737+0000 7f950cc00640 1 Processor -- start 2024-08-17T02:24:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.737+0000 7f950cc00640 1 -- start start 2024-08-17T02:24:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.738+0000 7f950cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95080b10e0 0x7f9508150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.738+0000 7f950cc00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f950814d780 0x7f95081561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.738+0000 7f950cc00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f950814db50 0x7f950814e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.738+0000 7f950cc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95080ab8c0 con 0x7f95080b10e0 2024-08-17T02:24:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.738+0000 7f950cc00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95080abb10 con 0x7f950814db50 2024-08-17T02:24:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.738+0000 7f950cc00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95080abdf0 con 0x7f950814d780 2024-08-17T02:24:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.738+0000 7f9507400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95080b10e0 0x7f9508150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.738+0000 7f9507400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95080b10e0 0x7f9508150690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34790/0 (socket says 172.21.15.5:34790) 2024-08-17T02:24:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.738+0000 7f9507400640 1 -- 172.21.15.5:0/4227927796 learned_addr learned my addr 172.21.15.5:0/4227927796 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.739+0000 7f9507e00640 1 --2- 172.21.15.5:0/4227927796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f950814db50 0x7f950814e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.739+0000 7f9506a00640 1 --2- 172.21.15.5:0/4227927796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f950814d780 0x7f95081561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.739+0000 7f9507400640 1 -- 172.21.15.5:0/4227927796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f950814d780 msgr2=0x7f95081561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.739+0000 7f9507400640 1 --2- 172.21.15.5:0/4227927796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f950814d780 0x7f95081561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.739+0000 7f9507400640 1 -- 172.21.15.5:0/4227927796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f950814db50 msgr2=0x7f950814e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.739+0000 7f9507400640 1 --2- 172.21.15.5:0/4227927796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f950814db50 0x7f950814e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.739+0000 7f9507400640 1 -- 172.21.15.5:0/4227927796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f8009450 con 0x7f95080b10e0 2024-08-17T02:24:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.739+0000 7f9507400640 1 --2- 172.21.15.5:0/4227927796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95080b10e0 0x7f9508150690 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009420 tx=0x7f94f8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.739+0000 7f94fea00640 1 -- 172.21.15.5:0/4227927796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f8031a60 con 0x7f95080b10e0 2024-08-17T02:24:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.739+0000 7f94fea00640 1 -- 172.21.15.5:0/4227927796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f8031bc0 con 0x7f95080b10e0 2024-08-17T02:24:05.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.740+0000 7f950cc00640 1 -- 172.21.15.5:0/4227927796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95080ac0d0 con 0x7f95080b10e0 2024-08-17T02:24:05.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.740+0000 7f94fea00640 1 -- 172.21.15.5:0/4227927796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f803d420 con 0x7f95080b10e0 2024-08-17T02:24:05.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.740+0000 7f950cc00640 1 -- 172.21.15.5:0/4227927796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9508155430 con 0x7f95080b10e0 2024-08-17T02:24:05.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.741+0000 7f950cc00640 1 -- 172.21.15.5:0/4227927796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9508070720 con 0x7f95080b10e0 2024-08-17T02:24:05.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.741+0000 7f94fea00640 1 -- 172.21.15.5:0/4227927796 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f94f803d790 con 0x7f95080b10e0 2024-08-17T02:24:05.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.743+0000 7f94fea00640 1 --2- 172.21.15.5:0/4227927796 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f94e8065150 0x7f94e8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:05.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.743+0000 7f94fea00640 1 -- 172.21.15.5:0/4227927796 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f94f80a3290 con 0x7f95080b10e0 2024-08-17T02:24:05.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.743+0000 7f9506a00640 1 --2- 172.21.15.5:0/4227927796 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f94e8065150 0x7f94e8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:05.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.744+0000 7f9506a00640 1 --2- 172.21.15.5:0/4227927796 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f94e8065150 0x7f94e8067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f95080ad8d0 tx=0x7f94f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:05.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.747+0000 7f94fea00640 1 -- 172.21.15.5:0/4227927796 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f94f80712b0 con 0x7f95080b10e0 2024-08-17T02:24:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.932+0000 7f950cc00640 1 -- 172.21.15.5:0/4227927796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95081571a0 con 0x7f95080b10e0 2024-08-17T02:24:05.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.932+0000 7f94fea00640 1 -- 172.21.15.5:0/4227927796 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94f802ae60 con 0x7f95080b10e0 2024-08-17T02:24:05.933 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:24:05.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.934+0000 7f950cc00640 1 -- 172.21.15.5:0/4227927796 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f94e8065150 msgr2=0x7f94e8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.934+0000 7f950cc00640 1 --2- 172.21.15.5:0/4227927796 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f94e8065150 0x7f94e8067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f95080ad8d0 tx=0x7f94f4009040 comp rx=0 tx=0).stop 2024-08-17T02:24:05.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.934+0000 7f950cc00640 1 -- 172.21.15.5:0/4227927796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95080b10e0 msgr2=0x7f9508150690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:05.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.934+0000 7f950cc00640 1 --2- 172.21.15.5:0/4227927796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95080b10e0 0x7f9508150690 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009420 tx=0x7f94f8032000 comp rx=0 tx=0).stop 2024-08-17T02:24:05.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.935+0000 7f950cc00640 1 -- 172.21.15.5:0/4227927796 shutdown_connections 2024-08-17T02:24:05.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.935+0000 7f950cc00640 1 --2- 172.21.15.5:0/4227927796 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f94e8065150 0x7f94e8067600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.935+0000 7f950cc00640 1 --2- 172.21.15.5:0/4227927796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f950814d780 0x7f95081561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.935+0000 7f950cc00640 1 --2- 172.21.15.5:0/4227927796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f950814db50 0x7f950814e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.935+0000 7f950cc00640 1 --2- 172.21.15.5:0/4227927796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95080b10e0 0x7f9508150690 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:05.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.935+0000 7f950cc00640 1 -- 172.21.15.5:0/4227927796 >> 172.21.15.5:0/4227927796 conn(0x7f95080cb770 msgr2=0x7f9508066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:05.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.935+0000 7f950cc00640 1 -- 172.21.15.5:0/4227927796 shutdown_connections 2024-08-17T02:24:05.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:05.935+0000 7f950cc00640 1 -- 172.21.15.5:0/4227927796 wait complete. 2024-08-17T02:24:05.950 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:24:06.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.103+0000 7f3a45a00640 1 Processor -- start 2024-08-17T02:24:06.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.104+0000 7f3a45a00640 1 -- start start 2024-08-17T02:24:06.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.105+0000 7f3a45a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3a400ae7d0 0x7f3a400ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.105+0000 7f3a45a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3a40156cd0 0x7f3a400adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.105+0000 7f3a45a00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a400b08d0 con 0x7f3a40156900 2024-08-17T02:24:06.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.105+0000 7f3a45a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a400b0b10 con 0x7f3a40156cd0 2024-08-17T02:24:06.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.105+0000 7f3a45a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a400b0df0 con 0x7f3a400ae7d0 2024-08-17T02:24:06.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.105+0000 7f3a45000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3a40156cd0 0x7f3a400adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.105+0000 7f3a45000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3a40156cd0 0x7f3a400adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34798/0 (socket says 172.21.15.5:34798) 2024-08-17T02:24:06.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.105+0000 7f3a45000640 1 -- 172.21.15.5:0/3311616360 learned_addr learned my addr 172.21.15.5:0/3311616360 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:06.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.106+0000 7f3a37e00640 1 --2- 172.21.15.5:0/3311616360 >> v2:172.21.15.87:3300/0 conn(0x7f3a400ae7d0 0x7f3a400ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.106+0000 7f3a45000640 1 -- 172.21.15.5:0/3311616360 >> v2:172.21.15.87:3300/0 conn(0x7f3a400ae7d0 msgr2=0x7f3a400ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:06.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.106+0000 7f3a45000640 1 --2- 172.21.15.5:0/3311616360 >> v2:172.21.15.87:3300/0 conn(0x7f3a400ae7d0 0x7f3a400ada70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.106+0000 7f3a45000640 1 -- 172.21.15.5:0/3311616360 >> v1:172.21.15.87:6789/0 conn(0x7f3a40156900 legacy=0x7f3a400b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.106+0000 7f3a45000640 1 -- 172.21.15.5:0/3311616360 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a400b10d0 con 0x7f3a40156cd0 2024-08-17T02:24:06.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.107+0000 7f3a45000640 1 --2- 172.21.15.5:0/3311616360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a40156cd0 0x7f3a400adfb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3a400b17f0 tx=0x7f3a38009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530d0f21b085dff8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.107+0000 7f3a3f400640 1 -- 172.21.15.5:0/3311616360 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3802f560 con 0x7f3a40156cd0 2024-08-17T02:24:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.107+0000 7f3a3f400640 1 -- 172.21.15.5:0/3311616360 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3802f6c0 con 0x7f3a40156cd0 2024-08-17T02:24:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.107+0000 7f3a3f400640 1 -- 172.21.15.5:0/3311616360 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3802faa0 con 0x7f3a40156cd0 2024-08-17T02:24:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.108+0000 7f3a45a00640 1 -- 172.21.15.5:0/3311616360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a40156cd0 msgr2=0x7f3a400adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.108+0000 7f3a45a00640 1 --2- 172.21.15.5:0/3311616360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a40156cd0 0x7f3a400adfb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3a400b17f0 tx=0x7f3a38009840 comp rx=0 tx=0).stop 2024-08-17T02:24:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.108+0000 7f3a45a00640 1 -- 172.21.15.5:0/3311616360 shutdown_connections 2024-08-17T02:24:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.108+0000 7f3a45a00640 1 --2- 172.21.15.5:0/3311616360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a40156cd0 0x7f3a400adfb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.108+0000 7f3a45a00640 1 --2- 172.21.15.5:0/3311616360 >> v2:172.21.15.87:3300/0 conn(0x7f3a400ae7d0 0x7f3a400ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.108+0000 7f3a45a00640 1 -- 172.21.15.5:0/3311616360 >> 172.21.15.5:0/3311616360 conn(0x7f3a40067930 msgr2=0x7f3a400cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.108+0000 7f3a45a00640 1 -- 172.21.15.5:0/3311616360 shutdown_connections 2024-08-17T02:24:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.108+0000 7f3a45a00640 1 -- 172.21.15.5:0/3311616360 wait complete. 2024-08-17T02:24:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.109+0000 7f3a45a00640 1 Processor -- start 2024-08-17T02:24:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.110+0000 7f3a45a00640 1 -- start start 2024-08-17T02:24:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.110+0000 7f3a45a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a400ae7d0 0x7f3a40164ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.110+0000 7f3a45a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a40156900 0x7f3a4014d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.111+0000 7f3a45a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a40156cd0 0x7f3a40159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.111+0000 7f3a45a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a40152390 con 0x7f3a40156cd0 2024-08-17T02:24:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.111+0000 7f3a45a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a40165730 con 0x7f3a400ae7d0 2024-08-17T02:24:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.111+0000 7f3a45a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a40165a10 con 0x7f3a40156900 2024-08-17T02:24:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.111+0000 7f3a45000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a40156cd0 0x7f3a40159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.111+0000 7f3a45000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a40156cd0 0x7f3a40159490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34802/0 (socket says 172.21.15.5:34802) 2024-08-17T02:24:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.111+0000 7f3a45000640 1 -- 172.21.15.5:0/2947388252 learned_addr learned my addr 172.21.15.5:0/2947388252 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.111+0000 7f3a37e00640 1 --2- 172.21.15.5:0/2947388252 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a40156900 0x7f3a4014d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.111+0000 7f3a3fe00640 1 --2- 172.21.15.5:0/2947388252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a400ae7d0 0x7f3a40164ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.111+0000 7f3a45000640 1 -- 172.21.15.5:0/2947388252 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a40156900 msgr2=0x7f3a4014d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.111+0000 7f3a45000640 1 --2- 172.21.15.5:0/2947388252 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a40156900 0x7f3a4014d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.111+0000 7f3a45000640 1 -- 172.21.15.5:0/2947388252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a400ae7d0 msgr2=0x7f3a40164ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.111+0000 7f3a45000640 1 --2- 172.21.15.5:0/2947388252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a400ae7d0 0x7f3a40164ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.111+0000 7f3a45000640 1 -- 172.21.15.5:0/2947388252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a38009ae0 con 0x7f3a40156cd0 2024-08-17T02:24:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.112+0000 7f3a45000640 1 --2- 172.21.15.5:0/2947388252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a40156cd0 0x7f3a40159490 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009f50 tx=0x7f3a38039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.112+0000 7f3a37400640 1 -- 172.21.15.5:0/2947388252 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3802f560 con 0x7f3a40156cd0 2024-08-17T02:24:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.112+0000 7f3a37400640 1 -- 172.21.15.5:0/2947388252 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a38008e50 con 0x7f3a40156cd0 2024-08-17T02:24:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.112+0000 7f3a37400640 1 -- 172.21.15.5:0/2947388252 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a380436c0 con 0x7f3a40156cd0 2024-08-17T02:24:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.112+0000 7f3a45a00640 1 -- 172.21.15.5:0/2947388252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a40165cf0 con 0x7f3a40156cd0 2024-08-17T02:24:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.112+0000 7f3a45a00640 1 -- 172.21.15.5:0/2947388252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a40165400 con 0x7f3a40156cd0 2024-08-17T02:24:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.113+0000 7f3a45a00640 1 -- 172.21.15.5:0/2947388252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a40070720 con 0x7f3a40156cd0 2024-08-17T02:24:06.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.114+0000 7f3a37400640 1 -- 172.21.15.5:0/2947388252 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3a38041420 con 0x7f3a40156cd0 2024-08-17T02:24:06.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.115+0000 7f3a37400640 1 --2- 172.21.15.5:0/2947388252 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3a1c065150 0x7f3a1c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.115+0000 7f3a37400640 1 -- 172.21.15.5:0/2947388252 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a380a72f0 con 0x7f3a40156cd0 2024-08-17T02:24:06.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.115+0000 7f3a3fe00640 1 --2- 172.21.15.5:0/2947388252 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3a1c065150 0x7f3a1c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.115+0000 7f3a3fe00640 1 --2- 172.21.15.5:0/2947388252 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3a1c065150 0x7f3a1c067600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3a30007fd0 tx=0x7f3a30009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:06.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.119+0000 7f3a37400640 1 -- 172.21.15.5:0/2947388252 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3a380753c0 con 0x7f3a40156cd0 2024-08-17T02:24:06.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.300+0000 7f3a45a00640 1 -- 172.21.15.5:0/2947388252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a400cbe40 con 0x7f3a40156cd0 2024-08-17T02:24:06.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.301+0000 7f3a37400640 1 -- 172.21.15.5:0/2947388252 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3a380789e0 con 0x7f3a40156cd0 2024-08-17T02:24:06.301 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:24:06.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.302+0000 7f3a45a00640 1 -- 172.21.15.5:0/2947388252 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3a1c065150 msgr2=0x7f3a1c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.303+0000 7f3a45a00640 1 --2- 172.21.15.5:0/2947388252 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3a1c065150 0x7f3a1c067600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3a30007fd0 tx=0x7f3a30009040 comp rx=0 tx=0).stop 2024-08-17T02:24:06.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.303+0000 7f3a45a00640 1 -- 172.21.15.5:0/2947388252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a40156cd0 msgr2=0x7f3a40159490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.303+0000 7f3a45a00640 1 --2- 172.21.15.5:0/2947388252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a40156cd0 0x7f3a40159490 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009f50 tx=0x7f3a38039000 comp rx=0 tx=0).stop 2024-08-17T02:24:06.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.303+0000 7f3a45a00640 1 -- 172.21.15.5:0/2947388252 shutdown_connections 2024-08-17T02:24:06.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.303+0000 7f3a45a00640 1 --2- 172.21.15.5:0/2947388252 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3a1c065150 0x7f3a1c067600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.303+0000 7f3a45a00640 1 --2- 172.21.15.5:0/2947388252 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a40156900 0x7f3a4014d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.303+0000 7f3a45a00640 1 --2- 172.21.15.5:0/2947388252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a40156cd0 0x7f3a40159490 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.303+0000 7f3a45a00640 1 --2- 172.21.15.5:0/2947388252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a400ae7d0 0x7f3a40164ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.303+0000 7f3a45a00640 1 -- 172.21.15.5:0/2947388252 >> 172.21.15.5:0/2947388252 conn(0x7f3a40067930 msgr2=0x7f3a4014f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:06.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.303+0000 7f3a45a00640 1 -- 172.21.15.5:0/2947388252 shutdown_connections 2024-08-17T02:24:06.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.303+0000 7f3a45a00640 1 -- 172.21.15.5:0/2947388252 wait complete. 2024-08-17T02:24:06.318 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:06.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.472+0000 7f143d800640 1 Processor -- start 2024-08-17T02:24:06.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.472+0000 7f143d800640 1 -- start start 2024-08-17T02:24:06.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.473+0000 7f143d800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1438158e10 0x7f1438068180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.473+0000 7f143d800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1438068dd0 0x7f14380cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.473+0000 7f143d800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14380c40a0 con 0x7f14381591e0 2024-08-17T02:24:06.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.473+0000 7f143d800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14380694e0 con 0x7f1438068dd0 2024-08-17T02:24:06.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.473+0000 7f143d800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1438069240 con 0x7f1438158e10 2024-08-17T02:24:06.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.473+0000 7f1437400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1438068dd0 0x7f14380cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.473+0000 7f1437400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1438068dd0 0x7f14380cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34812/0 (socket says 172.21.15.5:34812) 2024-08-17T02:24:06.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.473+0000 7f1437400640 1 -- 172.21.15.5:0/688388211 learned_addr learned my addr 172.21.15.5:0/688388211 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:06.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.474+0000 7f1436a00640 1 --2- 172.21.15.5:0/688388211 >> v2:172.21.15.87:3300/0 conn(0x7f1438158e10 0x7f1438068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.474+0000 7f1437400640 1 -- 172.21.15.5:0/688388211 >> v2:172.21.15.87:3300/0 conn(0x7f1438158e10 msgr2=0x7f1438068180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:06.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.474+0000 7f1437400640 1 --2- 172.21.15.5:0/688388211 >> v2:172.21.15.87:3300/0 conn(0x7f1438158e10 0x7f1438068180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.474+0000 7f1437400640 1 -- 172.21.15.5:0/688388211 >> v1:172.21.15.87:6789/0 conn(0x7f14381591e0 legacy=0x7f14380686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:06.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.474+0000 7f1437400640 1 -- 172.21.15.5:0/688388211 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14380c3a50 con 0x7f1438068dd0 2024-08-17T02:24:06.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.475+0000 7f1437400640 1 --2- 172.21.15.5:0/688388211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1438068dd0 0x7f14380cbfd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f143806a5d0 tx=0x7f1430009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c21f67142f1262 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:06.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.475+0000 7f1435600640 1 -- 172.21.15.5:0/688388211 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430007400 con 0x7f1438068dd0 2024-08-17T02:24:06.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.475+0000 7f1435600640 1 -- 172.21.15.5:0/688388211 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1430007560 con 0x7f1438068dd0 2024-08-17T02:24:06.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.475+0000 7f1435600640 1 -- 172.21.15.5:0/688388211 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430007940 con 0x7f1438068dd0 2024-08-17T02:24:06.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.476+0000 7f143d800640 1 -- 172.21.15.5:0/688388211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1438068dd0 msgr2=0x7f14380cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.476+0000 7f143d800640 1 --2- 172.21.15.5:0/688388211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1438068dd0 0x7f14380cbfd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f143806a5d0 tx=0x7f1430009840 comp rx=0 tx=0).stop 2024-08-17T02:24:06.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.476+0000 7f143d800640 1 -- 172.21.15.5:0/688388211 shutdown_connections 2024-08-17T02:24:06.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.476+0000 7f143d800640 1 --2- 172.21.15.5:0/688388211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1438068dd0 0x7f14380cbfd0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.476+0000 7f143d800640 1 --2- 172.21.15.5:0/688388211 >> v2:172.21.15.87:3300/0 conn(0x7f1438158e10 0x7f1438068180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.476+0000 7f143d800640 1 -- 172.21.15.5:0/688388211 >> 172.21.15.5:0/688388211 conn(0x7f14380ce590 msgr2=0x7f14380ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:06.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.476+0000 7f143d800640 1 -- 172.21.15.5:0/688388211 shutdown_connections 2024-08-17T02:24:06.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.476+0000 7f143d800640 1 -- 172.21.15.5:0/688388211 wait complete. 2024-08-17T02:24:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.477+0000 7f143d800640 1 Processor -- start 2024-08-17T02:24:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.477+0000 7f143d800640 1 -- start start 2024-08-17T02:24:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.478+0000 7f143d800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1438068dd0 0x7f143815cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.478+0000 7f143d800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1438158e10 0x7f143815d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.478+0000 7f143d800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14381591e0 0x7f14380aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.478+0000 7f143d800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14380c8740 con 0x7f14381591e0 2024-08-17T02:24:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.478+0000 7f143d800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14380b01a0 con 0x7f1438158e10 2024-08-17T02:24:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.478+0000 7f143d800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14380afbe0 con 0x7f1438068dd0 2024-08-17T02:24:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.478+0000 7f1437400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14381591e0 0x7f14380aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.479+0000 7f1437400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14381591e0 0x7f14380aee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34824/0 (socket says 172.21.15.5:34824) 2024-08-17T02:24:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.479+0000 7f1437400640 1 -- 172.21.15.5:0/455936970 learned_addr learned my addr 172.21.15.5:0/455936970 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.479+0000 7f1436a00640 1 --2- 172.21.15.5:0/455936970 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1438068dd0 0x7f143815cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.479+0000 7f1436000640 1 --2- 172.21.15.5:0/455936970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1438158e10 0x7f143815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.479+0000 7f1437400640 1 -- 172.21.15.5:0/455936970 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1438068dd0 msgr2=0x7f143815cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.479+0000 7f1437400640 1 --2- 172.21.15.5:0/455936970 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1438068dd0 0x7f143815cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.479+0000 7f1437400640 1 -- 172.21.15.5:0/455936970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1438158e10 msgr2=0x7f143815d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.479+0000 7f1437400640 1 --2- 172.21.15.5:0/455936970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1438158e10 0x7f143815d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.479+0000 7f1437400640 1 -- 172.21.15.5:0/455936970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430009ae0 con 0x7f14381591e0 2024-08-17T02:24:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.479+0000 7f1437400640 1 --2- 172.21.15.5:0/455936970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14381591e0 0x7f14380aee70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1430009ab0 tx=0x7f1430034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.479+0000 7f142e000640 1 -- 172.21.15.5:0/455936970 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430007400 con 0x7f14381591e0 2024-08-17T02:24:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.480+0000 7f142e000640 1 -- 172.21.15.5:0/455936970 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1430032e10 con 0x7f14381591e0 2024-08-17T02:24:06.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.480+0000 7f142e000640 1 -- 172.21.15.5:0/455936970 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143003d6a0 con 0x7f14381591e0 2024-08-17T02:24:06.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.480+0000 7f143d800640 1 -- 172.21.15.5:0/455936970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14380afec0 con 0x7f14381591e0 2024-08-17T02:24:06.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.480+0000 7f143d800640 1 -- 172.21.15.5:0/455936970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1438169f60 con 0x7f14381591e0 2024-08-17T02:24:06.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.481+0000 7f143d800640 1 -- 172.21.15.5:0/455936970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143816a150 con 0x7f14381591e0 2024-08-17T02:24:06.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.481+0000 7f142e000640 1 -- 172.21.15.5:0/455936970 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f143003da10 con 0x7f14381591e0 2024-08-17T02:24:06.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.482+0000 7f142e000640 1 --2- 172.21.15.5:0/455936970 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1418065150 0x7f1418067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.482+0000 7f142e000640 1 -- 172.21.15.5:0/455936970 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14300a3bd0 con 0x7f14381591e0 2024-08-17T02:24:06.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.482+0000 7f1436a00640 1 --2- 172.21.15.5:0/455936970 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1418065150 0x7f1418067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.483+0000 7f1436a00640 1 --2- 172.21.15.5:0/455936970 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1418065150 0x7f1418067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f142800bd40 tx=0x7f1428008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:06.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.487+0000 7f142e000640 1 -- 172.21.15.5:0/455936970 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1430071ca0 con 0x7f14381591e0 2024-08-17T02:24:06.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.671+0000 7f143d800640 1 -- 172.21.15.5:0/455936970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f14380cb030 con 0x7f14381591e0 2024-08-17T02:24:06.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.672+0000 7f142e000640 1 -- 172.21.15.5:0/455936970 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14300752c0 con 0x7f14381591e0 2024-08-17T02:24:06.672 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-17T02:24:06.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.674+0000 7f143d800640 1 -- 172.21.15.5:0/455936970 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1418065150 msgr2=0x7f1418067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.674+0000 7f143d800640 1 --2- 172.21.15.5:0/455936970 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1418065150 0x7f1418067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f142800bd40 tx=0x7f1428008040 comp rx=0 tx=0).stop 2024-08-17T02:24:06.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.674+0000 7f143d800640 1 -- 172.21.15.5:0/455936970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14381591e0 msgr2=0x7f14380aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.674+0000 7f143d800640 1 --2- 172.21.15.5:0/455936970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14381591e0 0x7f14380aee70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1430009ab0 tx=0x7f1430034000 comp rx=0 tx=0).stop 2024-08-17T02:24:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.674+0000 7f143d800640 1 -- 172.21.15.5:0/455936970 shutdown_connections 2024-08-17T02:24:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.674+0000 7f143d800640 1 --2- 172.21.15.5:0/455936970 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1418065150 0x7f1418067600 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.674+0000 7f143d800640 1 --2- 172.21.15.5:0/455936970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14381591e0 0x7f14380aee70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.674+0000 7f143d800640 1 --2- 172.21.15.5:0/455936970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1438158e10 0x7f143815d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.674+0000 7f143d800640 1 --2- 172.21.15.5:0/455936970 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1438068dd0 0x7f143815cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.674+0000 7f143d800640 1 -- 172.21.15.5:0/455936970 >> 172.21.15.5:0/455936970 conn(0x7f14380ce590 msgr2=0x7f143806b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.674+0000 7f143d800640 1 -- 172.21.15.5:0/455936970 shutdown_connections 2024-08-17T02:24:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.674+0000 7f143d800640 1 -- 172.21.15.5:0/455936970 wait complete. 2024-08-17T02:24:06.762 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:24:06.762 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:24:06.763 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.914+0000 7f8791e00640 1 Processor -- start 2024-08-17T02:24:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.914+0000 7f8791e00640 1 -- start start 2024-08-17T02:24:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.916+0000 7f8791e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878c155040 0x7f878c158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.916+0000 7f8791e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f878c06e770 0x7f878c0af340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.916+0000 7f8791e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c0aeeb0 con 0x7f878c1591c0 2024-08-17T02:24:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.916+0000 7f8791e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878c159610 con 0x7f878c06e770 2024-08-17T02:24:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.916+0000 7f8791e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0aadd0 con 0x7f878c155040 2024-08-17T02:24:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.916+0000 7f878b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f878c06e770 0x7f878c0af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.916+0000 7f878b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f878c06e770 0x7f878c0af340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34828/0 (socket says 172.21.15.5:34828) 2024-08-17T02:24:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.916+0000 7f878b400640 1 -- 172.21.15.5:0/2273543723 learned_addr learned my addr 172.21.15.5:0/2273543723 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.916+0000 7f878aa00640 1 --2- 172.21.15.5:0/2273543723 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878c155040 0x7f878c158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.916+0000 7f878b400640 1 -- 172.21.15.5:0/2273543723 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878c155040 msgr2=0x7f878c158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:06.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.916+0000 7f878b400640 1 --2- 172.21.15.5:0/2273543723 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878c155040 0x7f878c158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.916+0000 7f878b400640 1 -- 172.21.15.5:0/2273543723 >> v1:172.21.15.87:6789/0 conn(0x7f878c1591c0 legacy=0x7f878c06e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.917+0000 7f878b400640 1 -- 172.21.15.5:0/2273543723 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c1597f0 con 0x7f878c06e770 2024-08-17T02:24:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.917+0000 7f878b400640 1 --2- 172.21.15.5:0/2273543723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f878c06e770 0x7f878c0af340 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f878400d1a0 tx=0x7f878400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b7ad6a1cd7bfa7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.918+0000 7f878a000640 1 -- 172.21.15.5:0/2273543723 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878400b0d0 con 0x7f878c06e770 2024-08-17T02:24:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.918+0000 7f878a000640 1 -- 172.21.15.5:0/2273543723 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878400b230 con 0x7f878c06e770 2024-08-17T02:24:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.918+0000 7f878a000640 1 -- 172.21.15.5:0/2273543723 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8784009610 con 0x7f878c06e770 2024-08-17T02:24:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.918+0000 7f8791e00640 1 -- 172.21.15.5:0/2273543723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f878c06e770 msgr2=0x7f878c0af340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.918+0000 7f8791e00640 1 --2- 172.21.15.5:0/2273543723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f878c06e770 0x7f878c0af340 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f878400d1a0 tx=0x7f878400ba50 comp rx=0 tx=0).stop 2024-08-17T02:24:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.918+0000 7f8791e00640 1 -- 172.21.15.5:0/2273543723 shutdown_connections 2024-08-17T02:24:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.918+0000 7f8791e00640 1 --2- 172.21.15.5:0/2273543723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f878c06e770 0x7f878c0af340 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.918+0000 7f8791e00640 1 --2- 172.21.15.5:0/2273543723 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878c155040 0x7f878c158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.918+0000 7f8791e00640 1 -- 172.21.15.5:0/2273543723 >> 172.21.15.5:0/2273543723 conn(0x7f878c066e60 msgr2=0x7f878c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.918+0000 7f8791e00640 1 -- 172.21.15.5:0/2273543723 shutdown_connections 2024-08-17T02:24:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.919+0000 7f8791e00640 1 -- 172.21.15.5:0/2273543723 wait complete. 2024-08-17T02:24:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.920+0000 7f8791e00640 1 Processor -- start 2024-08-17T02:24:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.920+0000 7f8791e00640 1 -- start start 2024-08-17T02:24:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.921+0000 7f8791e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f878c06e770 0x7f878c0c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.921+0000 7f8791e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f878c155040 0x7f878c0c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.921+0000 7f8791e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878c1591c0 0x7f878c168ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.921+0000 7f8791e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0c1570 con 0x7f878c06e770 2024-08-17T02:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.921+0000 7f8791e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c155960 con 0x7f878c155040 2024-08-17T02:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.921+0000 7f8791e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c155c40 con 0x7f878c1591c0 2024-08-17T02:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.921+0000 7f878aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f878c06e770 0x7f878c0c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.921+0000 7f878aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f878c06e770 0x7f878c0c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34840/0 (socket says 172.21.15.5:34840) 2024-08-17T02:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.921+0000 7f878aa00640 1 -- 172.21.15.5:0/3786949694 learned_addr learned my addr 172.21.15.5:0/3786949694 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.921+0000 7f8783e00640 1 --2- 172.21.15.5:0/3786949694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f878c155040 0x7f878c0c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.921+0000 7f878b400640 1 --2- 172.21.15.5:0/3786949694 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878c1591c0 0x7f878c168ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.922+0000 7f878aa00640 1 -- 172.21.15.5:0/3786949694 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878c1591c0 msgr2=0x7f878c168ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.922+0000 7f878aa00640 1 --2- 172.21.15.5:0/3786949694 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878c1591c0 0x7f878c168ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.922+0000 7f878aa00640 1 -- 172.21.15.5:0/3786949694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f878c155040 msgr2=0x7f878c0c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.922+0000 7f878aa00640 1 --2- 172.21.15.5:0/3786949694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f878c155040 0x7f878c0c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.922+0000 7f878aa00640 1 -- 172.21.15.5:0/3786949694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878400bcf0 con 0x7f878c06e770 2024-08-17T02:24:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.922+0000 7f8783e00640 1 --2- 172.21.15.5:0/3786949694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f878c155040 0x7f878c0c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.922+0000 7f878aa00640 1 --2- 172.21.15.5:0/3786949694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f878c06e770 0x7f878c0c99b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f877c00ea20 tx=0x7f877c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.922+0000 7f8782000640 1 -- 172.21.15.5:0/3786949694 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c00ca10 con 0x7f878c06e770 2024-08-17T02:24:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.922+0000 7f8782000640 1 -- 172.21.15.5:0/3786949694 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c00cb70 con 0x7f878c06e770 2024-08-17T02:24:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.922+0000 7f8782000640 1 -- 172.21.15.5:0/3786949694 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c013470 con 0x7f878c06e770 2024-08-17T02:24:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.922+0000 7f8791e00640 1 -- 172.21.15.5:0/3786949694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878c155f20 con 0x7f878c06e770 2024-08-17T02:24:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.922+0000 7f8791e00640 1 -- 172.21.15.5:0/3786949694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c155410 con 0x7f878c06e770 2024-08-17T02:24:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.923+0000 7f8791e00640 1 -- 172.21.15.5:0/3786949694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878c1556f0 con 0x7f878c06e770 2024-08-17T02:24:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.924+0000 7f8782000640 1 -- 172.21.15.5:0/3786949694 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f877c013860 con 0x7f878c06e770 2024-08-17T02:24:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.925+0000 7f8782000640 1 --2- 172.21.15.5:0/3786949694 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8768065150 0x7f8768067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.925+0000 7f8782000640 1 -- 172.21.15.5:0/3786949694 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f877c0827d0 con 0x7f878c06e770 2024-08-17T02:24:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.925+0000 7f8783e00640 1 --2- 172.21.15.5:0/3786949694 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8768065150 0x7f8768067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.926+0000 7f8783e00640 1 --2- 172.21.15.5:0/3786949694 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8768065150 0x7f8768067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f878c0c2de0 tx=0x7f8774009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:06.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:06.929+0000 7f8782000640 1 -- 172.21.15.5:0/3786949694 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f877c0508a0 con 0x7f878c06e770 2024-08-17T02:24:07.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.111+0000 7f8791e00640 1 -- 172.21.15.5:0/3786949694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f878c063fb0 con 0x7f878c06e770 2024-08-17T02:24:07.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.112+0000 7f8782000640 1 -- 172.21.15.5:0/3786949694 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f877c053ec0 con 0x7f878c06e770 2024-08-17T02:24:07.113 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:07.113 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:36.575545+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:32.642845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:33.982937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:07.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.114+0000 7f8791e00640 1 -- 172.21.15.5:0/3786949694 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8768065150 msgr2=0x7f8768067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.114+0000 7f8791e00640 1 --2- 172.21.15.5:0/3786949694 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8768065150 0x7f8768067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f878c0c2de0 tx=0x7f8774009040 comp rx=0 tx=0).stop 2024-08-17T02:24:07.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.114+0000 7f8791e00640 1 -- 172.21.15.5:0/3786949694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f878c06e770 msgr2=0x7f878c0c99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.114+0000 7f8791e00640 1 --2- 172.21.15.5:0/3786949694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f878c06e770 0x7f878c0c99b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f877c00ea20 tx=0x7f877c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.115+0000 7f8791e00640 1 -- 172.21.15.5:0/3786949694 shutdown_connections 2024-08-17T02:24:07.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.115+0000 7f8791e00640 1 --2- 172.21.15.5:0/3786949694 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8768065150 0x7f8768067600 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.115+0000 7f8791e00640 1 --2- 172.21.15.5:0/3786949694 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878c1591c0 0x7f878c168ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.115+0000 7f8791e00640 1 --2- 172.21.15.5:0/3786949694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f878c155040 0x7f878c0c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.115+0000 7f8791e00640 1 --2- 172.21.15.5:0/3786949694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f878c06e770 0x7f878c0c99b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.115+0000 7f8791e00640 1 -- 172.21.15.5:0/3786949694 >> 172.21.15.5:0/3786949694 conn(0x7f878c066e60 msgr2=0x7f878c0abb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:07.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.115+0000 7f8791e00640 1 -- 172.21.15.5:0/3786949694 shutdown_connections 2024-08-17T02:24:07.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.115+0000 7f8791e00640 1 -- 172.21.15.5:0/3786949694 wait complete. 2024-08-17T02:24:07.131 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:28.773677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:23:32.642845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:23:33.982937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:24:07.131 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:07.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.285+0000 7f9a9a800640 1 Processor -- start 2024-08-17T02:24:07.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.285+0000 7f9a9a800640 1 -- start start 2024-08-17T02:24:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.286+0000 7f9a9a800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a94155820 0x7f9a940ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.286+0000 7f9a9a800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a940aae50 0x7f9a940acad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.286+0000 7f9a9a800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a940ac640 con 0x7f9a94155bf0 2024-08-17T02:24:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.286+0000 7f9a9a800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a940b10e0 con 0x7f9a940aae50 2024-08-17T02:24:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.286+0000 7f9a9a800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a940aefd0 con 0x7f9a94155820 2024-08-17T02:24:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.286+0000 7f9a93e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a940aae50 0x7f9a940acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.286+0000 7f9a93e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a940aae50 0x7f9a940acad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34848/0 (socket says 172.21.15.5:34848) 2024-08-17T02:24:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.286+0000 7f9a93e00640 1 -- 172.21.15.5:0/1447480261 learned_addr learned my addr 172.21.15.5:0/1447480261 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.287+0000 7f9a93400640 1 --2- 172.21.15.5:0/1447480261 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a94155820 0x7f9a940ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.287+0000 7f9a93e00640 1 -- 172.21.15.5:0/1447480261 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a94155820 msgr2=0x7f9a940ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.287+0000 7f9a93e00640 1 --2- 172.21.15.5:0/1447480261 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a94155820 0x7f9a940ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.287+0000 7f9a93e00640 1 -- 172.21.15.5:0/1447480261 >> v1:172.21.15.87:6789/0 conn(0x7f9a94155bf0 legacy=0x7f9a940aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.287+0000 7f9a93e00640 1 -- 172.21.15.5:0/1447480261 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a940af2b0 con 0x7f9a940aae50 2024-08-17T02:24:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.288+0000 7f9a93e00640 1 --2- 172.21.15.5:0/1447480261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a940aae50 0x7f9a940acad0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009f20 tx=0x7f9a8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c49307601003c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.288+0000 7f9a92a00640 1 -- 172.21.15.5:0/1447480261 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c031400 con 0x7f9a940aae50 2024-08-17T02:24:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.288+0000 7f9a92a00640 1 -- 172.21.15.5:0/1447480261 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8c02d050 con 0x7f9a940aae50 2024-08-17T02:24:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.288+0000 7f9a92a00640 1 -- 172.21.15.5:0/1447480261 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c0317d0 con 0x7f9a940aae50 2024-08-17T02:24:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.289+0000 7f9a9a800640 1 -- 172.21.15.5:0/1447480261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a940aae50 msgr2=0x7f9a940acad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.289+0000 7f9a9a800640 1 --2- 172.21.15.5:0/1447480261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a940aae50 0x7f9a940acad0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009f20 tx=0x7f9a8c009840 comp rx=0 tx=0).stop 2024-08-17T02:24:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.289+0000 7f9a9a800640 1 -- 172.21.15.5:0/1447480261 shutdown_connections 2024-08-17T02:24:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.289+0000 7f9a9a800640 1 --2- 172.21.15.5:0/1447480261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a940aae50 0x7f9a940acad0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.289+0000 7f9a9a800640 1 --2- 172.21.15.5:0/1447480261 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a94155820 0x7f9a940ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.289+0000 7f9a9a800640 1 -- 172.21.15.5:0/1447480261 >> 172.21.15.5:0/1447480261 conn(0x7f9a940678e0 msgr2=0x7f9a940cb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.289+0000 7f9a9a800640 1 -- 172.21.15.5:0/1447480261 shutdown_connections 2024-08-17T02:24:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.289+0000 7f9a9a800640 1 -- 172.21.15.5:0/1447480261 wait complete. 2024-08-17T02:24:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.290+0000 7f9a9a800640 1 Processor -- start 2024-08-17T02:24:07.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.290+0000 7f9a9a800640 1 -- start start 2024-08-17T02:24:07.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.291+0000 7f9a9a800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a940aae50 0x7f9a94157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.291+0000 7f9a9a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a94155820 0x7f9a941589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.291+0000 7f9a9a800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a94155bf0 0x7f9a94156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.291+0000 7f9a9a800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a941565b0 con 0x7f9a94155820 2024-08-17T02:24:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.291+0000 7f9a9a800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a941573f0 con 0x7f9a940aae50 2024-08-17T02:24:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.291+0000 7f9a9a800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a941567e0 con 0x7f9a94155bf0 2024-08-17T02:24:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.291+0000 7f9a8aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a94155820 0x7f9a941589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.292+0000 7f9a8aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a94155820 0x7f9a941589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34858/0 (socket says 172.21.15.5:34858) 2024-08-17T02:24:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.292+0000 7f9a8aa00640 1 -- 172.21.15.5:0/1014997720 learned_addr learned my addr 172.21.15.5:0/1014997720 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.292+0000 7f9a93400640 1 --2- 172.21.15.5:0/1014997720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a940aae50 0x7f9a94157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.292+0000 7f9a93e00640 1 --2- 172.21.15.5:0/1014997720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a94155bf0 0x7f9a94156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.292+0000 7f9a8aa00640 1 -- 172.21.15.5:0/1014997720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a94155bf0 msgr2=0x7f9a94156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.292+0000 7f9a8aa00640 1 --2- 172.21.15.5:0/1014997720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a94155bf0 0x7f9a94156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.292+0000 7f9a8aa00640 1 -- 172.21.15.5:0/1014997720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a940aae50 msgr2=0x7f9a94157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.292+0000 7f9a8aa00640 1 --2- 172.21.15.5:0/1014997720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a940aae50 0x7f9a94157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.292+0000 7f9a8aa00640 1 -- 172.21.15.5:0/1014997720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8c009ae0 con 0x7f9a94155820 2024-08-17T02:24:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.292+0000 7f9a93e00640 1 --2- 172.21.15.5:0/1014997720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a94155bf0 0x7f9a94156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.292+0000 7f9a8aa00640 1 --2- 172.21.15.5:0/1014997720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a94155820 0x7f9a941589a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c00c4c0 tx=0x7f9a7c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.293+0000 7f9a8b400640 1 -- 172.21.15.5:0/1014997720 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c001080 con 0x7f9a94155820 2024-08-17T02:24:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.293+0000 7f9a8b400640 1 -- 172.21.15.5:0/1014997720 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7c011590 con 0x7f9a94155820 2024-08-17T02:24:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.293+0000 7f9a8b400640 1 -- 172.21.15.5:0/1014997720 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c011950 con 0x7f9a94155820 2024-08-17T02:24:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.293+0000 7f9a9a800640 1 -- 172.21.15.5:0/1014997720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a94156ac0 con 0x7f9a94155820 2024-08-17T02:24:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.293+0000 7f9a9a800640 1 -- 172.21.15.5:0/1014997720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a94157080 con 0x7f9a94155820 2024-08-17T02:24:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.294+0000 7f9a9a800640 1 -- 172.21.15.5:0/1014997720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a94157560 con 0x7f9a94155820 2024-08-17T02:24:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.295+0000 7f9a8b400640 1 -- 172.21.15.5:0/1014997720 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9a7c011d00 con 0x7f9a94155820 2024-08-17T02:24:07.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.296+0000 7f9a8b400640 1 --2- 172.21.15.5:0/1014997720 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9a70065150 0x7f9a70067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.296+0000 7f9a8b400640 1 -- 172.21.15.5:0/1014997720 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a7c081830 con 0x7f9a94155820 2024-08-17T02:24:07.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.296+0000 7f9a93400640 1 --2- 172.21.15.5:0/1014997720 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9a70065150 0x7f9a70067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.297+0000 7f9a93400640 1 --2- 172.21.15.5:0/1014997720 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9a70065150 0x7f9a70067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9a84007ba0 tx=0x7f9a84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:07.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.300+0000 7f9a8b400640 1 -- 172.21.15.5:0/1014997720 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9a7c04f900 con 0x7f9a94155820 2024-08-17T02:24:07.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.480+0000 7f9a9a800640 1 -- 172.21.15.5:0/1014997720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a94063ea0 con 0x7f9a94155820 2024-08-17T02:24:07.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.481+0000 7f9a8b400640 1 -- 172.21.15.5:0/1014997720 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a7c052f20 con 0x7f9a94155820 2024-08-17T02:24:07.482 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:24:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.483+0000 7f9a9a800640 1 -- 172.21.15.5:0/1014997720 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9a70065150 msgr2=0x7f9a70067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.483+0000 7f9a9a800640 1 --2- 172.21.15.5:0/1014997720 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9a70065150 0x7f9a70067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9a84007ba0 tx=0x7f9a84008040 comp rx=0 tx=0).stop 2024-08-17T02:24:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.483+0000 7f9a9a800640 1 -- 172.21.15.5:0/1014997720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a94155820 msgr2=0x7f9a941589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.483+0000 7f9a9a800640 1 --2- 172.21.15.5:0/1014997720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a94155820 0x7f9a941589a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c00c4c0 tx=0x7f9a7c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.483+0000 7f9a9a800640 1 -- 172.21.15.5:0/1014997720 shutdown_connections 2024-08-17T02:24:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.483+0000 7f9a9a800640 1 --2- 172.21.15.5:0/1014997720 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9a70065150 0x7f9a70067600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.483+0000 7f9a9a800640 1 --2- 172.21.15.5:0/1014997720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a94155bf0 0x7f9a94156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.483+0000 7f9a9a800640 1 --2- 172.21.15.5:0/1014997720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a94155820 0x7f9a941589a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.483+0000 7f9a9a800640 1 --2- 172.21.15.5:0/1014997720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a940aae50 0x7f9a94157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.483+0000 7f9a9a800640 1 -- 172.21.15.5:0/1014997720 >> 172.21.15.5:0/1014997720 conn(0x7f9a940678e0 msgr2=0x7f9a9406d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.483+0000 7f9a9a800640 1 -- 172.21.15.5:0/1014997720 shutdown_connections 2024-08-17T02:24:07.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.483+0000 7f9a9a800640 1 -- 172.21.15.5:0/1014997720 wait complete. 2024-08-17T02:24:07.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:24:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.655+0000 7fe867e00640 1 Processor -- start 2024-08-17T02:24:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.655+0000 7fe867e00640 1 -- start start 2024-08-17T02:24:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.657+0000 7fe867e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe868156900 0x7fe8680b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.657+0000 7fe867e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe8680ae180 0x7fe8680aab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.657+0000 7fe867e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8680b0b10 con 0x7fe8680ae7d0 2024-08-17T02:24:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.657+0000 7fe867e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8680b0df0 con 0x7fe8680ae180 2024-08-17T02:24:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.657+0000 7fe867e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8680b10d0 con 0x7fe868156900 2024-08-17T02:24:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.657+0000 7fe866a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe868156900 0x7fe8680b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.657+0000 7fe85fe00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe8680ae7d0 0x7fe8680ada70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:54838/0 (socket says 172.21.15.5:54838) 2024-08-17T02:24:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.657+0000 7fe85fe00640 1 -- 172.21.15.5:0/3664470065 learned_addr learned my addr 172.21.15.5:0/3664470065 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.657+0000 7fe867400640 1 --2- 172.21.15.5:0/3664470065 >> v2:172.21.15.87:3300/0 conn(0x7fe8680ae180 0x7fe8680aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.658+0000 7fe866000640 1 -- 172.21.15.5:0/3664470065 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495848067 0 0) 0x7fe8680b0b10 con 0x7fe8680ae7d0 2024-08-17T02:24:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.658+0000 7fe866000640 1 -- 172.21.15.5:0/3664470065 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe84c0034e0 con 0x7fe8680ae7d0 2024-08-17T02:24:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.658+0000 7fe866a00640 1 -- 172.21.15.5:0/3664470065 >> v2:172.21.15.87:3300/0 conn(0x7fe8680ae180 msgr2=0x7fe8680aab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.658+0000 7fe866a00640 1 --2- 172.21.15.5:0/3664470065 >> v2:172.21.15.87:3300/0 conn(0x7fe8680ae180 0x7fe8680aab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.658+0000 7fe866a00640 1 -- 172.21.15.5:0/3664470065 >> v1:172.21.15.87:6789/0 conn(0x7fe8680ae7d0 legacy=0x7fe8680ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.658+0000 7fe866a00640 1 -- 172.21.15.5:0/3664470065 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8680b13b0 con 0x7fe868156900 2024-08-17T02:24:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.658+0000 7fe867400640 1 --2- 172.21.15.5:0/3664470065 >> v2:172.21.15.87:3300/0 conn(0x7fe8680ae180 0x7fe8680aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:07.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.659+0000 7fe866a00640 1 --2- 172.21.15.5:0/3664470065 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe868156900 0x7fe8680b01c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe858009850 tx=0x7fe8580090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f4a04d66be091d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:07.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.659+0000 7fe866000640 1 -- 172.21.15.5:0/3664470065 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85802ad00 con 0x7fe868156900 2024-08-17T02:24:07.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.659+0000 7fe866000640 1 -- 172.21.15.5:0/3664470065 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85802ae60 con 0x7fe868156900 2024-08-17T02:24:07.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.659+0000 7fe866000640 1 -- 172.21.15.5:0/3664470065 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858032670 con 0x7fe868156900 2024-08-17T02:24:07.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.660+0000 7fe867e00640 1 -- 172.21.15.5:0/3664470065 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe868156900 msgr2=0x7fe8680b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.660+0000 7fe867e00640 1 --2- 172.21.15.5:0/3664470065 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe868156900 0x7fe8680b01c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe858009850 tx=0x7fe8580090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.660+0000 7fe867e00640 1 -- 172.21.15.5:0/3664470065 shutdown_connections 2024-08-17T02:24:07.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.660+0000 7fe867e00640 1 --2- 172.21.15.5:0/3664470065 >> v2:172.21.15.87:3300/0 conn(0x7fe8680ae180 0x7fe8680aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.660+0000 7fe867e00640 1 --2- 172.21.15.5:0/3664470065 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe868156900 0x7fe8680b01c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.660+0000 7fe867e00640 1 -- 172.21.15.5:0/3664470065 >> 172.21.15.5:0/3664470065 conn(0x7fe868067930 msgr2=0x7fe8680cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:07.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.660+0000 7fe867e00640 1 -- 172.21.15.5:0/3664470065 shutdown_connections 2024-08-17T02:24:07.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.660+0000 7fe867e00640 1 -- 172.21.15.5:0/3664470065 wait complete. 2024-08-17T02:24:07.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.661+0000 7fe867e00640 1 Processor -- start 2024-08-17T02:24:07.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.661+0000 7fe867e00640 1 -- start start 2024-08-17T02:24:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.662+0000 7fe867e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8680ae180 0x7fe86816a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.662+0000 7fe867e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8680ae7d0 0x7fe868169610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.662+0000 7fe867e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe868156900 0x7fe868159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.662+0000 7fe867e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe868169f40 con 0x7fe8680ae180 2024-08-17T02:24:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.662+0000 7fe867e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86816a1f0 con 0x7fe8680ae7d0 2024-08-17T02:24:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.662+0000 7fe867e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86816a4d0 con 0x7fe868156900 2024-08-17T02:24:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.663+0000 7fe866a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8680ae180 0x7fe86816a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.663+0000 7fe866a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8680ae180 0x7fe86816a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34864/0 (socket says 172.21.15.5:34864) 2024-08-17T02:24:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.663+0000 7fe866a00640 1 -- 172.21.15.5:0/3494318194 learned_addr learned my addr 172.21.15.5:0/3494318194 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.663+0000 7fe85fe00640 1 --2- 172.21.15.5:0/3494318194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8680ae7d0 0x7fe868169610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.663+0000 7fe867400640 1 --2- 172.21.15.5:0/3494318194 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe868156900 0x7fe868159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.663+0000 7fe866a00640 1 -- 172.21.15.5:0/3494318194 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe868156900 msgr2=0x7fe868159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.663+0000 7fe866a00640 1 --2- 172.21.15.5:0/3494318194 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe868156900 0x7fe868159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.663+0000 7fe866a00640 1 -- 172.21.15.5:0/3494318194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8680ae7d0 msgr2=0x7fe868169610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.663+0000 7fe866a00640 1 --2- 172.21.15.5:0/3494318194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8680ae7d0 0x7fe868169610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.663+0000 7fe866a00640 1 -- 172.21.15.5:0/3494318194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe860009a20 con 0x7fe8680ae180 2024-08-17T02:24:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.663+0000 7fe866a00640 1 --2- 172.21.15.5:0/3494318194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8680ae180 0x7fe86816a7e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe858009360 tx=0x7fe858032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.664+0000 7fe85e000640 1 -- 172.21.15.5:0/3494318194 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85803b6e0 con 0x7fe8680ae180 2024-08-17T02:24:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.664+0000 7fe85e000640 1 -- 172.21.15.5:0/3494318194 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85803b860 con 0x7fe8680ae180 2024-08-17T02:24:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.664+0000 7fe85e000640 1 -- 172.21.15.5:0/3494318194 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85803bc20 con 0x7fe8680ae180 2024-08-17T02:24:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.664+0000 7fe867e00640 1 -- 172.21.15.5:0/3494318194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe858009390 con 0x7fe8680ae180 2024-08-17T02:24:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.664+0000 7fe867e00640 1 -- 172.21.15.5:0/3494318194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8681546f0 con 0x7fe8680ae180 2024-08-17T02:24:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.665+0000 7fe867e00640 1 -- 172.21.15.5:0/3494318194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe868070720 con 0x7fe8680ae180 2024-08-17T02:24:07.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.666+0000 7fe85e000640 1 -- 172.21.15.5:0/3494318194 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe858043030 con 0x7fe8680ae180 2024-08-17T02:24:07.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.666+0000 7fe85e000640 1 --2- 172.21.15.5:0/3494318194 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe844065150 0x7fe844067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:07.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.667+0000 7fe85e000640 1 -- 172.21.15.5:0/3494318194 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe858041070 con 0x7fe8680ae180 2024-08-17T02:24:07.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.667+0000 7fe85fe00640 1 --2- 172.21.15.5:0/3494318194 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe844065150 0x7fe844067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:07.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.667+0000 7fe85fe00640 1 --2- 172.21.15.5:0/3494318194 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe844065150 0x7fe844067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe868156340 tx=0x7fe850009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:07.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.670+0000 7fe85e000640 1 -- 172.21.15.5:0/3494318194 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe8580708e0 con 0x7fe8680ae180 2024-08-17T02:24:07.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.852+0000 7fe867e00640 1 -- 172.21.15.5:0/3494318194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8680aef00 con 0x7fe8680ae180 2024-08-17T02:24:07.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.853+0000 7fe85e000640 1 -- 172.21.15.5:0/3494318194 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe858073f00 con 0x7fe8680ae180 2024-08-17T02:24:07.853 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:24:07.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.855+0000 7fe867e00640 1 -- 172.21.15.5:0/3494318194 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe844065150 msgr2=0x7fe844067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.855+0000 7fe867e00640 1 --2- 172.21.15.5:0/3494318194 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe844065150 0x7fe844067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe868156340 tx=0x7fe850009040 comp rx=0 tx=0).stop 2024-08-17T02:24:07.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.855+0000 7fe867e00640 1 -- 172.21.15.5:0/3494318194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8680ae180 msgr2=0x7fe86816a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:07.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.855+0000 7fe867e00640 1 --2- 172.21.15.5:0/3494318194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8680ae180 0x7fe86816a7e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe858009360 tx=0x7fe858032000 comp rx=0 tx=0).stop 2024-08-17T02:24:07.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.855+0000 7fe867e00640 1 -- 172.21.15.5:0/3494318194 shutdown_connections 2024-08-17T02:24:07.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.855+0000 7fe867e00640 1 --2- 172.21.15.5:0/3494318194 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe844065150 0x7fe844067600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.855+0000 7fe867e00640 1 --2- 172.21.15.5:0/3494318194 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe868156900 0x7fe868159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.855+0000 7fe867e00640 1 --2- 172.21.15.5:0/3494318194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8680ae7d0 0x7fe868169610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.855+0000 7fe867e00640 1 --2- 172.21.15.5:0/3494318194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8680ae180 0x7fe86816a7e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:07.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.855+0000 7fe867e00640 1 -- 172.21.15.5:0/3494318194 >> 172.21.15.5:0/3494318194 conn(0x7fe868067930 msgr2=0x7fe868069a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:07.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.855+0000 7fe867e00640 1 -- 172.21.15.5:0/3494318194 shutdown_connections 2024-08-17T02:24:07.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:07.855+0000 7fe867e00640 1 -- 172.21.15.5:0/3494318194 wait complete. 2024-08-17T02:24:07.870 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:08.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.023+0000 7fe675000640 1 Processor -- start 2024-08-17T02:24:08.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.023+0000 7fe675000640 1 -- start start 2024-08-17T02:24:08.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.024+0000 7fe675000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6700afca0 0x7fe6700b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.024+0000 7fe675000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6700acf10 0x7fe670159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.024+0000 7fe675000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe6701589a0 0x7fe670158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.024+0000 7fe675000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6700b0980 con 0x7fe6700afca0 2024-08-17T02:24:08.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.024+0000 7fe675000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67015a4e0 con 0x7fe6701589a0 2024-08-17T02:24:08.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.024+0000 7fe675000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700c92b0 con 0x7fe6700acf10 2024-08-17T02:24:08.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.024+0000 7fe66de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6700afca0 0x7fe6700b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.024+0000 7fe66de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6700afca0 0x7fe6700b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34872/0 (socket says 172.21.15.5:34872) 2024-08-17T02:24:08.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.024+0000 7fe66de00640 1 -- 172.21.15.5:0/4183315953 learned_addr learned my addr 172.21.15.5:0/4183315953 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:08.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.025+0000 7fe66d400640 1 --2- 172.21.15.5:0/4183315953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6700acf10 0x7fe670159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.025+0000 7fe66e800640 1 --2- 172.21.15.5:0/4183315953 >> v2:172.21.15.87:3300/0 conn(0x7fe6701589a0 0x7fe670158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.025+0000 7fe66de00640 1 -- 172.21.15.5:0/4183315953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6700acf10 msgr2=0x7fe670159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:08.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.025+0000 7fe66de00640 1 --2- 172.21.15.5:0/4183315953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6700acf10 0x7fe670159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.025+0000 7fe66de00640 1 -- 172.21.15.5:0/4183315953 >> v2:172.21.15.87:3300/0 conn(0x7fe6701589a0 msgr2=0x7fe670158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:08.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.025+0000 7fe66de00640 1 --2- 172.21.15.5:0/4183315953 >> v2:172.21.15.87:3300/0 conn(0x7fe6701589a0 0x7fe670158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.025+0000 7fe66de00640 1 -- 172.21.15.5:0/4183315953 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe670159360 con 0x7fe6700afca0 2024-08-17T02:24:08.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.025+0000 7fe66e800640 1 --2- 172.21.15.5:0/4183315953 >> v2:172.21.15.87:3300/0 conn(0x7fe6701589a0 0x7fe670158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.026+0000 7fe66de00640 1 --2- 172.21.15.5:0/4183315953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700afca0 0x7fe6700b0070 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe660009910 tx=0x7fe6600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a12abfaf7687a22 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.026+0000 7fe66ca00640 1 -- 172.21.15.5:0/4183315953 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66002adb0 con 0x7fe6700afca0 2024-08-17T02:24:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.026+0000 7fe66ca00640 1 -- 172.21.15.5:0/4183315953 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe660032440 con 0x7fe6700afca0 2024-08-17T02:24:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.026+0000 7fe66ca00640 1 -- 172.21.15.5:0/4183315953 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660032820 con 0x7fe6700afca0 2024-08-17T02:24:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.027+0000 7fe675000640 1 -- 172.21.15.5:0/4183315953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700afca0 msgr2=0x7fe6700b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.027+0000 7fe675000640 1 --2- 172.21.15.5:0/4183315953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700afca0 0x7fe6700b0070 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe660009910 tx=0x7fe6600091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.027+0000 7fe675000640 1 -- 172.21.15.5:0/4183315953 shutdown_connections 2024-08-17T02:24:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.027+0000 7fe675000640 1 --2- 172.21.15.5:0/4183315953 >> v2:172.21.15.87:3300/0 conn(0x7fe6701589a0 0x7fe670158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.027+0000 7fe675000640 1 --2- 172.21.15.5:0/4183315953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6700acf10 0x7fe670159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.027+0000 7fe675000640 1 --2- 172.21.15.5:0/4183315953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700afca0 0x7fe6700b0070 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.027+0000 7fe675000640 1 -- 172.21.15.5:0/4183315953 >> 172.21.15.5:0/4183315953 conn(0x7fe670066e60 msgr2=0x7fe670067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:08.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.027+0000 7fe675000640 1 -- 172.21.15.5:0/4183315953 shutdown_connections 2024-08-17T02:24:08.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.027+0000 7fe675000640 1 -- 172.21.15.5:0/4183315953 wait complete. 2024-08-17T02:24:08.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.028+0000 7fe675000640 1 Processor -- start 2024-08-17T02:24:08.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.028+0000 7fe675000640 1 -- start start 2024-08-17T02:24:08.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.029+0000 7fe675000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6700acf10 0x7fe6701476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.029+0000 7fe675000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700afca0 0x7fe6700c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.029+0000 7fe675000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6701589a0 0x7fe6700c1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.029+0000 7fe675000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe670156be0 con 0x7fe6700afca0 2024-08-17T02:24:08.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.029+0000 7fe675000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe670155e10 con 0x7fe6700acf10 2024-08-17T02:24:08.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.029+0000 7fe675000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe670155b30 con 0x7fe6701589a0 2024-08-17T02:24:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.030+0000 7fe66d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700afca0 0x7fe6700c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.030+0000 7fe66d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700afca0 0x7fe6700c11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34874/0 (socket says 172.21.15.5:34874) 2024-08-17T02:24:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.030+0000 7fe66d400640 1 -- 172.21.15.5:0/3098654864 learned_addr learned my addr 172.21.15.5:0/3098654864 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.030+0000 7fe66de00640 1 --2- 172.21.15.5:0/3098654864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6700acf10 0x7fe6701476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.030+0000 7fe66e800640 1 --2- 172.21.15.5:0/3098654864 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6701589a0 0x7fe6700c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.030+0000 7fe66d400640 1 -- 172.21.15.5:0/3098654864 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6701589a0 msgr2=0x7fe6700c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.030+0000 7fe66d400640 1 --2- 172.21.15.5:0/3098654864 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6701589a0 0x7fe6700c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.030+0000 7fe66d400640 1 -- 172.21.15.5:0/3098654864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6700acf10 msgr2=0x7fe6701476f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.030+0000 7fe66d400640 1 --2- 172.21.15.5:0/3098654864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6700acf10 0x7fe6701476f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.030+0000 7fe66d400640 1 -- 172.21.15.5:0/3098654864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe660009450 con 0x7fe6700afca0 2024-08-17T02:24:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.030+0000 7fe66e800640 1 --2- 172.21.15.5:0/3098654864 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6701589a0 0x7fe6700c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.030+0000 7fe66d400640 1 --2- 172.21.15.5:0/3098654864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700afca0 0x7fe6700c11c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00e930 tx=0x7fe65c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.031+0000 7fe665600640 1 -- 172.21.15.5:0/3098654864 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00c8e0 con 0x7fe6700afca0 2024-08-17T02:24:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.031+0000 7fe665600640 1 -- 172.21.15.5:0/3098654864 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c00ca40 con 0x7fe6700afca0 2024-08-17T02:24:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.031+0000 7fe665600640 1 -- 172.21.15.5:0/3098654864 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00cde0 con 0x7fe6700afca0 2024-08-17T02:24:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.031+0000 7fe675000640 1 -- 172.21.15.5:0/3098654864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe670156590 con 0x7fe6700afca0 2024-08-17T02:24:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.031+0000 7fe675000640 1 -- 172.21.15.5:0/3098654864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe670147c30 con 0x7fe6700afca0 2024-08-17T02:24:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.032+0000 7fe675000640 1 -- 172.21.15.5:0/3098654864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe670156d90 con 0x7fe6700afca0 2024-08-17T02:24:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.033+0000 7fe665600640 1 -- 172.21.15.5:0/3098654864 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe65c013680 con 0x7fe6700afca0 2024-08-17T02:24:08.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.034+0000 7fe665600640 1 --2- 172.21.15.5:0/3098654864 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe650069560 0x7fe65006ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.034+0000 7fe665600640 1 -- 172.21.15.5:0/3098654864 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe65c0825e0 con 0x7fe6700afca0 2024-08-17T02:24:08.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.034+0000 7fe66de00640 1 --2- 172.21.15.5:0/3098654864 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe650069560 0x7fe65006ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.035+0000 7fe66de00640 1 --2- 172.21.15.5:0/3098654864 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe650069560 0x7fe65006ba10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe660034000 tx=0x7fe660032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:08.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.038+0000 7fe665600640 1 -- 172.21.15.5:0/3098654864 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe670156d90 con 0x7fe6700afca0 2024-08-17T02:24:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.220+0000 7fe675000640 1 -- 172.21.15.5:0/3098654864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe670156d90 con 0x7fe6700afca0 2024-08-17T02:24:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.221+0000 7fe665600640 1 -- 172.21.15.5:0/3098654864 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe670156d90 con 0x7fe6700afca0 2024-08-17T02:24:08.221 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-17T02:24:08.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.223+0000 7fe675000640 1 -- 172.21.15.5:0/3098654864 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe650069560 msgr2=0x7fe65006ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.223+0000 7fe675000640 1 --2- 172.21.15.5:0/3098654864 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe650069560 0x7fe65006ba10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe660034000 tx=0x7fe660032000 comp rx=0 tx=0).stop 2024-08-17T02:24:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.223+0000 7fe675000640 1 -- 172.21.15.5:0/3098654864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700afca0 msgr2=0x7fe6700c11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.223+0000 7fe675000640 1 --2- 172.21.15.5:0/3098654864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700afca0 0x7fe6700c11c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00e930 tx=0x7fe65c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.223+0000 7fe675000640 1 -- 172.21.15.5:0/3098654864 shutdown_connections 2024-08-17T02:24:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.223+0000 7fe675000640 1 --2- 172.21.15.5:0/3098654864 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe650069560 0x7fe65006ba10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.223+0000 7fe675000640 1 --2- 172.21.15.5:0/3098654864 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6701589a0 0x7fe6700c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.223+0000 7fe675000640 1 --2- 172.21.15.5:0/3098654864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700afca0 0x7fe6700c11c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.223+0000 7fe675000640 1 --2- 172.21.15.5:0/3098654864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6700acf10 0x7fe6701476f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.223+0000 7fe675000640 1 -- 172.21.15.5:0/3098654864 >> 172.21.15.5:0/3098654864 conn(0x7fe670066e60 msgr2=0x7fe670069830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.223+0000 7fe675000640 1 -- 172.21.15.5:0/3098654864 shutdown_connections 2024-08-17T02:24:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.223+0000 7fe675000640 1 -- 172.21.15.5:0/3098654864 wait complete. 2024-08-17T02:24:08.239 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:24:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.390+0000 7ffaf8200640 1 Processor -- start 2024-08-17T02:24:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.390+0000 7ffaf8200640 1 -- start start 2024-08-17T02:24:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.391+0000 7ffaf8200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffaf00ad960 0x7ffaf015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.391+0000 7ffaf8200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaf00ca050 0x7ffaf0156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.391+0000 7ffaf8200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffaf00add30 0x7ffaf0156960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.391+0000 7ffaf8200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf015b5e0 con 0x7ffaf00ad960 2024-08-17T02:24:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.391+0000 7ffaf8200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf00cb160 con 0x7ffaf00add30 2024-08-17T02:24:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.391+0000 7ffaf8200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00b0d10 con 0x7ffaf00ca050 2024-08-17T02:24:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.392+0000 7ffaf5800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffaf00ad960 0x7ffaf015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.392+0000 7ffaf5800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffaf00ad960 0x7ffaf015b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34888/0 (socket says 172.21.15.5:34888) 2024-08-17T02:24:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.392+0000 7ffaf5800640 1 -- 172.21.15.5:0/61897961 learned_addr learned my addr 172.21.15.5:0/61897961 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.392+0000 7ffaf4e00640 1 --2- 172.21.15.5:0/61897961 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaf00ca050 0x7ffaf0156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.392+0000 7ffaf6200640 1 --2- 172.21.15.5:0/61897961 >> v2:172.21.15.87:3300/0 conn(0x7ffaf00add30 0x7ffaf0156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.392+0000 7ffaf5800640 1 -- 172.21.15.5:0/61897961 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaf00ca050 msgr2=0x7ffaf0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.392+0000 7ffaf5800640 1 --2- 172.21.15.5:0/61897961 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaf00ca050 0x7ffaf0156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.392+0000 7ffaf5800640 1 -- 172.21.15.5:0/61897961 >> v2:172.21.15.87:3300/0 conn(0x7ffaf00add30 msgr2=0x7ffaf0156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.392+0000 7ffaf5800640 1 --2- 172.21.15.5:0/61897961 >> v2:172.21.15.87:3300/0 conn(0x7ffaf00add30 0x7ffaf0156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.392+0000 7ffaf5800640 1 -- 172.21.15.5:0/61897961 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf00ca550 con 0x7ffaf00ad960 2024-08-17T02:24:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.392+0000 7ffaf6200640 1 --2- 172.21.15.5:0/61897961 >> v2:172.21.15.87:3300/0 conn(0x7ffaf00add30 0x7ffaf0156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.393+0000 7ffaf5800640 1 --2- 172.21.15.5:0/61897961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaf00ad960 0x7ffaf015b0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffaf006eda0 tx=0x7ffae40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81035e2c0462abc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.393+0000 7ffaefe00640 1 -- 172.21.15.5:0/61897961 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae402ae60 con 0x7ffaf00ad960 2024-08-17T02:24:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.393+0000 7ffaefe00640 1 -- 172.21.15.5:0/61897961 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae4032440 con 0x7ffaf00ad960 2024-08-17T02:24:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.393+0000 7ffaefe00640 1 -- 172.21.15.5:0/61897961 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae40327e0 con 0x7ffaf00ad960 2024-08-17T02:24:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.394+0000 7ffaf8200640 1 -- 172.21.15.5:0/61897961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaf00ad960 msgr2=0x7ffaf015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.394+0000 7ffaf8200640 1 --2- 172.21.15.5:0/61897961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaf00ad960 0x7ffaf015b0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffaf006eda0 tx=0x7ffae40091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.394+0000 7ffaf8200640 1 -- 172.21.15.5:0/61897961 shutdown_connections 2024-08-17T02:24:08.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.394+0000 7ffaf8200640 1 --2- 172.21.15.5:0/61897961 >> v2:172.21.15.87:3300/0 conn(0x7ffaf00add30 0x7ffaf0156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.394+0000 7ffaf8200640 1 --2- 172.21.15.5:0/61897961 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaf00ca050 0x7ffaf0156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.394+0000 7ffaf8200640 1 --2- 172.21.15.5:0/61897961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaf00ad960 0x7ffaf015b0a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.394+0000 7ffaf8200640 1 -- 172.21.15.5:0/61897961 >> 172.21.15.5:0/61897961 conn(0x7ffaf0066e60 msgr2=0x7ffaf0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.394+0000 7ffaf8200640 1 -- 172.21.15.5:0/61897961 shutdown_connections 2024-08-17T02:24:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.394+0000 7ffaf8200640 1 -- 172.21.15.5:0/61897961 wait complete. 2024-08-17T02:24:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.395+0000 7ffaf8200640 1 Processor -- start 2024-08-17T02:24:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.396+0000 7ffaf8200640 1 -- start start 2024-08-17T02:24:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.396+0000 7ffaf8200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaf00ad960 0x7ffaf006b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.396+0000 7ffaf8200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaf00add30 0x7ffaf00a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.396+0000 7ffaf8200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaf00ca050 0x7ffaf01690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.396+0000 7ffaf8200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf006ac40 con 0x7ffaf00ad960 2024-08-17T02:24:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.396+0000 7ffaf8200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf006a030 con 0x7ffaf00ca050 2024-08-17T02:24:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.396+0000 7ffaf8200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf006a310 con 0x7ffaf00add30 2024-08-17T02:24:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.397+0000 7ffaf5800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaf00ad960 0x7ffaf006b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.397+0000 7ffaf5800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaf00ad960 0x7ffaf006b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34890/0 (socket says 172.21.15.5:34890) 2024-08-17T02:24:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.397+0000 7ffaf5800640 1 -- 172.21.15.5:0/1326890883 learned_addr learned my addr 172.21.15.5:0/1326890883 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.397+0000 7ffaf4e00640 1 --2- 172.21.15.5:0/1326890883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaf00add30 0x7ffaf00a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.397+0000 7ffaf6200640 1 --2- 172.21.15.5:0/1326890883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaf00ca050 0x7ffaf01690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.397+0000 7ffaf5800640 1 -- 172.21.15.5:0/1326890883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaf00add30 msgr2=0x7ffaf00a4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.397+0000 7ffaf5800640 1 --2- 172.21.15.5:0/1326890883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaf00add30 0x7ffaf00a4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.397+0000 7ffaf5800640 1 -- 172.21.15.5:0/1326890883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaf00ca050 msgr2=0x7ffaf01690f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.397+0000 7ffaf5800640 1 --2- 172.21.15.5:0/1326890883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaf00ca050 0x7ffaf01690f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.397+0000 7ffaf5800640 1 -- 172.21.15.5:0/1326890883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae4009450 con 0x7ffaf00ad960 2024-08-17T02:24:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.397+0000 7ffaf5800640 1 --2- 172.21.15.5:0/1326890883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaf00ad960 0x7ffaf006b0d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009210 tx=0x7ffae4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.398+0000 7ffaecc00640 1 -- 172.21.15.5:0/1326890883 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4000d10 con 0x7ffaf00ad960 2024-08-17T02:24:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.398+0000 7ffaecc00640 1 -- 172.21.15.5:0/1326890883 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae4031a60 con 0x7ffaf00ad960 2024-08-17T02:24:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.398+0000 7ffaecc00640 1 -- 172.21.15.5:0/1326890883 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4031e20 con 0x7ffaf00ad960 2024-08-17T02:24:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.398+0000 7ffaf8200640 1 -- 172.21.15.5:0/1326890883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf006a5f0 con 0x7ffaf00ad960 2024-08-17T02:24:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.398+0000 7ffaf8200640 1 -- 172.21.15.5:0/1326890883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf006b610 con 0x7ffaf00ad960 2024-08-17T02:24:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.399+0000 7ffaf8200640 1 -- 172.21.15.5:0/1326890883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf0063fb0 con 0x7ffaf00ad960 2024-08-17T02:24:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.400+0000 7ffaecc00640 1 -- 172.21.15.5:0/1326890883 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffae4039040 con 0x7ffaf00ad960 2024-08-17T02:24:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.400+0000 7ffaecc00640 1 --2- 172.21.15.5:0/1326890883 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ffad0065150 0x7ffad0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.400+0000 7ffaecc00640 1 -- 172.21.15.5:0/1326890883 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffae40a1df0 con 0x7ffaf00ad960 2024-08-17T02:24:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.401+0000 7ffaf4e00640 1 --2- 172.21.15.5:0/1326890883 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ffad0065150 0x7ffad0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.401+0000 7ffaf4e00640 1 --2- 172.21.15.5:0/1326890883 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ffad0065150 0x7ffad0067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00c92d0 tx=0x7ffadc0090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.405+0000 7ffaecc00640 1 -- 172.21.15.5:0/1326890883 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffae406ff60 con 0x7ffaf00ad960 2024-08-17T02:24:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.655+0000 7ffaf8200640 1 -- 172.21.15.5:0/1326890883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7ffaf00b0690 con 0x7ffaf00ad960 2024-08-17T02:24:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.817+0000 7ffaecc00640 1 -- 172.21.15.5:0/1326890883 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v50) v1 ==== 138+0+0 (secure 0 0 0) 0x7ffae40370d0 con 0x7ffaf00ad960 2024-08-17T02:24:08.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.820+0000 7ffaf8200640 1 -- 172.21.15.5:0/1326890883 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ffad0065150 msgr2=0x7ffad0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.820+0000 7ffaf8200640 1 --2- 172.21.15.5:0/1326890883 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ffad0065150 0x7ffad0067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00c92d0 tx=0x7ffadc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.820+0000 7ffaf8200640 1 -- 172.21.15.5:0/1326890883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaf00ad960 msgr2=0x7ffaf006b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.820+0000 7ffaf8200640 1 --2- 172.21.15.5:0/1326890883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaf00ad960 0x7ffaf006b0d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009210 tx=0x7ffae4032000 comp rx=0 tx=0).stop 2024-08-17T02:24:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.820+0000 7ffaf8200640 1 -- 172.21.15.5:0/1326890883 shutdown_connections 2024-08-17T02:24:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.820+0000 7ffaf8200640 1 --2- 172.21.15.5:0/1326890883 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ffad0065150 0x7ffad0067600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.820+0000 7ffaf8200640 1 --2- 172.21.15.5:0/1326890883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaf00add30 0x7ffaf00a4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.820+0000 7ffaf8200640 1 --2- 172.21.15.5:0/1326890883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaf00ca050 0x7ffaf01690f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.820+0000 7ffaf8200640 1 --2- 172.21.15.5:0/1326890883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaf00ad960 0x7ffaf006b0d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.820+0000 7ffaf8200640 1 -- 172.21.15.5:0/1326890883 >> 172.21.15.5:0/1326890883 conn(0x7ffaf0066e60 msgr2=0x7ffaf01536a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.820+0000 7ffaf8200640 1 -- 172.21.15.5:0/1326890883 shutdown_connections 2024-08-17T02:24:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.820+0000 7ffaf8200640 1 -- 172.21.15.5:0/1326890883 wait complete. 2024-08-17T02:24:08.835 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:24:08.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.989+0000 7f427fa00640 1 Processor -- start 2024-08-17T02:24:08.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.989+0000 7f427fa00640 1 -- start start 2024-08-17T02:24:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.990+0000 7f427fa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42781590b0 0x7f42780b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.991+0000 7f427fa00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42780c92b0 con 0x7f42780acf10 2024-08-17T02:24:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.991+0000 7f427fa00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42780ad480 con 0x7f42780afca0 2024-08-17T02:24:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.991+0000 7f427fa00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42780b0980 con 0x7f42781590b0 2024-08-17T02:24:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.991+0000 7f4277e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42781590b0 0x7f42780b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.991+0000 7f4277e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42781590b0 0x7f42780b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34896/0 (socket says 172.21.15.5:34896) 2024-08-17T02:24:08.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.991+0000 7f4277e00640 1 -- 172.21.15.5:0/3134344945 learned_addr learned my addr 172.21.15.5:0/3134344945 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:08.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.991+0000 7f4277e00640 1 -- 172.21.15.5:0/3134344945 >> v1:172.21.15.87:6789/0 conn(0x7f42780afca0 legacy=0x7f42781589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.991+0000 7f4277e00640 1 -- 172.21.15.5:0/3134344945 >> v1:172.21.15.5:6789/0 conn(0x7f42780acf10 legacy=0x7f42780c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.991+0000 7f4277e00640 1 -- 172.21.15.5:0/3134344945 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42780ad760 con 0x7f42781590b0 2024-08-17T02:24:08.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.992+0000 7f4277e00640 1 --2- 172.21.15.5:0/3134344945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42781590b0 0x7f42780b0070 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4264009910 tx=0x7f42640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62db0198a55c286 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:08.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.992+0000 7f4277400640 1 -- 172.21.15.5:0/3134344945 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264032440 con 0x7f42781590b0 2024-08-17T02:24:08.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.993+0000 7f4277400640 1 -- 172.21.15.5:0/3134344945 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42640325a0 con 0x7f42781590b0 2024-08-17T02:24:08.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.993+0000 7f4277400640 1 -- 172.21.15.5:0/3134344945 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264032980 con 0x7f42781590b0 2024-08-17T02:24:08.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.993+0000 7f427fa00640 1 -- 172.21.15.5:0/3134344945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42781590b0 msgr2=0x7f42780b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.993+0000 7f427fa00640 1 --2- 172.21.15.5:0/3134344945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42781590b0 0x7f42780b0070 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4264009910 tx=0x7f42640091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.993+0000 7f427fa00640 1 -- 172.21.15.5:0/3134344945 shutdown_connections 2024-08-17T02:24:08.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.993+0000 7f427fa00640 1 --2- 172.21.15.5:0/3134344945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42781590b0 0x7f42780b0070 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.993+0000 7f427fa00640 1 -- 172.21.15.5:0/3134344945 >> 172.21.15.5:0/3134344945 conn(0x7f4278066e60 msgr2=0x7f4278067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:08.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.993+0000 7f427fa00640 1 -- 172.21.15.5:0/3134344945 shutdown_connections 2024-08-17T02:24:08.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.993+0000 7f427fa00640 1 -- 172.21.15.5:0/3134344945 wait complete. 2024-08-17T02:24:08.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.995+0000 7f427fa00640 1 Processor -- start 2024-08-17T02:24:08.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.995+0000 7f427fa00640 1 -- start start 2024-08-17T02:24:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.996+0000 7f427fa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42780acf10 0x7f4278140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.996+0000 7f427fa00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42780afca0 0x7f4278141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.996+0000 7f427fa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42781590b0 0x7f427806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.996+0000 7f427fa00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4278069830 con 0x7f42781590b0 2024-08-17T02:24:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.996+0000 7f427fa00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4278069a80 con 0x7f42780acf10 2024-08-17T02:24:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.996+0000 7f427fa00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4278069d60 con 0x7f42780afca0 2024-08-17T02:24:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.996+0000 7f427da00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42781590b0 0x7f427806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.996+0000 7f427da00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42781590b0 0x7f427806a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34908/0 (socket says 172.21.15.5:34908) 2024-08-17T02:24:08.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.996+0000 7f427da00640 1 -- 172.21.15.5:0/3657205183 learned_addr learned my addr 172.21.15.5:0/3657205183 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:08.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.996+0000 7f427d000640 1 --2- 172.21.15.5:0/3657205183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42780acf10 0x7f4278140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.996+0000 7f4277e00640 1 --2- 172.21.15.5:0/3657205183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42780afca0 0x7f4278141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:08.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.996+0000 7f427da00640 1 -- 172.21.15.5:0/3657205183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42780afca0 msgr2=0x7f4278141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.996+0000 7f427da00640 1 --2- 172.21.15.5:0/3657205183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42780afca0 0x7f4278141680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.996+0000 7f427da00640 1 -- 172.21.15.5:0/3657205183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42780acf10 msgr2=0x7f4278140cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:08.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.996+0000 7f427da00640 1 --2- 172.21.15.5:0/3657205183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42780acf10 0x7f4278140cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:08.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.996+0000 7f427da00640 1 -- 172.21.15.5:0/3657205183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4264009450 con 0x7f42781590b0 2024-08-17T02:24:08.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.997+0000 7f427da00640 1 --2- 172.21.15.5:0/3657205183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42781590b0 0x7f427806a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f427000c860 tx=0x7f4270001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:08.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.997+0000 7f426be00640 1 -- 172.21.15.5:0/3657205183 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427000ce50 con 0x7f42781590b0 2024-08-17T02:24:08.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.997+0000 7f426be00640 1 -- 172.21.15.5:0/3657205183 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427000a850 con 0x7f42781590b0 2024-08-17T02:24:08.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.997+0000 7f426be00640 1 -- 172.21.15.5:0/3657205183 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427000ac10 con 0x7f42781590b0 2024-08-17T02:24:08.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.997+0000 7f427fa00640 1 -- 172.21.15.5:0/3657205183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427806a040 con 0x7f42781590b0 2024-08-17T02:24:09.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.997+0000 7f427fa00640 1 -- 172.21.15.5:0/3657205183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4278141210 con 0x7f42781590b0 2024-08-17T02:24:09.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.998+0000 7f427fa00640 1 -- 172.21.15.5:0/3657205183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4278063fb0 con 0x7f42781590b0 2024-08-17T02:24:09.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:08.999+0000 7f426be00640 1 -- 172.21.15.5:0/3657205183 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4270012630 con 0x7f42781590b0 2024-08-17T02:24:09.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.000+0000 7f426be00640 1 --2- 172.21.15.5:0/3657205183 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4258065150 0x7f4258067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:09.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.000+0000 7f426be00640 1 -- 172.21.15.5:0/3657205183 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4270082670 con 0x7f42781590b0 2024-08-17T02:24:09.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.000+0000 7f427d000640 1 --2- 172.21.15.5:0/3657205183 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4258065150 0x7f4258067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:09.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.001+0000 7f427d000640 1 --2- 172.21.15.5:0/3657205183 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4258065150 0x7f4258067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f427815c8f0 tx=0x7f426c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.004+0000 7f426be00640 1 -- 172.21.15.5:0/3657205183 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4270050740 con 0x7f42781590b0 2024-08-17T02:24:09.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:09.181 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:09.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.188+0000 7f427fa00640 1 -- 172.21.15.5:0/3657205183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f427806ea80 con 0x7f42781590b0 2024-08-17T02:24:09.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.191+0000 7f426be00640 1 -- 172.21.15.5:0/3657205183 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4270053d60 con 0x7f42781590b0 2024-08-17T02:24:09.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.194+0000 7f427fa00640 1 -- 172.21.15.5:0/3657205183 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4258065150 msgr2=0x7f4258067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:09.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.194+0000 7f427fa00640 1 --2- 172.21.15.5:0/3657205183 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4258065150 0x7f4258067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f427815c8f0 tx=0x7f426c009040 comp rx=0 tx=0).stop 2024-08-17T02:24:09.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.194+0000 7f427fa00640 1 -- 172.21.15.5:0/3657205183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42781590b0 msgr2=0x7f427806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:09.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.194+0000 7f427fa00640 1 --2- 172.21.15.5:0/3657205183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42781590b0 0x7f427806a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f427000c860 tx=0x7f4270001690 comp rx=0 tx=0).stop 2024-08-17T02:24:09.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.194+0000 7f427fa00640 1 -- 172.21.15.5:0/3657205183 shutdown_connections 2024-08-17T02:24:09.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.194+0000 7f427fa00640 1 --2- 172.21.15.5:0/3657205183 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4258065150 0x7f4258067600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.194+0000 7f427fa00640 1 --2- 172.21.15.5:0/3657205183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42780afca0 0x7f4278141680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.194+0000 7f427fa00640 1 --2- 172.21.15.5:0/3657205183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42781590b0 0x7f427806a840 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.194+0000 7f427fa00640 1 --2- 172.21.15.5:0/3657205183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42780acf10 0x7f4278140cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:09.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.194+0000 7f427fa00640 1 -- 172.21.15.5:0/3657205183 >> 172.21.15.5:0/3657205183 conn(0x7f4278066e60 msgr2=0x7f42780c9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:09.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.194+0000 7f427fa00640 1 -- 172.21.15.5:0/3657205183 shutdown_connections 2024-08-17T02:24:09.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.194+0000 7f427fa00640 1 -- 172.21.15.5:0/3657205183 wait complete. 2024-08-17T02:24:09.212 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:24:09.212 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:24:09.350 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:24:09.430 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:24:09.431 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:24:09.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:24:09.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-17T02:24:09.494 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:24:09.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:09.494 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:24:09.542 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:24:09.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:24:09.543 DEBUG:teuthology.orchestra.run.smithi087:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-08-17T02:24:09.604 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-08-17T02:24:09.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:09.605 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:24:09.648 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-08-17T02:24:09.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:24:09.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-08-17T02:24:09.710 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:24:09.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:09.710 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:24:09.746 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-08-17T02:24:09.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:24:09.747 DEBUG:teuthology.orchestra.run.smithi087:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-08-17T02:24:09.809 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-08-17T02:24:09.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:09.809 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:24:09.846 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:24:09.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:09.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.999+0000 7f46e3c00640 1 Processor -- start 2024-08-17T02:24:10.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:09.999+0000 7f46e3c00640 1 -- start start 2024-08-17T02:24:10.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.000+0000 7f46e3c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f46dc0add30 0x7f46dc156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.000+0000 7f46e3c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46dc0cb160 con 0x7f46dc0ca050 2024-08-17T02:24:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.000+0000 7f46e3c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46dc0b0d10 con 0x7f46dc0ad960 2024-08-17T02:24:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.000+0000 7f46e3c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46dc0ca550 con 0x7f46dc0add30 2024-08-17T02:24:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.000+0000 7f46dbe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f46dc0ca050 0x7f46dc0aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35868/0 (socket says 172.21.15.5:35868) 2024-08-17T02:24:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.000+0000 7f46dbe00640 1 -- 172.21.15.5:0/211448811 learned_addr learned my addr 172.21.15.5:0/211448811 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.001+0000 7f46e1c00640 1 --2- 172.21.15.5:0/211448811 >> v2:172.21.15.87:3300/0 conn(0x7f46dc0add30 0x7f46dc156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.001+0000 7f46db400640 1 -- 172.21.15.5:0/211448811 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062983021 0 0) 0x7f46dc0cb160 con 0x7f46dc0ca050 2024-08-17T02:24:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.001+0000 7f46db400640 1 -- 172.21.15.5:0/211448811 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46c40034e0 con 0x7f46dc0ca050 2024-08-17T02:24:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.001+0000 7f46db400640 1 -- 172.21.15.5:0/211448811 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340329593 0 0) 0x7f46dc0b0d10 con 0x7f46dc0ad960 2024-08-17T02:24:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.001+0000 7f46db400640 1 -- 172.21.15.5:0/211448811 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46dc0cb160 con 0x7f46dc0ad960 2024-08-17T02:24:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.001+0000 7f46e1c00640 1 -- 172.21.15.5:0/211448811 >> v1:172.21.15.87:6789/0 conn(0x7f46dc0ad960 legacy=0x7f46dc156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.001+0000 7f46e1c00640 1 -- 172.21.15.5:0/211448811 >> v1:172.21.15.5:6789/0 conn(0x7f46dc0ca050 legacy=0x7f46dc0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.001+0000 7f46e1c00640 1 -- 172.21.15.5:0/211448811 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46dc0ca830 con 0x7f46dc0add30 2024-08-17T02:24:10.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.002+0000 7f46e1c00640 1 --2- 172.21.15.5:0/211448811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46dc0add30 0x7f46dc156b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009e60 tx=0x7f46d4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b6667bcd2b117fc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:10.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.002+0000 7f46db400640 1 -- 172.21.15.5:0/211448811 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4030550 con 0x7f46dc0add30 2024-08-17T02:24:10.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.002+0000 7f46db400640 1 -- 172.21.15.5:0/211448811 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d40306b0 con 0x7f46dc0add30 2024-08-17T02:24:10.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.002+0000 7f46db400640 1 -- 172.21.15.5:0/211448811 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4030a50 con 0x7f46dc0add30 2024-08-17T02:24:10.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.003+0000 7f46e3c00640 1 -- 172.21.15.5:0/211448811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46dc0add30 msgr2=0x7f46dc156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.003+0000 7f46e3c00640 1 --2- 172.21.15.5:0/211448811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46dc0add30 0x7f46dc156b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009e60 tx=0x7f46d4009780 comp rx=0 tx=0).stop 2024-08-17T02:24:10.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.003+0000 7f46e3c00640 1 -- 172.21.15.5:0/211448811 shutdown_connections 2024-08-17T02:24:10.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.003+0000 7f46e3c00640 1 --2- 172.21.15.5:0/211448811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46dc0add30 0x7f46dc156b30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.003+0000 7f46e3c00640 1 -- 172.21.15.5:0/211448811 >> 172.21.15.5:0/211448811 conn(0x7f46dc066e60 msgr2=0x7f46dc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:10.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.003+0000 7f46e3c00640 1 -- 172.21.15.5:0/211448811 shutdown_connections 2024-08-17T02:24:10.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.003+0000 7f46e3c00640 1 -- 172.21.15.5:0/211448811 wait complete. 2024-08-17T02:24:10.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.005+0000 7f46e3c00640 1 Processor -- start 2024-08-17T02:24:10.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.005+0000 7f46e3c00640 1 -- start start 2024-08-17T02:24:10.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.005+0000 7f46e3c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46dc0ad960 0x7f46dc1432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.005+0000 7f46e3c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46dc0add30 0x7f46dc0a9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.006+0000 7f46e3c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46dc0ca050 0x7f46dc0a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.006+0000 7f46e3c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc15bdf0 con 0x7f46dc0ad960 2024-08-17T02:24:10.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.006+0000 7f46e3c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc158910 con 0x7f46dc0add30 2024-08-17T02:24:10.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.006+0000 7f46e3c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc15dfe0 con 0x7f46dc0ca050 2024-08-17T02:24:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.006+0000 7f46e1200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46dc0ad960 0x7f46dc1432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.006+0000 7f46e1200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46dc0ad960 0x7f46dc1432f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48576/0 (socket says 172.21.15.5:48576) 2024-08-17T02:24:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.006+0000 7f46e1200640 1 -- 172.21.15.5:0/3074802684 learned_addr learned my addr 172.21.15.5:0/3074802684 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.006+0000 7f46dbe00640 1 --2- 172.21.15.5:0/3074802684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46dc0add30 0x7f46dc0a9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.006+0000 7f46e1c00640 1 --2- 172.21.15.5:0/3074802684 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46dc0ca050 0x7f46dc0a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.006+0000 7f46e1200640 1 -- 172.21.15.5:0/3074802684 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46dc0ca050 msgr2=0x7f46dc0a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.006+0000 7f46e1200640 1 --2- 172.21.15.5:0/3074802684 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46dc0ca050 0x7f46dc0a9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.006+0000 7f46e1200640 1 -- 172.21.15.5:0/3074802684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46dc0add30 msgr2=0x7f46dc0a9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.006+0000 7f46e1200640 1 --2- 172.21.15.5:0/3074802684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46dc0add30 0x7f46dc0a9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.006+0000 7f46e1200640 1 -- 172.21.15.5:0/3074802684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d4009a20 con 0x7f46dc0ad960 2024-08-17T02:24:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.006+0000 7f46dbe00640 1 --2- 172.21.15.5:0/3074802684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46dc0add30 0x7f46dc0a9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:10.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.007+0000 7f46e1200640 1 --2- 172.21.15.5:0/3074802684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46dc0ad960 0x7f46dc1432f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f46d000c790 tx=0x7f46d0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:10.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.007+0000 7f46cfe00640 1 -- 172.21.15.5:0/3074802684 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d000a640 con 0x7f46dc0ad960 2024-08-17T02:24:10.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.007+0000 7f46cfe00640 1 -- 172.21.15.5:0/3074802684 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d000a7a0 con 0x7f46dc0ad960 2024-08-17T02:24:10.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.007+0000 7f46cfe00640 1 -- 172.21.15.5:0/3074802684 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d000ab60 con 0x7f46dc0ad960 2024-08-17T02:24:10.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.007+0000 7f46e3c00640 1 -- 172.21.15.5:0/3074802684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46dc15e2c0 con 0x7f46dc0ad960 2024-08-17T02:24:10.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.007+0000 7f46e3c00640 1 -- 172.21.15.5:0/3074802684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46dc143830 con 0x7f46dc0ad960 2024-08-17T02:24:10.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.008+0000 7f46e3c00640 1 -- 172.21.15.5:0/3074802684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46dc063fb0 con 0x7f46dc0ad960 2024-08-17T02:24:10.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.009+0000 7f46cfe00640 1 -- 172.21.15.5:0/3074802684 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f46d0012440 con 0x7f46dc0ad960 2024-08-17T02:24:10.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.010+0000 7f46cfe00640 1 --2- 172.21.15.5:0/3074802684 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f46bc065150 0x7f46bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.010+0000 7f46cfe00640 1 -- 172.21.15.5:0/3074802684 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f46d0082090 con 0x7f46dc0ad960 2024-08-17T02:24:10.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.010+0000 7f46dbe00640 1 --2- 172.21.15.5:0/3074802684 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f46bc065150 0x7f46bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.010+0000 7f46dbe00640 1 --2- 172.21.15.5:0/3074802684 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f46bc065150 0x7f46bc067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0c8c10 tx=0x7f46c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:10.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.013+0000 7f46cfe00640 1 -- 172.21.15.5:0/3074802684 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f46d0050160 con 0x7f46dc0ad960 2024-08-17T02:24:10.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.236+0000 7f46e3c00640 1 -- 172.21.15.5:0/3074802684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46dc153c80 con 0x7f46dc0ad960 2024-08-17T02:24:10.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.237+0000 7f46cfe00640 1 -- 172.21.15.5:0/3074802684 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4582 (secure 0 0 0) 0x7f46d0002e60 con 0x7f46dc0ad960 2024-08-17T02:24:10.238 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:10.239 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/2870814974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2870814974},{"type":"v1","addr":"172.21.15.87:6834","nonce":2870814974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/508600504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":508600504},{"type":"v1","addr":"172.21.15.5:6835","nonce":508600504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3215918333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3215918333},{"type":"v1","addr":"172.21.15.5:6837","nonce":3215918333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:34.987476+0000","modified":"2024-08-17T02:23:38.593683+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/3443816405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3443816405},{"type":"v1","addr":"172.21.15.87:6835","nonce":3443816405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:24:10.241 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-08-17T02:24:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.239+0000 7f46e3c00640 1 -- 172.21.15.5:0/3074802684 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f46bc065150 msgr2=0x7f46bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.239+0000 7f46e3c00640 1 --2- 172.21.15.5:0/3074802684 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f46bc065150 0x7f46bc067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0c8c10 tx=0x7f46c8009040 comp rx=0 tx=0).stop 2024-08-17T02:24:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.239+0000 7f46e3c00640 1 -- 172.21.15.5:0/3074802684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46dc0ad960 msgr2=0x7f46dc1432f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.239+0000 7f46e3c00640 1 --2- 172.21.15.5:0/3074802684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46dc0ad960 0x7f46dc1432f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f46d000c790 tx=0x7f46d0007e10 comp rx=0 tx=0).stop 2024-08-17T02:24:10.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.239+0000 7f46e3c00640 1 -- 172.21.15.5:0/3074802684 shutdown_connections 2024-08-17T02:24:10.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.239+0000 7f46e3c00640 1 --2- 172.21.15.5:0/3074802684 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f46bc065150 0x7f46bc067600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.239+0000 7f46e3c00640 1 --2- 172.21.15.5:0/3074802684 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46dc0ca050 0x7f46dc0a9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.239+0000 7f46e3c00640 1 --2- 172.21.15.5:0/3074802684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46dc0add30 0x7f46dc0a9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.239+0000 7f46e3c00640 1 --2- 172.21.15.5:0/3074802684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46dc0ad960 0x7f46dc1432f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.239+0000 7f46e3c00640 1 -- 172.21.15.5:0/3074802684 >> 172.21.15.5:0/3074802684 conn(0x7f46dc066e60 msgr2=0x7f46dc155550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:10.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.239+0000 7f46e3c00640 1 -- 172.21.15.5:0/3074802684 shutdown_connections 2024-08-17T02:24:10.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.239+0000 7f46e3c00640 1 -- 172.21.15.5:0/3074802684 wait complete. 2024-08-17T02:24:10.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:10.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.407+0000 7fc6aee00640 1 Processor -- start 2024-08-17T02:24:10.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.407+0000 7fc6aee00640 1 -- start start 2024-08-17T02:24:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.409+0000 7fc6aee00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc6a80ad960 0x7fc6a815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.409+0000 7fc6aee00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc6a80add30 0x7fc6a8156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.409+0000 7fc6aee00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a815b5e0 con 0x7fc6a80ca050 2024-08-17T02:24:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.409+0000 7fc6aee00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a80cb160 con 0x7fc6a80ad960 2024-08-17T02:24:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.409+0000 7fc6aee00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a80b0d10 con 0x7fc6a80add30 2024-08-17T02:24:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.409+0000 7fc6a7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc6a80ad960 0x7fc6a815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.409+0000 7fc6a7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc6a80ad960 0x7fc6a815b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48592/0 (socket says 172.21.15.5:48592) 2024-08-17T02:24:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.409+0000 7fc6a7e00640 1 -- 172.21.15.5:0/2558560384 learned_addr learned my addr 172.21.15.5:0/2558560384 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.409+0000 7fc6ace00640 1 --2- 172.21.15.5:0/2558560384 >> v2:172.21.15.87:3300/0 conn(0x7fc6a80add30 0x7fc6a8156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.409+0000 7fc6a7e00640 1 -- 172.21.15.5:0/2558560384 >> v2:172.21.15.87:3300/0 conn(0x7fc6a80add30 msgr2=0x7fc6a8156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:10.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.409+0000 7fc6a7e00640 1 --2- 172.21.15.5:0/2558560384 >> v2:172.21.15.87:3300/0 conn(0x7fc6a80add30 0x7fc6a8156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.409+0000 7fc6a7e00640 1 -- 172.21.15.5:0/2558560384 >> v1:172.21.15.5:6789/0 conn(0x7fc6a80ca050 legacy=0x7fc6a8156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.409+0000 7fc6a7e00640 1 -- 172.21.15.5:0/2558560384 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a80ca550 con 0x7fc6a80ad960 2024-08-17T02:24:10.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.409+0000 7fc6ace00640 1 --2- 172.21.15.5:0/2558560384 >> v2:172.21.15.87:3300/0 conn(0x7fc6a80add30 0x7fc6a8156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:10.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.410+0000 7fc6a7e00640 1 --2- 172.21.15.5:0/2558560384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6a80ad960 0x7fc6a815b0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80cb0d0 tx=0x7fc6980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16908b747d2545f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:10.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.411+0000 7fc6a7400640 1 -- 172.21.15.5:0/2558560384 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698032440 con 0x7fc6a80ad960 2024-08-17T02:24:10.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.411+0000 7fc6a7400640 1 -- 172.21.15.5:0/2558560384 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6980325a0 con 0x7fc6a80ad960 2024-08-17T02:24:10.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.411+0000 7fc6a7400640 1 -- 172.21.15.5:0/2558560384 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698032980 con 0x7fc6a80ad960 2024-08-17T02:24:10.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.411+0000 7fc6aee00640 1 -- 172.21.15.5:0/2558560384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6a80ad960 msgr2=0x7fc6a815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.411+0000 7fc6aee00640 1 --2- 172.21.15.5:0/2558560384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6a80ad960 0x7fc6a815b0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80cb0d0 tx=0x7fc6980091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.411+0000 7fc6aee00640 1 -- 172.21.15.5:0/2558560384 shutdown_connections 2024-08-17T02:24:10.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.411+0000 7fc6aee00640 1 --2- 172.21.15.5:0/2558560384 >> v2:172.21.15.87:3300/0 conn(0x7fc6a80add30 0x7fc6a8156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.411+0000 7fc6aee00640 1 --2- 172.21.15.5:0/2558560384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6a80ad960 0x7fc6a815b0a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.411+0000 7fc6aee00640 1 -- 172.21.15.5:0/2558560384 >> 172.21.15.5:0/2558560384 conn(0x7fc6a8066e60 msgr2=0x7fc6a8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:10.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.411+0000 7fc6aee00640 1 -- 172.21.15.5:0/2558560384 shutdown_connections 2024-08-17T02:24:10.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.411+0000 7fc6aee00640 1 -- 172.21.15.5:0/2558560384 wait complete. 2024-08-17T02:24:10.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.413+0000 7fc6aee00640 1 Processor -- start 2024-08-17T02:24:10.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.413+0000 7fc6aee00640 1 -- start start 2024-08-17T02:24:10.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.414+0000 7fc6aee00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6a80ad960 0x7fc6a8169060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.414+0000 7fc6aee00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6a80add30 0x7fc6a8140f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.414+0000 7fc6aee00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc6a80ca050 0x7fc6a81580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.414+0000 7fc6aee00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80a8a10 con 0x7fc6a80ad960 2024-08-17T02:24:10.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.414+0000 7fc6aee00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a8169640 con 0x7fc6a80add30 2024-08-17T02:24:10.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.414+0000 7fc6aee00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a8169920 con 0x7fc6a80ca050 2024-08-17T02:24:10.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.414+0000 7fc6a7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6a80ad960 0x7fc6a8169060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.414+0000 7fc6a7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6a80ad960 0x7fc6a8169060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48600/0 (socket says 172.21.15.5:48600) 2024-08-17T02:24:10.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.414+0000 7fc6a7e00640 1 -- 172.21.15.5:0/2090979294 learned_addr learned my addr 172.21.15.5:0/2090979294 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.414+0000 7fc6ace00640 1 --2- 172.21.15.5:0/2090979294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc6a80ca050 0x7fc6a81580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.414+0000 7fc69fe00640 1 --2- 172.21.15.5:0/2090979294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6a80add30 0x7fc6a8140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.414+0000 7fc6a7e00640 1 -- 172.21.15.5:0/2090979294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc6a80ca050 msgr2=0x7fc6a81580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.414+0000 7fc6a7e00640 1 --2- 172.21.15.5:0/2090979294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc6a80ca050 0x7fc6a81580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.414+0000 7fc6a7e00640 1 -- 172.21.15.5:0/2090979294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6a80add30 msgr2=0x7fc6a8140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.414+0000 7fc6a7e00640 1 --2- 172.21.15.5:0/2090979294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6a80add30 0x7fc6a8140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.414+0000 7fc6a7e00640 1 -- 172.21.15.5:0/2090979294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc698009450 con 0x7fc6a80ad960 2024-08-17T02:24:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.415+0000 7fc6a7e00640 1 --2- 172.21.15.5:0/2090979294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6a80ad960 0x7fc6a8169060 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc698009210 tx=0x7fc698032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.415+0000 7fc69f400640 1 -- 172.21.15.5:0/2090979294 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698031c80 con 0x7fc6a80ad960 2024-08-17T02:24:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.415+0000 7fc69f400640 1 -- 172.21.15.5:0/2090979294 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc698031e00 con 0x7fc6a80ad960 2024-08-17T02:24:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.415+0000 7fc69f400640 1 -- 172.21.15.5:0/2090979294 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69803d670 con 0x7fc6a80ad960 2024-08-17T02:24:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.415+0000 7fc6aee00640 1 -- 172.21.15.5:0/2090979294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a8169c00 con 0x7fc6a80ad960 2024-08-17T02:24:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.415+0000 7fc6aee00640 1 -- 172.21.15.5:0/2090979294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a8141440 con 0x7fc6a80ad960 2024-08-17T02:24:10.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.416+0000 7fc6aee00640 1 -- 172.21.15.5:0/2090979294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a8063fb0 con 0x7fc6a80ad960 2024-08-17T02:24:10.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.417+0000 7fc69f400640 1 -- 172.21.15.5:0/2090979294 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc698039040 con 0x7fc6a80ad960 2024-08-17T02:24:10.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.418+0000 7fc69f400640 1 --2- 172.21.15.5:0/2090979294 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc684065180 0x7fc684067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.418+0000 7fc69f400640 1 -- 172.21.15.5:0/2090979294 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc6980a2300 con 0x7fc6a80ad960 2024-08-17T02:24:10.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.418+0000 7fc69fe00640 1 --2- 172.21.15.5:0/2090979294 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc684065180 0x7fc684067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.419+0000 7fc69fe00640 1 --2- 172.21.15.5:0/2090979294 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc684065180 0x7fc684067630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80b0800 tx=0x7fc690009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:10.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.422+0000 7fc69f400640 1 -- 172.21.15.5:0/2090979294 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc698070320 con 0x7fc6a80ad960 2024-08-17T02:24:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.611+0000 7fc6aee00640 1 -- 172.21.15.5:0/2090979294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6a81523b0 con 0x7fc6a80ad960 2024-08-17T02:24:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.612+0000 7fc69f400640 1 -- 172.21.15.5:0/2090979294 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fc698073940 con 0x7fc6a80ad960 2024-08-17T02:24:10.613 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:10.613 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:36.575545+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:32.642845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:33.982937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.614+0000 7fc6aee00640 1 -- 172.21.15.5:0/2090979294 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc684065180 msgr2=0x7fc684067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.614+0000 7fc6aee00640 1 --2- 172.21.15.5:0/2090979294 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc684065180 0x7fc684067630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80b0800 tx=0x7fc690009040 comp rx=0 tx=0).stop 2024-08-17T02:24:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.614+0000 7fc6aee00640 1 -- 172.21.15.5:0/2090979294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6a80ad960 msgr2=0x7fc6a8169060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.614+0000 7fc6aee00640 1 --2- 172.21.15.5:0/2090979294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6a80ad960 0x7fc6a8169060 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc698009210 tx=0x7fc698032000 comp rx=0 tx=0).stop 2024-08-17T02:24:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.614+0000 7fc6aee00640 1 -- 172.21.15.5:0/2090979294 shutdown_connections 2024-08-17T02:24:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.614+0000 7fc6aee00640 1 --2- 172.21.15.5:0/2090979294 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc684065180 0x7fc684067630 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.614+0000 7fc6aee00640 1 --2- 172.21.15.5:0/2090979294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc6a80ca050 0x7fc6a81580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.614+0000 7fc6aee00640 1 --2- 172.21.15.5:0/2090979294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6a80add30 0x7fc6a8140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.614+0000 7fc6aee00640 1 --2- 172.21.15.5:0/2090979294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6a80ad960 0x7fc6a8169060 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.614+0000 7fc6aee00640 1 -- 172.21.15.5:0/2090979294 >> 172.21.15.5:0/2090979294 conn(0x7fc6a8066e60 msgr2=0x7fc6a815a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.615+0000 7fc6aee00640 1 -- 172.21.15.5:0/2090979294 shutdown_connections 2024-08-17T02:24:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.615+0000 7fc6aee00640 1 -- 172.21.15.5:0/2090979294 wait complete. 2024-08-17T02:24:10.630 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:28.773677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:23:32.642845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:23:33.982937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:24:10.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:10.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.784+0000 7f5757c00640 1 Processor -- start 2024-08-17T02:24:10.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.784+0000 7f5757c00640 1 -- start start 2024-08-17T02:24:10.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.785+0000 7f5757c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5750156730 0x7f57500ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.785+0000 7f5757c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5750156b00 0x7f57500caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.785+0000 7f5757c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57500ce6a0 con 0x7f57500cc6a0 2024-08-17T02:24:10.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.785+0000 7f5757c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57500cddb0 con 0x7f5750156b00 2024-08-17T02:24:10.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.785+0000 7f5757c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f575015a2c0 con 0x7f5750156730 2024-08-17T02:24:10.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.785+0000 7f574fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5750156b00 0x7f57500caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.786+0000 7f574fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5750156b00 0x7f57500caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48606/0 (socket says 172.21.15.5:48606) 2024-08-17T02:24:10.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.786+0000 7f574fe00640 1 -- 172.21.15.5:0/187239966 learned_addr learned my addr 172.21.15.5:0/187239966 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:10.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.786+0000 7f5755200640 1 --2- 172.21.15.5:0/187239966 >> v2:172.21.15.87:3300/0 conn(0x7f5750156730 0x7f57500ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.786+0000 7f574fe00640 1 -- 172.21.15.5:0/187239966 >> v2:172.21.15.87:3300/0 conn(0x7f5750156730 msgr2=0x7f57500ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:10.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.786+0000 7f574fe00640 1 --2- 172.21.15.5:0/187239966 >> v2:172.21.15.87:3300/0 conn(0x7f5750156730 0x7f57500ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.786+0000 7f574fe00640 1 -- 172.21.15.5:0/187239966 >> v1:172.21.15.87:6789/0 conn(0x7f57500cc6a0 legacy=0x7f57500ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.786+0000 7f574fe00640 1 -- 172.21.15.5:0/187239966 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57500cfb40 con 0x7f5750156b00 2024-08-17T02:24:10.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.787+0000 7f574fe00640 1 --2- 172.21.15.5:0/187239966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5750156b00 0x7f57500caaf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5750088030 tx=0x7f573c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16b264f9d99153 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.787+0000 7f574f400640 1 -- 172.21.15.5:0/187239966 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c02adf0 con 0x7f5750156b00 2024-08-17T02:24:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.787+0000 7f574f400640 1 -- 172.21.15.5:0/187239966 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c032440 con 0x7f5750156b00 2024-08-17T02:24:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.787+0000 7f574f400640 1 -- 172.21.15.5:0/187239966 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c032820 con 0x7f5750156b00 2024-08-17T02:24:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.788+0000 7f5757c00640 1 -- 172.21.15.5:0/187239966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5750156b00 msgr2=0x7f57500caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.788+0000 7f5757c00640 1 --2- 172.21.15.5:0/187239966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5750156b00 0x7f57500caaf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5750088030 tx=0x7f573c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.788+0000 7f5757c00640 1 -- 172.21.15.5:0/187239966 shutdown_connections 2024-08-17T02:24:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.788+0000 7f5757c00640 1 --2- 172.21.15.5:0/187239966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5750156b00 0x7f57500caaf0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.788+0000 7f5757c00640 1 --2- 172.21.15.5:0/187239966 >> v2:172.21.15.87:3300/0 conn(0x7f5750156730 0x7f57500ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.788+0000 7f5757c00640 1 -- 172.21.15.5:0/187239966 >> 172.21.15.5:0/187239966 conn(0x7f575006e590 msgr2=0x7f575006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.788+0000 7f5757c00640 1 -- 172.21.15.5:0/187239966 shutdown_connections 2024-08-17T02:24:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.788+0000 7f5757c00640 1 -- 172.21.15.5:0/187239966 wait complete. 2024-08-17T02:24:10.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.789+0000 7f5757c00640 1 Processor -- start 2024-08-17T02:24:10.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.789+0000 7f5757c00640 1 -- start start 2024-08-17T02:24:10.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.790+0000 7f5757c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57500cc6a0 0x7f57500b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.790+0000 7f5757c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5750156730 0x7f575015d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.790+0000 7f5757c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5750156b00 0x7f5750154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.790+0000 7f5757c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57500b50e0 con 0x7f5750156b00 2024-08-17T02:24:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.790+0000 7f5757c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57500b44d0 con 0x7f5750156730 2024-08-17T02:24:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.790+0000 7f5757c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57500b47b0 con 0x7f57500cc6a0 2024-08-17T02:24:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.791+0000 7f5755c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5750156b00 0x7f5750154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.791+0000 7f5755c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5750156b00 0x7f5750154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48614/0 (socket says 172.21.15.5:48614) 2024-08-17T02:24:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.791+0000 7f5755c00640 1 -- 172.21.15.5:0/2226444846 learned_addr learned my addr 172.21.15.5:0/2226444846 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.791+0000 7f574fe00640 1 --2- 172.21.15.5:0/2226444846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5750156730 0x7f575015d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.791+0000 7f5755200640 1 --2- 172.21.15.5:0/2226444846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57500cc6a0 0x7f57500b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.791+0000 7f5755c00640 1 -- 172.21.15.5:0/2226444846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57500cc6a0 msgr2=0x7f57500b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.791+0000 7f5755c00640 1 --2- 172.21.15.5:0/2226444846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57500cc6a0 0x7f57500b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.791+0000 7f5755c00640 1 -- 172.21.15.5:0/2226444846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5750156730 msgr2=0x7f575015d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.791+0000 7f5755c00640 1 --2- 172.21.15.5:0/2226444846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5750156730 0x7f575015d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.791+0000 7f5755c00640 1 -- 172.21.15.5:0/2226444846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c009450 con 0x7f5750156b00 2024-08-17T02:24:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.791+0000 7f5755c00640 1 --2- 172.21.15.5:0/2226444846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5750156b00 0x7f5750154710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f574800c7c0 tx=0x7f57480015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.792+0000 7f5743e00640 1 -- 172.21.15.5:0/2226444846 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574800a640 con 0x7f5750156b00 2024-08-17T02:24:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.792+0000 7f5743e00640 1 -- 172.21.15.5:0/2226444846 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574800a7c0 con 0x7f5750156b00 2024-08-17T02:24:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.792+0000 7f5757c00640 1 -- 172.21.15.5:0/2226444846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57500b4a90 con 0x7f5750156b00 2024-08-17T02:24:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.792+0000 7f5743e00640 1 -- 172.21.15.5:0/2226444846 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574800ab80 con 0x7f5750156b00 2024-08-17T02:24:10.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.792+0000 7f5757c00640 1 -- 172.21.15.5:0/2226444846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575015d6b0 con 0x7f5750156b00 2024-08-17T02:24:10.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.793+0000 7f5757c00640 1 -- 172.21.15.5:0/2226444846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5750063fb0 con 0x7f5750156b00 2024-08-17T02:24:10.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.793+0000 7f5743e00640 1 -- 172.21.15.5:0/2226444846 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5748003030 con 0x7f5750156b00 2024-08-17T02:24:10.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.794+0000 7f5743e00640 1 --2- 172.21.15.5:0/2226444846 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5730065150 0x7f5730067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.794+0000 7f5743e00640 1 -- 172.21.15.5:0/2226444846 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5748082360 con 0x7f5750156b00 2024-08-17T02:24:10.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.795+0000 7f5755200640 1 --2- 172.21.15.5:0/2226444846 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5730065150 0x7f5730067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.795+0000 7f5755200640 1 --2- 172.21.15.5:0/2226444846 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5730065150 0x7f5730067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5744009d20 tx=0x7f57440090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:10.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.798+0000 7f5743e00640 1 -- 172.21.15.5:0/2226444846 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5748050430 con 0x7f5750156b00 2024-08-17T02:24:10.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.981+0000 7f5757c00640 1 -- 172.21.15.5:0/2226444846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57500b2260 con 0x7f5750156b00 2024-08-17T02:24:10.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.982+0000 7f5743e00640 1 -- 172.21.15.5:0/2226444846 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5748053a50 con 0x7f5750156b00 2024-08-17T02:24:10.983 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:24:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.984+0000 7f5757c00640 1 -- 172.21.15.5:0/2226444846 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5730065150 msgr2=0x7f5730067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.984+0000 7f5757c00640 1 --2- 172.21.15.5:0/2226444846 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5730065150 0x7f5730067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5744009d20 tx=0x7f57440090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.984+0000 7f5757c00640 1 -- 172.21.15.5:0/2226444846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5750156b00 msgr2=0x7f5750154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.984+0000 7f5757c00640 1 --2- 172.21.15.5:0/2226444846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5750156b00 0x7f5750154710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f574800c7c0 tx=0x7f57480015f0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.984+0000 7f5757c00640 1 -- 172.21.15.5:0/2226444846 shutdown_connections 2024-08-17T02:24:10.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.984+0000 7f5757c00640 1 --2- 172.21.15.5:0/2226444846 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5730065150 0x7f5730067600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.984+0000 7f5757c00640 1 --2- 172.21.15.5:0/2226444846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5750156b00 0x7f5750154710 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.984+0000 7f5757c00640 1 --2- 172.21.15.5:0/2226444846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5750156730 0x7f575015d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.984+0000 7f5757c00640 1 --2- 172.21.15.5:0/2226444846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57500cc6a0 0x7f57500b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:10.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.984+0000 7f5757c00640 1 -- 172.21.15.5:0/2226444846 >> 172.21.15.5:0/2226444846 conn(0x7f575006e590 msgr2=0x7f575006e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:10.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.985+0000 7f5757c00640 1 -- 172.21.15.5:0/2226444846 shutdown_connections 2024-08-17T02:24:10.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:10.985+0000 7f5757c00640 1 -- 172.21.15.5:0/2226444846 wait complete. 2024-08-17T02:24:11.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:24:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.157+0000 7f70fe000640 1 Processor -- start 2024-08-17T02:24:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.157+0000 7f70fe000640 1 -- start start 2024-08-17T02:24:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.158+0000 7f70fe000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70f8158b90 0x7f70f80b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.158+0000 7f70fe000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f70f80af130 0x7f70f80ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.158+0000 7f70fe000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f80afd20 con 0x7f70f80b2370 2024-08-17T02:24:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.158+0000 7f70fe000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f80affe0 con 0x7f70f8158b90 2024-08-17T02:24:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.158+0000 7f70fe000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f80b02c0 con 0x7f70f80af130 2024-08-17T02:24:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.158+0000 7f70f7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70f8158b90 0x7f70f80b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.158+0000 7f70f7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70f8158b90 0x7f70f80b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48630/0 (socket says 172.21.15.5:48630) 2024-08-17T02:24:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.158+0000 7f70f7400640 1 -- 172.21.15.5:0/3125995403 learned_addr learned my addr 172.21.15.5:0/3125995403 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.159+0000 7f70f7e00640 1 --2- 172.21.15.5:0/3125995403 >> v2:172.21.15.87:3300/0 conn(0x7f70f80af130 0x7f70f80ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.159+0000 7f70f7400640 1 -- 172.21.15.5:0/3125995403 >> v2:172.21.15.87:3300/0 conn(0x7f70f80af130 msgr2=0x7f70f80ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.159+0000 7f70f7400640 1 --2- 172.21.15.5:0/3125995403 >> v2:172.21.15.87:3300/0 conn(0x7f70f80af130 0x7f70f80ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.159+0000 7f70f7400640 1 -- 172.21.15.5:0/3125995403 >> v1:172.21.15.87:6789/0 conn(0x7f70f80b2370 legacy=0x7f70f80aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.159+0000 7f70f7400640 1 -- 172.21.15.5:0/3125995403 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f80ca3c0 con 0x7f70f8158b90 2024-08-17T02:24:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.160+0000 7f70f7400640 1 --2- 172.21.15.5:0/3125995403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f8158b90 0x7f70f80b1e30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f70f80cd650 tx=0x7f70e80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80c97db055bafdf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.160+0000 7f70f6000640 1 -- 172.21.15.5:0/3125995403 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e802adb0 con 0x7f70f8158b90 2024-08-17T02:24:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.160+0000 7f70f6000640 1 -- 172.21.15.5:0/3125995403 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e8032440 con 0x7f70f8158b90 2024-08-17T02:24:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.160+0000 7f70f6000640 1 -- 172.21.15.5:0/3125995403 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8032820 con 0x7f70f8158b90 2024-08-17T02:24:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.161+0000 7f70fe000640 1 -- 172.21.15.5:0/3125995403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f8158b90 msgr2=0x7f70f80b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.161+0000 7f70fe000640 1 --2- 172.21.15.5:0/3125995403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f8158b90 0x7f70f80b1e30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f70f80cd650 tx=0x7f70e80091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.161+0000 7f70fe000640 1 -- 172.21.15.5:0/3125995403 shutdown_connections 2024-08-17T02:24:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.161+0000 7f70fe000640 1 --2- 172.21.15.5:0/3125995403 >> v2:172.21.15.87:3300/0 conn(0x7f70f80af130 0x7f70f80ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.161+0000 7f70fe000640 1 --2- 172.21.15.5:0/3125995403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f8158b90 0x7f70f80b1e30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.161+0000 7f70fe000640 1 -- 172.21.15.5:0/3125995403 >> 172.21.15.5:0/3125995403 conn(0x7f70f806e590 msgr2=0x7f70f806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.161+0000 7f70fe000640 1 -- 172.21.15.5:0/3125995403 shutdown_connections 2024-08-17T02:24:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.161+0000 7f70fe000640 1 -- 172.21.15.5:0/3125995403 wait complete. 2024-08-17T02:24:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.162+0000 7f70fe000640 1 Processor -- start 2024-08-17T02:24:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.162+0000 7f70fe000640 1 -- start start 2024-08-17T02:24:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.163+0000 7f70fe000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70f80af130 0x7f70f806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.163+0000 7f70fe000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70f80b2370 0x7f70f80cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.163+0000 7f70fe000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f8158b90 0x7f70f8157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.163+0000 7f70fe000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f806cd10 con 0x7f70f8158b90 2024-08-17T02:24:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.163+0000 7f70fe000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80c7ca0 con 0x7f70f80af130 2024-08-17T02:24:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.163+0000 7f70fe000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f806cf40 con 0x7f70f80b2370 2024-08-17T02:24:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.164+0000 7f70f7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f8158b90 0x7f70f8157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.164+0000 7f70f7400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70f80af130 0x7f70f806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.164+0000 7f70f7400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70f80af130 0x7f70f806dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:37364/0 (socket says 172.21.15.5:37364) 2024-08-17T02:24:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.164+0000 7f70f7400640 1 -- 172.21.15.5:0/279979922 learned_addr learned my addr 172.21.15.5:0/279979922 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.164+0000 7f70f6a00640 1 --2- 172.21.15.5:0/279979922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70f80b2370 0x7f70f80cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.164+0000 7f70f7e00640 1 -- 172.21.15.5:0/279979922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70f80b2370 msgr2=0x7f70f80cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.164+0000 7f70f7e00640 1 --2- 172.21.15.5:0/279979922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70f80b2370 0x7f70f80cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.164+0000 7f70f7e00640 1 -- 172.21.15.5:0/279979922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70f80af130 msgr2=0x7f70f806dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.164+0000 7f70f7e00640 1 --2- 172.21.15.5:0/279979922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70f80af130 0x7f70f806dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.164+0000 7f70f7e00640 1 -- 172.21.15.5:0/279979922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e8009450 con 0x7f70f8158b90 2024-08-17T02:24:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.164+0000 7f70f7e00640 1 --2- 172.21.15.5:0/279979922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f8158b90 0x7f70f8157270 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f70f0007e70 tx=0x7f70f00097b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.164+0000 7f70eea00640 1 -- 172.21.15.5:0/279979922 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0018070 con 0x7f70f8158b90 2024-08-17T02:24:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.165+0000 7f70eea00640 1 -- 172.21.15.5:0/279979922 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f000ed60 con 0x7f70f8158b90 2024-08-17T02:24:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.165+0000 7f70eea00640 1 -- 172.21.15.5:0/279979922 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0014650 con 0x7f70f8158b90 2024-08-17T02:24:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.165+0000 7f70fe000640 1 -- 172.21.15.5:0/279979922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f806d220 con 0x7f70f8158b90 2024-08-17T02:24:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.165+0000 7f70fe000640 1 -- 172.21.15.5:0/279979922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f806e240 con 0x7f70f8158b90 2024-08-17T02:24:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.166+0000 7f70fe000640 1 -- 172.21.15.5:0/279979922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f8064780 con 0x7f70f8158b90 2024-08-17T02:24:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.167+0000 7f70eea00640 1 -- 172.21.15.5:0/279979922 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f70f0003020 con 0x7f70f8158b90 2024-08-17T02:24:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.167+0000 7f70eea00640 1 --2- 172.21.15.5:0/279979922 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f70d8065150 0x7f70d8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.168+0000 7f70eea00640 1 -- 172.21.15.5:0/279979922 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f70f0082520 con 0x7f70f8158b90 2024-08-17T02:24:11.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.168+0000 7f70f7400640 1 --2- 172.21.15.5:0/279979922 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f70d8065150 0x7f70d8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.168+0000 7f70f7400640 1 --2- 172.21.15.5:0/279979922 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f70d8065150 0x7f70d8067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f70e80093f0 tx=0x7f70e8032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.172+0000 7f70eea00640 1 -- 172.21.15.5:0/279979922 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f70f0050690 con 0x7f70f8158b90 2024-08-17T02:24:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.355+0000 7f70fe000640 1 -- 172.21.15.5:0/279979922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70f806da00 con 0x7f70f8158b90 2024-08-17T02:24:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.355+0000 7f70eea00640 1 -- 172.21.15.5:0/279979922 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70f0080e60 con 0x7f70f8158b90 2024-08-17T02:24:11.356 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:24:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.357+0000 7f70fe000640 1 -- 172.21.15.5:0/279979922 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f70d8065150 msgr2=0x7f70d8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.357+0000 7f70fe000640 1 --2- 172.21.15.5:0/279979922 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f70d8065150 0x7f70d8067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f70e80093f0 tx=0x7f70e8032000 comp rx=0 tx=0).stop 2024-08-17T02:24:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.357+0000 7f70fe000640 1 -- 172.21.15.5:0/279979922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f8158b90 msgr2=0x7f70f8157270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.357+0000 7f70fe000640 1 --2- 172.21.15.5:0/279979922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f8158b90 0x7f70f8157270 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f70f0007e70 tx=0x7f70f00097b0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.357+0000 7f70fe000640 1 -- 172.21.15.5:0/279979922 shutdown_connections 2024-08-17T02:24:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.357+0000 7f70fe000640 1 --2- 172.21.15.5:0/279979922 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f70d8065150 0x7f70d8067600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.357+0000 7f70fe000640 1 --2- 172.21.15.5:0/279979922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70f80b2370 0x7f70f80cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.357+0000 7f70fe000640 1 --2- 172.21.15.5:0/279979922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f8158b90 0x7f70f8157270 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.357+0000 7f70fe000640 1 --2- 172.21.15.5:0/279979922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70f80af130 0x7f70f806dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.357+0000 7f70fe000640 1 -- 172.21.15.5:0/279979922 >> 172.21.15.5:0/279979922 conn(0x7f70f806e590 msgr2=0x7f70f80ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:11.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.357+0000 7f70fe000640 1 -- 172.21.15.5:0/279979922 shutdown_connections 2024-08-17T02:24:11.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.357+0000 7f70fe000640 1 -- 172.21.15.5:0/279979922 wait complete. 2024-08-17T02:24:11.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.526+0000 7f9bd6400640 1 Processor -- start 2024-08-17T02:24:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.526+0000 7f9bd6400640 1 -- start start 2024-08-17T02:24:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.528+0000 7f9bd6400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9bd00add30 0x7f9bd0156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.528+0000 7f9bd6400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd00cb160 con 0x7f9bd00ca050 2024-08-17T02:24:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.528+0000 7f9bd6400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd00b0d10 con 0x7f9bd00ad960 2024-08-17T02:24:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.528+0000 7f9bd6400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd00ca550 con 0x7f9bd00add30 2024-08-17T02:24:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.528+0000 7f9bc7e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9bd00ca050 0x7f9bd00aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35884/0 (socket says 172.21.15.5:35884) 2024-08-17T02:24:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.528+0000 7f9bc7e00640 1 -- 172.21.15.5:0/4195289210 learned_addr learned my addr 172.21.15.5:0/4195289210 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.528+0000 7f9bcfe00640 1 --2- 172.21.15.5:0/4195289210 >> v2:172.21.15.87:3300/0 conn(0x7f9bd00add30 0x7f9bd0156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.528+0000 7f9bcea00640 1 -- 172.21.15.5:0/4195289210 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865577273 0 0) 0x7f9bd00cb160 con 0x7f9bd00ca050 2024-08-17T02:24:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.528+0000 7f9bcea00640 1 -- 172.21.15.5:0/4195289210 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bb40034e0 con 0x7f9bd00ca050 2024-08-17T02:24:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.529+0000 7f9bcfe00640 1 -- 172.21.15.5:0/4195289210 >> v1:172.21.15.87:6789/0 conn(0x7f9bd00ad960 legacy=0x7f9bd0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.529+0000 7f9bcfe00640 1 -- 172.21.15.5:0/4195289210 >> v1:172.21.15.5:6789/0 conn(0x7f9bd00ca050 legacy=0x7f9bd00aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.529+0000 7f9bcfe00640 1 -- 172.21.15.5:0/4195289210 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd00ca830 con 0x7f9bd00add30 2024-08-17T02:24:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.530+0000 7f9bcfe00640 1 --2- 172.21.15.5:0/4195289210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bd00add30 0x7f9bd0156b30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009e60 tx=0x7f9bc8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6e4f5ba87f04034 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.530+0000 7f9bcea00640 1 -- 172.21.15.5:0/4195289210 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8030560 con 0x7f9bd00add30 2024-08-17T02:24:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.530+0000 7f9bcea00640 1 -- 172.21.15.5:0/4195289210 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc80306c0 con 0x7f9bd00add30 2024-08-17T02:24:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.530+0000 7f9bcea00640 1 -- 172.21.15.5:0/4195289210 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8030a60 con 0x7f9bd00add30 2024-08-17T02:24:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.530+0000 7f9bd6400640 1 -- 172.21.15.5:0/4195289210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bd00add30 msgr2=0x7f9bd0156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.530+0000 7f9bd6400640 1 --2- 172.21.15.5:0/4195289210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bd00add30 0x7f9bd0156b30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009e60 tx=0x7f9bc8009780 comp rx=0 tx=0).stop 2024-08-17T02:24:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.531+0000 7f9bd6400640 1 -- 172.21.15.5:0/4195289210 shutdown_connections 2024-08-17T02:24:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.531+0000 7f9bd6400640 1 --2- 172.21.15.5:0/4195289210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bd00add30 0x7f9bd0156b30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.531+0000 7f9bd6400640 1 -- 172.21.15.5:0/4195289210 >> 172.21.15.5:0/4195289210 conn(0x7f9bd0066e60 msgr2=0x7f9bd0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.531+0000 7f9bd6400640 1 -- 172.21.15.5:0/4195289210 shutdown_connections 2024-08-17T02:24:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.531+0000 7f9bd6400640 1 -- 172.21.15.5:0/4195289210 wait complete. 2024-08-17T02:24:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.532+0000 7f9bd6400640 1 Processor -- start 2024-08-17T02:24:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.532+0000 7f9bd6400640 1 -- start start 2024-08-17T02:24:11.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.533+0000 7f9bd6400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9bd00ad960 0x7f9bd00ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.533+0000 7f9bd6400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bd00add30 0x7f9bd00acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.533+0000 7f9bd6400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bd00ca050 0x7f9bd00c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.533+0000 7f9bd6400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd00ad080 con 0x7f9bd00ca050 2024-08-17T02:24:11.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.533+0000 7f9bd6400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd00c4080 con 0x7f9bd00add30 2024-08-17T02:24:11.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.533+0000 7f9bd6400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd00abaa0 con 0x7f9bd00ad960 2024-08-17T02:24:11.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.533+0000 7f9bcfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bd00ca050 0x7f9bd00c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.534+0000 7f9bcfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bd00ca050 0x7f9bd00c3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48652/0 (socket says 172.21.15.5:48652) 2024-08-17T02:24:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.534+0000 7f9bcfe00640 1 -- 172.21.15.5:0/335292102 learned_addr learned my addr 172.21.15.5:0/335292102 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.534+0000 7f9bc7e00640 1 --2- 172.21.15.5:0/335292102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bd00add30 0x7f9bd00acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.534+0000 7f9bcf400640 1 --2- 172.21.15.5:0/335292102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9bd00ad960 0x7f9bd00ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.534+0000 7f9bcfe00640 1 -- 172.21.15.5:0/335292102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9bd00ad960 msgr2=0x7f9bd00ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.534+0000 7f9bcfe00640 1 --2- 172.21.15.5:0/335292102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9bd00ad960 0x7f9bd00ab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.534+0000 7f9bcfe00640 1 -- 172.21.15.5:0/335292102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bd00add30 msgr2=0x7f9bd00acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.534+0000 7f9bcfe00640 1 --2- 172.21.15.5:0/335292102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bd00add30 0x7f9bd00acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.534+0000 7f9bcfe00640 1 -- 172.21.15.5:0/335292102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc8009a20 con 0x7f9bd00ca050 2024-08-17T02:24:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.534+0000 7f9bc7e00640 1 --2- 172.21.15.5:0/335292102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bd00add30 0x7f9bd00acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.535+0000 7f9bcfe00640 1 --2- 172.21.15.5:0/335292102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bd00ca050 0x7f9bd00c3b40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009e60 tx=0x7f9bc8038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.535+0000 7f9bc6a00640 1 -- 172.21.15.5:0/335292102 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8030560 con 0x7f9bd00ca050 2024-08-17T02:24:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.535+0000 7f9bc6a00640 1 -- 172.21.15.5:0/335292102 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc8030e90 con 0x7f9bd00ca050 2024-08-17T02:24:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.535+0000 7f9bc6a00640 1 -- 172.21.15.5:0/335292102 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc803cd00 con 0x7f9bd00ca050 2024-08-17T02:24:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.535+0000 7f9bd6400640 1 -- 172.21.15.5:0/335292102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd00abd80 con 0x7f9bd00ca050 2024-08-17T02:24:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.535+0000 7f9bd6400640 1 -- 172.21.15.5:0/335292102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd00ac620 con 0x7f9bd00ca050 2024-08-17T02:24:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.536+0000 7f9bd6400640 1 -- 172.21.15.5:0/335292102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd00ac840 con 0x7f9bd00ca050 2024-08-17T02:24:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.537+0000 7f9bc6a00640 1 -- 172.21.15.5:0/335292102 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9bc804f430 con 0x7f9bd00ca050 2024-08-17T02:24:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.537+0000 7f9bc6a00640 1 --2- 172.21.15.5:0/335292102 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9bac065150 0x7f9bac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.538+0000 7f9bc6a00640 1 -- 172.21.15.5:0/335292102 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9bc802e050 con 0x7f9bd00ca050 2024-08-17T02:24:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.538+0000 7f9bcf400640 1 --2- 172.21.15.5:0/335292102 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9bac065150 0x7f9bac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.538+0000 7f9bcf400640 1 --2- 172.21.15.5:0/335292102 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9bac065150 0x7f9bac067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0007fd0 tx=0x7f9bc0007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.541+0000 7f9bc6a00640 1 -- 172.21.15.5:0/335292102 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9bc8071ba0 con 0x7f9bd00ca050 2024-08-17T02:24:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.722+0000 7f9bd6400640 1 -- 172.21.15.5:0/335292102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9bd0063fb0 con 0x7f9bd00ca050 2024-08-17T02:24:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.722+0000 7f9bc6a00640 1 -- 172.21.15.5:0/335292102 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9bc803ce60 con 0x7f9bd00ca050 2024-08-17T02:24:11.723 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-17T02:24:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.725+0000 7f9bd6400640 1 -- 172.21.15.5:0/335292102 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9bac065150 msgr2=0x7f9bac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.725+0000 7f9bd6400640 1 --2- 172.21.15.5:0/335292102 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9bac065150 0x7f9bac067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0007fd0 tx=0x7f9bc0007e30 comp rx=0 tx=0).stop 2024-08-17T02:24:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.725+0000 7f9bd6400640 1 -- 172.21.15.5:0/335292102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bd00ca050 msgr2=0x7f9bd00c3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.725+0000 7f9bd6400640 1 --2- 172.21.15.5:0/335292102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bd00ca050 0x7f9bd00c3b40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009e60 tx=0x7f9bc8038000 comp rx=0 tx=0).stop 2024-08-17T02:24:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.725+0000 7f9bd6400640 1 -- 172.21.15.5:0/335292102 shutdown_connections 2024-08-17T02:24:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.725+0000 7f9bd6400640 1 --2- 172.21.15.5:0/335292102 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9bac065150 0x7f9bac067600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.725+0000 7f9bd6400640 1 --2- 172.21.15.5:0/335292102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bd00ca050 0x7f9bd00c3b40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.725+0000 7f9bd6400640 1 --2- 172.21.15.5:0/335292102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bd00add30 0x7f9bd00acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.725+0000 7f9bd6400640 1 --2- 172.21.15.5:0/335292102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9bd00ad960 0x7f9bd00ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.725+0000 7f9bd6400640 1 -- 172.21.15.5:0/335292102 >> 172.21.15.5:0/335292102 conn(0x7f9bd0066e60 msgr2=0x7f9bd01535b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.725+0000 7f9bd6400640 1 -- 172.21.15.5:0/335292102 shutdown_connections 2024-08-17T02:24:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.725+0000 7f9bd6400640 1 -- 172.21.15.5:0/335292102 wait complete. 2024-08-17T02:24:11.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:11.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.892+0000 7ffa8ee00640 1 Processor -- start 2024-08-17T02:24:11.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.892+0000 7ffa8ee00640 1 -- start start 2024-08-17T02:24:11.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.893+0000 7ffa8ee00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffa88158d50 0x7ffa880ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.893+0000 7ffa8ee00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa88159120 0x7ffa880ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.893+0000 7ffa8ee00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa880ac9e0 0x7ffa880abe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.893+0000 7ffa8ee00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa880a96c0 con 0x7ffa88159120 2024-08-17T02:24:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.893+0000 7ffa8ee00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa880acf00 con 0x7ffa88158d50 2024-08-17T02:24:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.893+0000 7ffa8ee00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880af7d0 con 0x7ffa880ac9e0 2024-08-17T02:24:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.893+0000 7ffa87400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa88159120 0x7ffa880ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.894+0000 7ffa87400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa88159120 0x7ffa880ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48656/0 (socket says 172.21.15.5:48656) 2024-08-17T02:24:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.894+0000 7ffa87400640 1 -- 172.21.15.5:0/3901919457 learned_addr learned my addr 172.21.15.5:0/3901919457 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.894+0000 7ffa87e00640 1 --2- 172.21.15.5:0/3901919457 >> v2:172.21.15.87:3300/0 conn(0x7ffa88158d50 0x7ffa880ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.894+0000 7ffa8ce00640 1 --2- 172.21.15.5:0/3901919457 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa880ac9e0 0x7ffa880abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.894+0000 7ffa87400640 1 -- 172.21.15.5:0/3901919457 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa880ac9e0 msgr2=0x7ffa880abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.894+0000 7ffa87400640 1 --2- 172.21.15.5:0/3901919457 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa880ac9e0 0x7ffa880abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.894+0000 7ffa87400640 1 -- 172.21.15.5:0/3901919457 >> v2:172.21.15.87:3300/0 conn(0x7ffa88158d50 msgr2=0x7ffa880ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.894+0000 7ffa87400640 1 --2- 172.21.15.5:0/3901919457 >> v2:172.21.15.87:3300/0 conn(0x7ffa88158d50 0x7ffa880ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.894+0000 7ffa87400640 1 -- 172.21.15.5:0/3901919457 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa880a98f0 con 0x7ffa88159120 2024-08-17T02:24:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.895+0000 7ffa87400640 1 --2- 172.21.15.5:0/3901919457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa88159120 0x7ffa880ab8f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffa8806ecf0 tx=0x7ffa740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabf87d73de5c74 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.895+0000 7ffa86a00640 1 -- 172.21.15.5:0/3901919457 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7402ad40 con 0x7ffa88159120 2024-08-17T02:24:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.895+0000 7ffa86a00640 1 -- 172.21.15.5:0/3901919457 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa74032440 con 0x7ffa88159120 2024-08-17T02:24:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.895+0000 7ffa86a00640 1 -- 172.21.15.5:0/3901919457 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7402aea0 con 0x7ffa88159120 2024-08-17T02:24:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.896+0000 7ffa8ee00640 1 -- 172.21.15.5:0/3901919457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa88159120 msgr2=0x7ffa880ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.896+0000 7ffa8ee00640 1 --2- 172.21.15.5:0/3901919457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa88159120 0x7ffa880ab8f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffa8806ecf0 tx=0x7ffa740091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.896+0000 7ffa8ee00640 1 -- 172.21.15.5:0/3901919457 shutdown_connections 2024-08-17T02:24:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.896+0000 7ffa8ee00640 1 --2- 172.21.15.5:0/3901919457 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa880ac9e0 0x7ffa880abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.896+0000 7ffa8ee00640 1 --2- 172.21.15.5:0/3901919457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa88159120 0x7ffa880ab8f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.896+0000 7ffa8ee00640 1 --2- 172.21.15.5:0/3901919457 >> v2:172.21.15.87:3300/0 conn(0x7ffa88158d50 0x7ffa880ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.896+0000 7ffa8ee00640 1 -- 172.21.15.5:0/3901919457 >> 172.21.15.5:0/3901919457 conn(0x7ffa88095a70 msgr2=0x7ffa88095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.896+0000 7ffa8ee00640 1 -- 172.21.15.5:0/3901919457 shutdown_connections 2024-08-17T02:24:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.896+0000 7ffa8ee00640 1 -- 172.21.15.5:0/3901919457 wait complete. 2024-08-17T02:24:11.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.897+0000 7ffa8ee00640 1 Processor -- start 2024-08-17T02:24:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.897+0000 7ffa8ee00640 1 -- start start 2024-08-17T02:24:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.898+0000 7ffa8ee00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa880ac9e0 0x7ffa8816a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.898+0000 7ffa8ee00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa88158d50 0x7ffa88151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.898+0000 7ffa8ee00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa88159120 0x7ffa88169350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.898+0000 7ffa8ee00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa88096ef0 con 0x7ffa880ac9e0 2024-08-17T02:24:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.898+0000 7ffa8ee00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa88156f10 con 0x7ffa88159120 2024-08-17T02:24:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.898+0000 7ffa8ee00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa88169f30 con 0x7ffa88158d50 2024-08-17T02:24:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.899+0000 7ffa87e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa880ac9e0 0x7ffa8816a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.899+0000 7ffa87e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa880ac9e0 0x7ffa8816a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48664/0 (socket says 172.21.15.5:48664) 2024-08-17T02:24:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.899+0000 7ffa87e00640 1 -- 172.21.15.5:0/898271434 learned_addr learned my addr 172.21.15.5:0/898271434 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.899+0000 7ffa8ce00640 1 --2- 172.21.15.5:0/898271434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa88159120 0x7ffa88169350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.899+0000 7ffa87400640 1 --2- 172.21.15.5:0/898271434 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa88158d50 0x7ffa88151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.899+0000 7ffa87e00640 1 -- 172.21.15.5:0/898271434 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa88158d50 msgr2=0x7ffa88151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.899+0000 7ffa87e00640 1 --2- 172.21.15.5:0/898271434 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa88158d50 0x7ffa88151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.899+0000 7ffa87e00640 1 -- 172.21.15.5:0/898271434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa88159120 msgr2=0x7ffa88169350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.899+0000 7ffa87e00640 1 --2- 172.21.15.5:0/898271434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa88159120 0x7ffa88169350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.899+0000 7ffa87e00640 1 -- 172.21.15.5:0/898271434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa74009450 con 0x7ffa880ac9e0 2024-08-17T02:24:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.899+0000 7ffa87400640 1 --2- 172.21.15.5:0/898271434 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa88158d50 0x7ffa88151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.899+0000 7ffa87e00640 1 --2- 172.21.15.5:0/898271434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa880ac9e0 0x7ffa8816a520 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800e900 tx=0x7ffa780090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.900+0000 7ffa7f400640 1 -- 172.21.15.5:0/898271434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800c8e0 con 0x7ffa880ac9e0 2024-08-17T02:24:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.900+0000 7ffa7f400640 1 -- 172.21.15.5:0/898271434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7800ca40 con 0x7ffa880ac9e0 2024-08-17T02:24:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.900+0000 7ffa7f400640 1 -- 172.21.15.5:0/898271434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800cde0 con 0x7ffa880ac9e0 2024-08-17T02:24:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.900+0000 7ffa8ee00640 1 -- 172.21.15.5:0/898271434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8816a210 con 0x7ffa880ac9e0 2024-08-17T02:24:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.900+0000 7ffa8ee00640 1 -- 172.21.15.5:0/898271434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa88096b80 con 0x7ffa880ac9e0 2024-08-17T02:24:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.901+0000 7ffa8ee00640 1 -- 172.21.15.5:0/898271434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa88063fb0 con 0x7ffa880ac9e0 2024-08-17T02:24:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.902+0000 7ffa7f400640 1 -- 172.21.15.5:0/898271434 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffa78013680 con 0x7ffa880ac9e0 2024-08-17T02:24:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.903+0000 7ffa7f400640 1 --2- 172.21.15.5:0/898271434 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ffa68065150 0x7ffa68067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.903+0000 7ffa7f400640 1 -- 172.21.15.5:0/898271434 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa78082550 con 0x7ffa880ac9e0 2024-08-17T02:24:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.903+0000 7ffa87400640 1 --2- 172.21.15.5:0/898271434 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ffa68065150 0x7ffa68067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.903+0000 7ffa87400640 1 --2- 172.21.15.5:0/898271434 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ffa68065150 0x7ffa68067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffa74034000 tx=0x7ffa74032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:11.906+0000 7ffa7f400640 1 -- 172.21.15.5:0/898271434 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffa78050780 con 0x7ffa880ac9e0 2024-08-17T02:24:12.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.126+0000 7ffa8ee00640 1 -- 172.21.15.5:0/898271434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa880b28f0 con 0x7ffa880ac9e0 2024-08-17T02:24:12.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.126+0000 7ffa7f400640 1 -- 172.21.15.5:0/898271434 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4582 (secure 0 0 0) 0x7ffa78053da0 con 0x7ffa880ac9e0 2024-08-17T02:24:12.127 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:12.127 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/2870814974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2870814974},{"type":"v1","addr":"172.21.15.87:6834","nonce":2870814974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/508600504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":508600504},{"type":"v1","addr":"172.21.15.5:6835","nonce":508600504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3215918333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3215918333},{"type":"v1","addr":"172.21.15.5:6837","nonce":3215918333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:34.987476+0000","modified":"2024-08-17T02:23:38.593683+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/3443816405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3443816405},{"type":"v1","addr":"172.21.15.87:6835","nonce":3443816405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:24:12.127 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-08-17T02:24:12.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.128+0000 7ffa8ee00640 1 -- 172.21.15.5:0/898271434 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ffa68065150 msgr2=0x7ffa68067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.128+0000 7ffa8ee00640 1 --2- 172.21.15.5:0/898271434 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ffa68065150 0x7ffa68067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffa74034000 tx=0x7ffa74032000 comp rx=0 tx=0).stop 2024-08-17T02:24:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.128+0000 7ffa8ee00640 1 -- 172.21.15.5:0/898271434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa880ac9e0 msgr2=0x7ffa8816a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.128+0000 7ffa8ee00640 1 --2- 172.21.15.5:0/898271434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa880ac9e0 0x7ffa8816a520 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800e900 tx=0x7ffa780090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.128+0000 7ffa8ee00640 1 -- 172.21.15.5:0/898271434 shutdown_connections 2024-08-17T02:24:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.128+0000 7ffa8ee00640 1 --2- 172.21.15.5:0/898271434 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ffa68065150 0x7ffa68067600 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.128+0000 7ffa8ee00640 1 --2- 172.21.15.5:0/898271434 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa88158d50 0x7ffa88151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.128+0000 7ffa8ee00640 1 --2- 172.21.15.5:0/898271434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa88159120 0x7ffa88169350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.128+0000 7ffa8ee00640 1 --2- 172.21.15.5:0/898271434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa880ac9e0 0x7ffa8816a520 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.129+0000 7ffa8ee00640 1 -- 172.21.15.5:0/898271434 >> 172.21.15.5:0/898271434 conn(0x7ffa88095a70 msgr2=0x7ffa880aaf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.129+0000 7ffa8ee00640 1 -- 172.21.15.5:0/898271434 shutdown_connections 2024-08-17T02:24:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.129+0000 7ffa8ee00640 1 -- 172.21.15.5:0/898271434 wait complete. 2024-08-17T02:24:12.145 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:12.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.296+0000 7f2895200640 1 Processor -- start 2024-08-17T02:24:12.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.296+0000 7f2895200640 1 -- start start 2024-08-17T02:24:12.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.297+0000 7f2895200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28900ad960 0x7f289015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.297+0000 7f2895200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28900ca050 0x7f2890156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.297+0000 7f2895200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289015b5e0 con 0x7f28900add30 2024-08-17T02:24:12.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.297+0000 7f2895200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28900cb160 con 0x7f28900ca050 2024-08-17T02:24:12.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.297+0000 7f2895200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28900b0d10 con 0x7f28900ad960 2024-08-17T02:24:12.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.297+0000 7f2885400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28900ca050 0x7f2890156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.297+0000 7f2885400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28900ca050 0x7f2890156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48672/0 (socket says 172.21.15.5:48672) 2024-08-17T02:24:12.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.297+0000 7f2885400640 1 -- 172.21.15.5:0/3854314021 learned_addr learned my addr 172.21.15.5:0/3854314021 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.298+0000 7f288de00640 1 --2- 172.21.15.5:0/3854314021 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28900ad960 0x7f289015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.298+0000 7f2885400640 1 -- 172.21.15.5:0/3854314021 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28900ad960 msgr2=0x7f289015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.298+0000 7f2885400640 1 --2- 172.21.15.5:0/3854314021 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28900ad960 0x7f289015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.298+0000 7f2885400640 1 -- 172.21.15.5:0/3854314021 >> v1:172.21.15.87:6789/0 conn(0x7f28900add30 legacy=0x7f2890156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.298+0000 7f2885400640 1 -- 172.21.15.5:0/3854314021 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28900ca550 con 0x7f28900ca050 2024-08-17T02:24:12.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.299+0000 7f2885400640 1 --2- 172.21.15.5:0/3854314021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28900ca050 0x7f2890156420 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2878009910 tx=0x7f28780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a44c2cc678fa345 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:12.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.299+0000 7f288d400640 1 -- 172.21.15.5:0/3854314021 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878032440 con 0x7f28900ca050 2024-08-17T02:24:12.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.299+0000 7f288d400640 1 -- 172.21.15.5:0/3854314021 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28780325a0 con 0x7f28900ca050 2024-08-17T02:24:12.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.299+0000 7f288d400640 1 -- 172.21.15.5:0/3854314021 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878032980 con 0x7f28900ca050 2024-08-17T02:24:12.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.300+0000 7f2895200640 1 -- 172.21.15.5:0/3854314021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28900ca050 msgr2=0x7f2890156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.300+0000 7f2895200640 1 --2- 172.21.15.5:0/3854314021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28900ca050 0x7f2890156420 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2878009910 tx=0x7f28780091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.300+0000 7f2895200640 1 -- 172.21.15.5:0/3854314021 shutdown_connections 2024-08-17T02:24:12.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.300+0000 7f2895200640 1 --2- 172.21.15.5:0/3854314021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28900ca050 0x7f2890156420 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.300+0000 7f2895200640 1 --2- 172.21.15.5:0/3854314021 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28900ad960 0x7f289015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.300+0000 7f2895200640 1 -- 172.21.15.5:0/3854314021 >> 172.21.15.5:0/3854314021 conn(0x7f2890066e60 msgr2=0x7f2890067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:12.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.300+0000 7f2895200640 1 -- 172.21.15.5:0/3854314021 shutdown_connections 2024-08-17T02:24:12.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.300+0000 7f2895200640 1 -- 172.21.15.5:0/3854314021 wait complete. 2024-08-17T02:24:12.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.301+0000 7f2895200640 1 Processor -- start 2024-08-17T02:24:12.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.301+0000 7f2895200640 1 -- start start 2024-08-17T02:24:12.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.302+0000 7f2895200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28900ad960 0x7f289006a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.302+0000 7f2895200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28900add30 0x7f289015e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.302+0000 7f2895200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28900ca050 0x7f289016ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.302+0000 7f2895200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289015e5a0 con 0x7f28900add30 2024-08-17T02:24:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.302+0000 7f2895200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289006b360 con 0x7f28900ad960 2024-08-17T02:24:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.302+0000 7f2895200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2890151a30 con 0x7f28900ca050 2024-08-17T02:24:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.303+0000 7f2885400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28900add30 0x7f289015e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.303+0000 7f2885400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28900add30 0x7f289015e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48682/0 (socket says 172.21.15.5:48682) 2024-08-17T02:24:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.303+0000 7f2885400640 1 -- 172.21.15.5:0/739720580 learned_addr learned my addr 172.21.15.5:0/739720580 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.303+0000 7f288de00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28900ad960 0x7f289006a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.303+0000 7f288e800640 1 --2- 172.21.15.5:0/739720580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28900ca050 0x7f289016ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.303+0000 7f2885400640 1 -- 172.21.15.5:0/739720580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28900ca050 msgr2=0x7f289016ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.303+0000 7f2885400640 1 --2- 172.21.15.5:0/739720580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28900ca050 0x7f289016ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.303+0000 7f2885400640 1 -- 172.21.15.5:0/739720580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28900ad960 msgr2=0x7f289006a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.303+0000 7f2885400640 1 --2- 172.21.15.5:0/739720580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28900ad960 0x7f289006a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.303+0000 7f2885400640 1 -- 172.21.15.5:0/739720580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2878009450 con 0x7f28900add30 2024-08-17T02:24:12.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.303+0000 7f2885400640 1 --2- 172.21.15.5:0/739720580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28900add30 0x7f289015e060 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2878035040 tx=0x7f2878032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:12.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.304+0000 7f2886000640 1 -- 172.21.15.5:0/739720580 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878031ae0 con 0x7f28900add30 2024-08-17T02:24:12.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.304+0000 7f2886000640 1 -- 172.21.15.5:0/739720580 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2878031c80 con 0x7f28900add30 2024-08-17T02:24:12.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.304+0000 7f2886000640 1 -- 172.21.15.5:0/739720580 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287803d420 con 0x7f28900add30 2024-08-17T02:24:12.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.304+0000 7f2895200640 1 -- 172.21.15.5:0/739720580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289016d620 con 0x7f28900add30 2024-08-17T02:24:12.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.304+0000 7f2895200640 1 -- 172.21.15.5:0/739720580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289006ae20 con 0x7f28900add30 2024-08-17T02:24:12.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.305+0000 7f2895200640 1 -- 172.21.15.5:0/739720580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2890151ba0 con 0x7f28900add30 2024-08-17T02:24:12.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.306+0000 7f2886000640 1 -- 172.21.15.5:0/739720580 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2878039040 con 0x7f28900add30 2024-08-17T02:24:12.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.306+0000 7f2886000640 1 --2- 172.21.15.5:0/739720580 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f286c065150 0x7f286c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.307+0000 7f2886000640 1 -- 172.21.15.5:0/739720580 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f28780a2120 con 0x7f28900add30 2024-08-17T02:24:12.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.307+0000 7f288de00640 1 --2- 172.21.15.5:0/739720580 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f286c065150 0x7f286c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.307+0000 7f288de00640 1 --2- 172.21.15.5:0/739720580 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f286c065150 0x7f286c067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2880007ba0 tx=0x7f2880008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:12.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.310+0000 7f2886000640 1 -- 172.21.15.5:0/739720580 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2878070290 con 0x7f28900add30 2024-08-17T02:24:12.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.498+0000 7f2895200640 1 -- 172.21.15.5:0/739720580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2890063fb0 con 0x7f28900add30 2024-08-17T02:24:12.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.498+0000 7f2886000640 1 -- 172.21.15.5:0/739720580 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f28780738b0 con 0x7f28900add30 2024-08-17T02:24:12.500 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:12.500 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:36.575545+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:32.642845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:33.982937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:12.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.501+0000 7f2895200640 1 -- 172.21.15.5:0/739720580 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f286c065150 msgr2=0x7f286c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.501+0000 7f2895200640 1 --2- 172.21.15.5:0/739720580 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f286c065150 0x7f286c067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2880007ba0 tx=0x7f2880008040 comp rx=0 tx=0).stop 2024-08-17T02:24:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.501+0000 7f2895200640 1 -- 172.21.15.5:0/739720580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28900add30 msgr2=0x7f289015e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.501+0000 7f2895200640 1 --2- 172.21.15.5:0/739720580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28900add30 0x7f289015e060 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2878035040 tx=0x7f2878032000 comp rx=0 tx=0).stop 2024-08-17T02:24:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.501+0000 7f2895200640 1 -- 172.21.15.5:0/739720580 shutdown_connections 2024-08-17T02:24:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.501+0000 7f2895200640 1 --2- 172.21.15.5:0/739720580 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f286c065150 0x7f286c067600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.501+0000 7f2895200640 1 --2- 172.21.15.5:0/739720580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28900ca050 0x7f289016ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.501+0000 7f2895200640 1 --2- 172.21.15.5:0/739720580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28900add30 0x7f289015e060 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.501+0000 7f2895200640 1 --2- 172.21.15.5:0/739720580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28900ad960 0x7f289006a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.501+0000 7f2895200640 1 -- 172.21.15.5:0/739720580 >> 172.21.15.5:0/739720580 conn(0x7f2890066e60 msgr2=0x7f2890155170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.501+0000 7f2895200640 1 -- 172.21.15.5:0/739720580 shutdown_connections 2024-08-17T02:24:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.501+0000 7f2895200640 1 -- 172.21.15.5:0/739720580 wait complete. 2024-08-17T02:24:12.517 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:24:12.517 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:12.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.667+0000 7f490bc00640 1 Processor -- start 2024-08-17T02:24:12.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.667+0000 7f490bc00640 1 -- start start 2024-08-17T02:24:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.668+0000 7f490bc00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4904158e10 0x7f4904068180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.668+0000 7f490bc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4904068dd0 0x7f49040cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.668+0000 7f490bc00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49040c40a0 con 0x7f49041591e0 2024-08-17T02:24:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.668+0000 7f490bc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49040694e0 con 0x7f4904068dd0 2024-08-17T02:24:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.668+0000 7f490bc00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4904069240 con 0x7f4904158e10 2024-08-17T02:24:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.669+0000 7f4909c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4904068dd0 0x7f49040cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.669+0000 7f4909c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4904068dd0 0x7f49040cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48688/0 (socket says 172.21.15.5:48688) 2024-08-17T02:24:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.669+0000 7f4909c00640 1 -- 172.21.15.5:0/1763502025 learned_addr learned my addr 172.21.15.5:0/1763502025 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:12.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.669+0000 7f4903e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f49041591e0 0x7f49040686c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35894/0 (socket says 172.21.15.5:35894) 2024-08-17T02:24:12.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.669+0000 7f4909200640 1 --2- 172.21.15.5:0/1763502025 >> v2:172.21.15.87:3300/0 conn(0x7f4904158e10 0x7f4904068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.669+0000 7f4909c00640 1 -- 172.21.15.5:0/1763502025 >> v2:172.21.15.87:3300/0 conn(0x7f4904158e10 msgr2=0x7f4904068180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:12.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.669+0000 7f4909c00640 1 --2- 172.21.15.5:0/1763502025 >> v2:172.21.15.87:3300/0 conn(0x7f4904158e10 0x7f4904068180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.669+0000 7f4909c00640 1 -- 172.21.15.5:0/1763502025 >> v1:172.21.15.5:6789/0 conn(0x7f49041591e0 legacy=0x7f49040686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.669+0000 7f4909c00640 1 -- 172.21.15.5:0/1763502025 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49040c3a50 con 0x7f4904068dd0 2024-08-17T02:24:12.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.669+0000 7f4903400640 1 -- 172.21.15.5:0/1763502025 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959830144 0 0) 0x7f49040c40a0 con 0x7f49041591e0 2024-08-17T02:24:12.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.670+0000 7f4909c00640 1 --2- 172.21.15.5:0/1763502025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904068dd0 0x7f49040cbfd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f490406a5d0 tx=0x7f48fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2a2f32265ae5c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:12.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.670+0000 7f4903400640 1 -- 172.21.15.5:0/1763502025 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc02e050 con 0x7f4904068dd0 2024-08-17T02:24:12.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.670+0000 7f4903400640 1 -- 172.21.15.5:0/1763502025 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc007400 con 0x7f4904068dd0 2024-08-17T02:24:12.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.670+0000 7f4903400640 1 -- 172.21.15.5:0/1763502025 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc0077a0 con 0x7f4904068dd0 2024-08-17T02:24:12.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.671+0000 7f490bc00640 1 -- 172.21.15.5:0/1763502025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904068dd0 msgr2=0x7f49040cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.671+0000 7f490bc00640 1 --2- 172.21.15.5:0/1763502025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904068dd0 0x7f49040cbfd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f490406a5d0 tx=0x7f48fc009840 comp rx=0 tx=0).stop 2024-08-17T02:24:12.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.671+0000 7f490bc00640 1 -- 172.21.15.5:0/1763502025 shutdown_connections 2024-08-17T02:24:12.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.671+0000 7f490bc00640 1 --2- 172.21.15.5:0/1763502025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904068dd0 0x7f49040cbfd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.671+0000 7f490bc00640 1 --2- 172.21.15.5:0/1763502025 >> v2:172.21.15.87:3300/0 conn(0x7f4904158e10 0x7f4904068180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.671+0000 7f490bc00640 1 -- 172.21.15.5:0/1763502025 >> 172.21.15.5:0/1763502025 conn(0x7f49040ce590 msgr2=0x7f49040ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.671+0000 7f490bc00640 1 -- 172.21.15.5:0/1763502025 shutdown_connections 2024-08-17T02:24:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.671+0000 7f490bc00640 1 -- 172.21.15.5:0/1763502025 wait complete. 2024-08-17T02:24:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.672+0000 7f490bc00640 1 Processor -- start 2024-08-17T02:24:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.673+0000 7f490bc00640 1 -- start start 2024-08-17T02:24:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.673+0000 7f490bc00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4904068dd0 0x7f4904155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.674+0000 7f490bc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904158e10 0x7f49040c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.674+0000 7f490bc00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49041591e0 0x7f49040aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.674+0000 7f490bc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49040c7a30 con 0x7f4904158e10 2024-08-17T02:24:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.674+0000 7f490bc00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4904156340 con 0x7f49041591e0 2024-08-17T02:24:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.674+0000 7f490bc00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49040c6e20 con 0x7f4904068dd0 2024-08-17T02:24:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.674+0000 7f4903e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904158e10 0x7f49040c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.674+0000 7f4903e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904158e10 0x7f49040c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48702/0 (socket says 172.21.15.5:48702) 2024-08-17T02:24:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.674+0000 7f4903e00640 1 -- 172.21.15.5:0/1030920995 learned_addr learned my addr 172.21.15.5:0/1030920995 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.674+0000 7f4909200640 1 --2- 172.21.15.5:0/1030920995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4904068dd0 0x7f4904155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.674+0000 7f4909c00640 1 --2- 172.21.15.5:0/1030920995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49041591e0 0x7f49040aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.674+0000 7f4903e00640 1 -- 172.21.15.5:0/1030920995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4904068dd0 msgr2=0x7f4904155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.674+0000 7f4903e00640 1 --2- 172.21.15.5:0/1030920995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4904068dd0 0x7f4904155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.674+0000 7f4903e00640 1 -- 172.21.15.5:0/1030920995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49041591e0 msgr2=0x7f49040aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.674+0000 7f4903e00640 1 --2- 172.21.15.5:0/1030920995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49041591e0 0x7f49040aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.674+0000 7f4903e00640 1 -- 172.21.15.5:0/1030920995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc009ae0 con 0x7f4904158e10 2024-08-17T02:24:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.674+0000 7f4909c00640 1 --2- 172.21.15.5:0/1030920995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49041591e0 0x7f49040aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.674+0000 7f4909200640 1 --2- 172.21.15.5:0/1030920995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4904068dd0 0x7f4904155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.675+0000 7f4903e00640 1 --2- 172.21.15.5:0/1030920995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904158e10 0x7f49040c6090 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f48f000c560 tx=0x7f48f0007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.675+0000 7f48f7e00640 1 -- 172.21.15.5:0/1030920995 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f00072e0 con 0x7f4904158e10 2024-08-17T02:24:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.675+0000 7f48f7e00640 1 -- 172.21.15.5:0/1030920995 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f0007460 con 0x7f4904158e10 2024-08-17T02:24:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.675+0000 7f48f7e00640 1 -- 172.21.15.5:0/1030920995 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f00047a0 con 0x7f4904158e10 2024-08-17T02:24:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.675+0000 7f490bc00640 1 -- 172.21.15.5:0/1030920995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49040c7100 con 0x7f4904158e10 2024-08-17T02:24:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.675+0000 7f490bc00640 1 -- 172.21.15.5:0/1030920995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49040c76c0 con 0x7f4904158e10 2024-08-17T02:24:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.676+0000 7f490bc00640 1 -- 172.21.15.5:0/1030920995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49041595b0 con 0x7f4904158e10 2024-08-17T02:24:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.677+0000 7f48f7e00640 1 -- 172.21.15.5:0/1030920995 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f48f0004bf0 con 0x7f4904158e10 2024-08-17T02:24:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.678+0000 7f48f7e00640 1 --2- 172.21.15.5:0/1030920995 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f48e4065150 0x7f48e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.678+0000 7f48f7e00640 1 -- 172.21.15.5:0/1030920995 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f48f0081900 con 0x7f4904158e10 2024-08-17T02:24:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.678+0000 7f4909200640 1 --2- 172.21.15.5:0/1030920995 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f48e4065150 0x7f48e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.679+0000 7f4909200640 1 --2- 172.21.15.5:0/1030920995 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f48e4065150 0x7f48e4067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f48f800bb80 tx=0x7f48f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:12.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.681+0000 7f48f7e00640 1 -- 172.21.15.5:0/1030920995 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f48f004be40 con 0x7f4904158e10 2024-08-17T02:24:12.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.901+0000 7f490bc00640 1 -- 172.21.15.5:0/1030920995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4904063fb0 con 0x7f4904158e10 2024-08-17T02:24:12.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.901+0000 7f48f7e00640 1 -- 172.21.15.5:0/1030920995 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4582 (secure 0 0 0) 0x7f48f004f920 con 0x7f4904158e10 2024-08-17T02:24:12.902 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:12.902 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/2870814974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2870814974},{"type":"v1","addr":"172.21.15.87:6834","nonce":2870814974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/508600504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":508600504},{"type":"v1","addr":"172.21.15.5:6835","nonce":508600504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3215918333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3215918333},{"type":"v1","addr":"172.21.15.5:6837","nonce":3215918333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:34.987476+0000","modified":"2024-08-17T02:23:38.593683+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/3443816405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3443816405},{"type":"v1","addr":"172.21.15.87:6835","nonce":3443816405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:24:12.902 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-08-17T02:24:12.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.903+0000 7f490bc00640 1 -- 172.21.15.5:0/1030920995 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f48e4065150 msgr2=0x7f48e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.903+0000 7f490bc00640 1 --2- 172.21.15.5:0/1030920995 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f48e4065150 0x7f48e4067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f48f800bb80 tx=0x7f48f8008040 comp rx=0 tx=0).stop 2024-08-17T02:24:12.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.903+0000 7f490bc00640 1 -- 172.21.15.5:0/1030920995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904158e10 msgr2=0x7f49040c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.903+0000 7f490bc00640 1 --2- 172.21.15.5:0/1030920995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904158e10 0x7f49040c6090 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f48f000c560 tx=0x7f48f0007d20 comp rx=0 tx=0).stop 2024-08-17T02:24:12.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.903+0000 7f490bc00640 1 -- 172.21.15.5:0/1030920995 shutdown_connections 2024-08-17T02:24:12.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.903+0000 7f490bc00640 1 --2- 172.21.15.5:0/1030920995 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f48e4065150 0x7f48e4067600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.903+0000 7f490bc00640 1 --2- 172.21.15.5:0/1030920995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49041591e0 0x7f49040aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.903+0000 7f490bc00640 1 --2- 172.21.15.5:0/1030920995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904158e10 0x7f49040c6090 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.903+0000 7f490bc00640 1 --2- 172.21.15.5:0/1030920995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4904068dd0 0x7f4904155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.903+0000 7f490bc00640 1 -- 172.21.15.5:0/1030920995 >> 172.21.15.5:0/1030920995 conn(0x7f49040ce590 msgr2=0x7f490406d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:12.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.904+0000 7f490bc00640 1 -- 172.21.15.5:0/1030920995 shutdown_connections 2024-08-17T02:24:12.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:12.904+0000 7f490bc00640 1 -- 172.21.15.5:0/1030920995 wait complete. 2024-08-17T02:24:12.920 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.071+0000 7f4f73200640 1 Processor -- start 2024-08-17T02:24:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.071+0000 7f4f73200640 1 -- start start 2024-08-17T02:24:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.072+0000 7f4f73200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f7406cdb0 0x7f4f7415d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.072+0000 7f4f73200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f740abe60 con 0x7f4f740aef90 2024-08-17T02:24:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.072+0000 7f4f73200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f740ac0c0 con 0x7f4f74158c30 2024-08-17T02:24:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.072+0000 7f4f73200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f740ac3a0 con 0x7f4f7406cdb0 2024-08-17T02:24:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.072+0000 7f4f72800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f7406cdb0 0x7f4f7415d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.072+0000 7f4f6be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4f740aef90 0x7f4f7406c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35902/0 (socket says 172.21.15.5:35902) 2024-08-17T02:24:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.072+0000 7f4f6be00640 1 -- 172.21.15.5:0/2782334486 learned_addr learned my addr 172.21.15.5:0/2782334486 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:13.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.073+0000 7f4f72800640 1 -- 172.21.15.5:0/2782334486 >> v1:172.21.15.87:6789/0 conn(0x7f4f74158c30 legacy=0x7f4f740ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:13.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.073+0000 7f4f72800640 1 -- 172.21.15.5:0/2782334486 >> v1:172.21.15.5:6789/0 conn(0x7f4f740aef90 legacy=0x7f4f7406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.073+0000 7f4f71400640 1 -- 172.21.15.5:0/2782334486 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794770542 0 0) 0x7f4f740abe60 con 0x7f4f740aef90 2024-08-17T02:24:13.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.073+0000 7f4f72800640 1 -- 172.21.15.5:0/2782334486 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7415c7f0 con 0x7f4f7406cdb0 2024-08-17T02:24:13.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.074+0000 7f4f72800640 1 --2- 172.21.15.5:0/2782334486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f7406cdb0 0x7f4f7415d2d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c009e60 tx=0x7f4f6c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9f9bf97cf48521 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.074+0000 7f4f71400640 1 -- 172.21.15.5:0/2782334486 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c007550 con 0x7f4f7406cdb0 2024-08-17T02:24:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.074+0000 7f4f71400640 1 -- 172.21.15.5:0/2782334486 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6c02d050 con 0x7f4f7406cdb0 2024-08-17T02:24:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.074+0000 7f4f71400640 1 -- 172.21.15.5:0/2782334486 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c0078e0 con 0x7f4f7406cdb0 2024-08-17T02:24:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.074+0000 7f4f73200640 1 -- 172.21.15.5:0/2782334486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f7406cdb0 msgr2=0x7f4f7415d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.074+0000 7f4f73200640 1 --2- 172.21.15.5:0/2782334486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f7406cdb0 0x7f4f7415d2d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c009e60 tx=0x7f4f6c009780 comp rx=0 tx=0).stop 2024-08-17T02:24:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.075+0000 7f4f73200640 1 -- 172.21.15.5:0/2782334486 shutdown_connections 2024-08-17T02:24:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.075+0000 7f4f73200640 1 --2- 172.21.15.5:0/2782334486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f7406cdb0 0x7f4f7415d2d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.075+0000 7f4f73200640 1 -- 172.21.15.5:0/2782334486 >> 172.21.15.5:0/2782334486 conn(0x7f4f7406e8d0 msgr2=0x7f4f7406ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.075+0000 7f4f73200640 1 -- 172.21.15.5:0/2782334486 shutdown_connections 2024-08-17T02:24:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.075+0000 7f4f73200640 1 -- 172.21.15.5:0/2782334486 wait complete. 2024-08-17T02:24:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.076+0000 7f4f73200640 1 Processor -- start 2024-08-17T02:24:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.076+0000 7f4f73200640 1 -- start start 2024-08-17T02:24:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.077+0000 7f4f73200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f7406cdb0 0x7f4f74151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.077+0000 7f4f73200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4f740aef90 0x7f4f74155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.077+0000 7f4f73200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f74158c30 0x7f4f740c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.077+0000 7f4f73200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f74151a90 con 0x7f4f74158c30 2024-08-17T02:24:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.077+0000 7f4f73200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f740c94e0 con 0x7f4f7406cdb0 2024-08-17T02:24:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.077+0000 7f4f73200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7415afa0 con 0x7f4f740aef90 2024-08-17T02:24:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.077+0000 7f4f72800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f74158c30 0x7f4f740c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.077+0000 7f4f72800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f74158c30 0x7f4f740c7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48712/0 (socket says 172.21.15.5:48712) 2024-08-17T02:24:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.077+0000 7f4f72800640 1 -- 172.21.15.5:0/1282677697 learned_addr learned my addr 172.21.15.5:0/1282677697 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.078+0000 7f4f71e00640 1 --2- 172.21.15.5:0/1282677697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f7406cdb0 0x7f4f74151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.078+0000 7f4f6be00640 1 --2- 172.21.15.5:0/1282677697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4f740aef90 0x7f4f74155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.078+0000 7f4f72800640 1 -- 172.21.15.5:0/1282677697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4f740aef90 msgr2=0x7f4f74155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.078+0000 7f4f72800640 1 --2- 172.21.15.5:0/1282677697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4f740aef90 0x7f4f74155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.078+0000 7f4f72800640 1 -- 172.21.15.5:0/1282677697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f7406cdb0 msgr2=0x7f4f74151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.078+0000 7f4f72800640 1 --2- 172.21.15.5:0/1282677697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f7406cdb0 0x7f4f74151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.078+0000 7f4f72800640 1 -- 172.21.15.5:0/1282677697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c009a20 con 0x7f4f74158c30 2024-08-17T02:24:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.078+0000 7f4f72800640 1 --2- 172.21.15.5:0/1282677697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f74158c30 0x7f4f740c7ce0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c0099f0 tx=0x7f4f6c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.078+0000 7f4f69600640 1 -- 172.21.15.5:0/1282677697 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c007e40 con 0x7f4f74158c30 2024-08-17T02:24:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.078+0000 7f4f69600640 1 -- 172.21.15.5:0/1282677697 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6c040070 con 0x7f4f74158c30 2024-08-17T02:24:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.078+0000 7f4f73200640 1 -- 172.21.15.5:0/1282677697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7415b280 con 0x7f4f74158c30 2024-08-17T02:24:13.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.078+0000 7f4f69600640 1 -- 172.21.15.5:0/1282677697 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c031e80 con 0x7f4f74158c30 2024-08-17T02:24:13.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.079+0000 7f4f73200640 1 -- 172.21.15.5:0/1282677697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f740c9170 con 0x7f4f74158c30 2024-08-17T02:24:13.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.080+0000 7f4f73200640 1 -- 172.21.15.5:0/1282677697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f74067d20 con 0x7f4f74158c30 2024-08-17T02:24:13.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.080+0000 7f4f69600640 1 -- 172.21.15.5:0/1282677697 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4f6c042030 con 0x7f4f74158c30 2024-08-17T02:24:13.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.081+0000 7f4f69600640 1 --2- 172.21.15.5:0/1282677697 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4f50065180 0x7f4f50067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.081+0000 7f4f69600640 1 -- 172.21.15.5:0/1282677697 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f6c0a3f50 con 0x7f4f74158c30 2024-08-17T02:24:13.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.081+0000 7f4f71e00640 1 --2- 172.21.15.5:0/1282677697 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4f50065180 0x7f4f50067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.082+0000 7f4f71e00640 1 --2- 172.21.15.5:0/1282677697 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4f50065180 0x7f4f50067630 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400b8d0 tx=0x7f4f64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.085+0000 7f4f69600640 1 -- 172.21.15.5:0/1282677697 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4f74067d20 con 0x7f4f74158c30 2024-08-17T02:24:13.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.306+0000 7f4f73200640 1 -- 172.21.15.5:0/1282677697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f74067d20 con 0x7f4f74158c30 2024-08-17T02:24:13.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.307+0000 7f4f69600640 1 -- 172.21.15.5:0/1282677697 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4582 (secure 0 0 0) 0x7f4f74067d20 con 0x7f4f74158c30 2024-08-17T02:24:13.307 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:13.307 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/2870814974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2870814974},{"type":"v1","addr":"172.21.15.87:6834","nonce":2870814974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/508600504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":508600504},{"type":"v1","addr":"172.21.15.5:6835","nonce":508600504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3215918333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3215918333},{"type":"v1","addr":"172.21.15.5:6837","nonce":3215918333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:34.987476+0000","modified":"2024-08-17T02:23:38.593683+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/3443816405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3443816405},{"type":"v1","addr":"172.21.15.87:6835","nonce":3443816405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:24:13.308 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-08-17T02:24:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.309+0000 7f4f73200640 1 -- 172.21.15.5:0/1282677697 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4f50065180 msgr2=0x7f4f50067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.309+0000 7f4f73200640 1 --2- 172.21.15.5:0/1282677697 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4f50065180 0x7f4f50067630 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400b8d0 tx=0x7f4f64008040 comp rx=0 tx=0).stop 2024-08-17T02:24:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.309+0000 7f4f73200640 1 -- 172.21.15.5:0/1282677697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f74158c30 msgr2=0x7f4f740c7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.309+0000 7f4f73200640 1 --2- 172.21.15.5:0/1282677697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f74158c30 0x7f4f740c7ce0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c0099f0 tx=0x7f4f6c037000 comp rx=0 tx=0).stop 2024-08-17T02:24:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.309+0000 7f4f73200640 1 -- 172.21.15.5:0/1282677697 shutdown_connections 2024-08-17T02:24:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.309+0000 7f4f73200640 1 --2- 172.21.15.5:0/1282677697 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4f50065180 0x7f4f50067630 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.309+0000 7f4f73200640 1 --2- 172.21.15.5:0/1282677697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4f740aef90 0x7f4f74155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.309+0000 7f4f73200640 1 --2- 172.21.15.5:0/1282677697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f74158c30 0x7f4f740c7ce0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.309+0000 7f4f73200640 1 --2- 172.21.15.5:0/1282677697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f7406cdb0 0x7f4f74151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.309+0000 7f4f73200640 1 -- 172.21.15.5:0/1282677697 >> 172.21.15.5:0/1282677697 conn(0x7f4f7406e8d0 msgr2=0x7f4f74157e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.309+0000 7f4f73200640 1 -- 172.21.15.5:0/1282677697 shutdown_connections 2024-08-17T02:24:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.309+0000 7f4f73200640 1 -- 172.21.15.5:0/1282677697 wait complete. 2024-08-17T02:24:13.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:13.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.475+0000 7efd62400640 1 Processor -- start 2024-08-17T02:24:13.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.475+0000 7efd62400640 1 -- start start 2024-08-17T02:24:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.476+0000 7efd62400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efd5c0694c0 0x7efd5c0ac140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.476+0000 7efd62400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5c0ab5a0 con 0x7efd5c069080 2024-08-17T02:24:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.476+0000 7efd62400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5c0698b0 con 0x7efd5c0ae4e0 2024-08-17T02:24:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.476+0000 7efd62400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5c0aa990 con 0x7efd5c0694c0 2024-08-17T02:24:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.476+0000 7efd5be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efd5c069080 0x7efd5c0aba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35904/0 (socket says 172.21.15.5:35904) 2024-08-17T02:24:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.476+0000 7efd5be00640 1 -- 172.21.15.5:0/1034574774 learned_addr learned my addr 172.21.15.5:0/1034574774 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.477+0000 7efd61a00640 1 --2- 172.21.15.5:0/1034574774 >> v2:172.21.15.87:3300/0 conn(0x7efd5c0694c0 0x7efd5c0ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.477+0000 7efd5b400640 1 -- 172.21.15.5:0/1034574774 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251972682 0 0) 0x7efd5c0ab5a0 con 0x7efd5c069080 2024-08-17T02:24:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.477+0000 7efd5b400640 1 -- 172.21.15.5:0/1034574774 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd440034e0 con 0x7efd5c069080 2024-08-17T02:24:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.477+0000 7efd5b400640 1 -- 172.21.15.5:0/1034574774 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3257737641 0 0) 0x7efd440034e0 con 0x7efd5c069080 2024-08-17T02:24:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.477+0000 7efd61a00640 1 -- 172.21.15.5:0/1034574774 >> v1:172.21.15.87:6789/0 conn(0x7efd5c0ae4e0 legacy=0x7efd5c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.477+0000 7efd61a00640 1 -- 172.21.15.5:0/1034574774 >> v1:172.21.15.5:6789/0 conn(0x7efd5c069080 legacy=0x7efd5c0aba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.477+0000 7efd61a00640 1 -- 172.21.15.5:0/1034574774 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c0aac70 con 0x7efd5c0694c0 2024-08-17T02:24:13.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.478+0000 7efd61a00640 1 --2- 172.21.15.5:0/1034574774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c0694c0 0x7efd5c0ac140 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efd54009e60 tx=0x7efd54009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84d80cd575074a06 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.478+0000 7efd5b400640 1 -- 172.21.15.5:0/1034574774 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48001470 con 0x7efd5c0694c0 2024-08-17T02:24:13.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.479+0000 7efd5b400640 1 -- 172.21.15.5:0/1034574774 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5402d050 con 0x7efd5c0694c0 2024-08-17T02:24:13.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.479+0000 7efd5b400640 1 -- 172.21.15.5:0/1034574774 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54031630 con 0x7efd5c0694c0 2024-08-17T02:24:13.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.479+0000 7efd62400640 1 -- 172.21.15.5:0/1034574774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c0694c0 msgr2=0x7efd5c0ac140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.479+0000 7efd62400640 1 --2- 172.21.15.5:0/1034574774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c0694c0 0x7efd5c0ac140 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efd54009e60 tx=0x7efd54009780 comp rx=0 tx=0).stop 2024-08-17T02:24:13.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.479+0000 7efd62400640 1 -- 172.21.15.5:0/1034574774 shutdown_connections 2024-08-17T02:24:13.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.479+0000 7efd62400640 1 --2- 172.21.15.5:0/1034574774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c0694c0 0x7efd5c0ac140 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.479+0000 7efd62400640 1 -- 172.21.15.5:0/1034574774 >> 172.21.15.5:0/1034574774 conn(0x7efd5c0ce470 msgr2=0x7efd5c095cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:13.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.479+0000 7efd62400640 1 -- 172.21.15.5:0/1034574774 shutdown_connections 2024-08-17T02:24:13.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.479+0000 7efd62400640 1 -- 172.21.15.5:0/1034574774 wait complete. 2024-08-17T02:24:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.481+0000 7efd62400640 1 Processor -- start 2024-08-17T02:24:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.481+0000 7efd62400640 1 -- start start 2024-08-17T02:24:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.481+0000 7efd62400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c069080 0x7efd5c157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.481+0000 7efd62400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd5c0694c0 0x7efd5c0ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.481+0000 7efd62400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efd5c0ae4e0 0x7efd5c1508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.481+0000 7efd62400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c150e00 con 0x7efd5c0694c0 2024-08-17T02:24:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.482+0000 7efd62400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c152cb0 con 0x7efd5c069080 2024-08-17T02:24:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.482+0000 7efd62400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c1512d0 con 0x7efd5c0ae4e0 2024-08-17T02:24:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.482+0000 7efd5be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd5c0694c0 0x7efd5c0ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.482+0000 7efd5be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd5c0694c0 0x7efd5c0ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48724/0 (socket says 172.21.15.5:48724) 2024-08-17T02:24:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.482+0000 7efd5be00640 1 -- 172.21.15.5:0/234169898 learned_addr learned my addr 172.21.15.5:0/234169898 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.482+0000 7efd61a00640 1 --2- 172.21.15.5:0/234169898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efd5c0ae4e0 0x7efd5c1508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.482+0000 7efd61000640 1 --2- 172.21.15.5:0/234169898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c069080 0x7efd5c157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.482+0000 7efd5be00640 1 -- 172.21.15.5:0/234169898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efd5c0ae4e0 msgr2=0x7efd5c1508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.482+0000 7efd5be00640 1 --2- 172.21.15.5:0/234169898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efd5c0ae4e0 0x7efd5c1508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.482+0000 7efd5be00640 1 -- 172.21.15.5:0/234169898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c069080 msgr2=0x7efd5c157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.482+0000 7efd5be00640 1 --2- 172.21.15.5:0/234169898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c069080 0x7efd5c157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.482+0000 7efd5be00640 1 -- 172.21.15.5:0/234169898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd54009a20 con 0x7efd5c0694c0 2024-08-17T02:24:13.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.482+0000 7efd61000640 1 --2- 172.21.15.5:0/234169898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c069080 0x7efd5c157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:13.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.483+0000 7efd5be00640 1 --2- 172.21.15.5:0/234169898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd5c0694c0 0x7efd5c0ccf20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efd4800cb90 tx=0x7efd48001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.483+0000 7efd4fe00640 1 -- 172.21.15.5:0/234169898 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48007360 con 0x7efd5c0694c0 2024-08-17T02:24:13.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.483+0000 7efd4fe00640 1 -- 172.21.15.5:0/234169898 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd480074e0 con 0x7efd5c0694c0 2024-08-17T02:24:13.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.483+0000 7efd4fe00640 1 -- 172.21.15.5:0/234169898 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd480049f0 con 0x7efd5c0694c0 2024-08-17T02:24:13.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.483+0000 7efd62400640 1 -- 172.21.15.5:0/234169898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5c1578d0 con 0x7efd5c0694c0 2024-08-17T02:24:13.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.483+0000 7efd62400640 1 -- 172.21.15.5:0/234169898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5c152940 con 0x7efd5c0694c0 2024-08-17T02:24:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.484+0000 7efd62400640 1 -- 172.21.15.5:0/234169898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5c1527a0 con 0x7efd5c0694c0 2024-08-17T02:24:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.485+0000 7efd4fe00640 1 -- 172.21.15.5:0/234169898 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efd4800a640 con 0x7efd5c0694c0 2024-08-17T02:24:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.486+0000 7efd4fe00640 1 --2- 172.21.15.5:0/234169898 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7efd3c065180 0x7efd3c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.486+0000 7efd4fe00640 1 -- 172.21.15.5:0/234169898 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd480818e0 con 0x7efd5c0694c0 2024-08-17T02:24:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.486+0000 7efd61000640 1 --2- 172.21.15.5:0/234169898 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7efd3c065180 0x7efd3c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.487+0000 7efd61000640 1 --2- 172.21.15.5:0/234169898 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7efd3c065180 0x7efd3c067630 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efd50001780 tx=0x7efd50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.490+0000 7efd4fe00640 1 -- 172.21.15.5:0/234169898 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efd5c1527a0 con 0x7efd5c0694c0 2024-08-17T02:24:13.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.673+0000 7efd62400640 1 -- 172.21.15.5:0/234169898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd5c1527a0 con 0x7efd5c0694c0 2024-08-17T02:24:13.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.674+0000 7efd4fe00640 1 -- 172.21.15.5:0/234169898 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15254 (secure 0 0 0) 0x7efd5c1527a0 con 0x7efd5c0694c0 2024-08-17T02:24:13.676 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:13.676 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:23:36.575545+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:32.642845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:33.982937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:13.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.676+0000 7efd62400640 1 -- 172.21.15.5:0/234169898 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7efd3c065180 msgr2=0x7efd3c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.677+0000 7efd62400640 1 --2- 172.21.15.5:0/234169898 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7efd3c065180 0x7efd3c067630 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efd50001780 tx=0x7efd50009040 comp rx=0 tx=0).stop 2024-08-17T02:24:13.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.677+0000 7efd62400640 1 -- 172.21.15.5:0/234169898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd5c0694c0 msgr2=0x7efd5c0ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.677+0000 7efd62400640 1 --2- 172.21.15.5:0/234169898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd5c0694c0 0x7efd5c0ccf20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efd4800cb90 tx=0x7efd48001b80 comp rx=0 tx=0).stop 2024-08-17T02:24:13.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.677+0000 7efd62400640 1 -- 172.21.15.5:0/234169898 shutdown_connections 2024-08-17T02:24:13.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.677+0000 7efd62400640 1 --2- 172.21.15.5:0/234169898 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7efd3c065180 0x7efd3c067630 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.677+0000 7efd62400640 1 --2- 172.21.15.5:0/234169898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efd5c0ae4e0 0x7efd5c1508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.677+0000 7efd62400640 1 --2- 172.21.15.5:0/234169898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd5c0694c0 0x7efd5c0ccf20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.677+0000 7efd62400640 1 --2- 172.21.15.5:0/234169898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c069080 0x7efd5c157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.677+0000 7efd62400640 1 -- 172.21.15.5:0/234169898 >> 172.21.15.5:0/234169898 conn(0x7efd5c0ce470 msgr2=0x7efd5c06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:13.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.677+0000 7efd62400640 1 -- 172.21.15.5:0/234169898 shutdown_connections 2024-08-17T02:24:13.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.677+0000 7efd62400640 1 -- 172.21.15.5:0/234169898 wait complete. 2024-08-17T02:24:13.694 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:24:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.849+0000 7f97f0400640 1 Processor -- start 2024-08-17T02:24:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.849+0000 7f97f0400640 1 -- start start 2024-08-17T02:24:13.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.851+0000 7f97f0400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97e80acf10 0x7f97e80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.851+0000 7f97f0400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e80c92b0 con 0x7f97e80afca0 2024-08-17T02:24:13.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.851+0000 7f97f0400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e80ad480 con 0x7f97e81590b0 2024-08-17T02:24:13.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.851+0000 7f97f0400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80b0980 con 0x7f97e80acf10 2024-08-17T02:24:13.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.851+0000 7f97eda00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f97e80afca0 0x7f97e81589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35912/0 (socket says 172.21.15.5:35912) 2024-08-17T02:24:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.851+0000 7f97eda00640 1 -- 172.21.15.5:0/72149789 learned_addr learned my addr 172.21.15.5:0/72149789 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.851+0000 7f97ee400640 1 --2- 172.21.15.5:0/72149789 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97e80acf10 0x7f97e80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.851+0000 7f97e7e00640 1 -- 172.21.15.5:0/72149789 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993813819 0 0) 0x7f97e80c92b0 con 0x7f97e80afca0 2024-08-17T02:24:13.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.851+0000 7f97e7e00640 1 -- 172.21.15.5:0/72149789 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97d00034e0 con 0x7f97e80afca0 2024-08-17T02:24:13.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.852+0000 7f97ee400640 1 -- 172.21.15.5:0/72149789 >> v1:172.21.15.87:6789/0 conn(0x7f97e81590b0 legacy=0x7f97e80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.852+0000 7f97ee400640 1 -- 172.21.15.5:0/72149789 >> v1:172.21.15.5:6789/0 conn(0x7f97e80afca0 legacy=0x7f97e81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.852+0000 7f97e7e00640 1 -- 172.21.15.5:0/72149789 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1524900639 0 0) 0x7f97d00034e0 con 0x7f97e80afca0 2024-08-17T02:24:13.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.852+0000 7f97ee400640 1 -- 172.21.15.5:0/72149789 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e80ad760 con 0x7f97e80acf10 2024-08-17T02:24:13.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.853+0000 7f97ee400640 1 --2- 172.21.15.5:0/72149789 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97e80acf10 0x7f97e80b0070 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009e90 tx=0x7f97e0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec2c0facd0c5d366 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.853+0000 7f97e7e00640 1 -- 172.21.15.5:0/72149789 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc001470 con 0x7f97e80acf10 2024-08-17T02:24:13.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.853+0000 7f97e7e00640 1 -- 172.21.15.5:0/72149789 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e0033410 con 0x7f97e80acf10 2024-08-17T02:24:13.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.853+0000 7f97e7e00640 1 -- 172.21.15.5:0/72149789 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e00337b0 con 0x7f97e80acf10 2024-08-17T02:24:13.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.854+0000 7f97f0400640 1 -- 172.21.15.5:0/72149789 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97e80acf10 msgr2=0x7f97e80b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.854+0000 7f97f0400640 1 --2- 172.21.15.5:0/72149789 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97e80acf10 0x7f97e80b0070 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009e90 tx=0x7f97e0009780 comp rx=0 tx=0).stop 2024-08-17T02:24:13.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.854+0000 7f97f0400640 1 -- 172.21.15.5:0/72149789 shutdown_connections 2024-08-17T02:24:13.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.854+0000 7f97f0400640 1 --2- 172.21.15.5:0/72149789 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97e80acf10 0x7f97e80b0070 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.854+0000 7f97f0400640 1 -- 172.21.15.5:0/72149789 >> 172.21.15.5:0/72149789 conn(0x7f97e8066e60 msgr2=0x7f97e8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:13.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.854+0000 7f97f0400640 1 -- 172.21.15.5:0/72149789 shutdown_connections 2024-08-17T02:24:13.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.854+0000 7f97f0400640 1 -- 172.21.15.5:0/72149789 wait complete. 2024-08-17T02:24:13.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.855+0000 7f97f0400640 1 Processor -- start 2024-08-17T02:24:13.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.855+0000 7f97f0400640 1 -- start start 2024-08-17T02:24:13.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.856+0000 7f97f0400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97e80acf10 0x7f97e816cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.856+0000 7f97f0400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97e80afca0 0x7f97e8153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.856+0000 7f97f0400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e81590b0 0x7f97e8142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.856+0000 7f97f0400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e816d090 con 0x7f97e81590b0 2024-08-17T02:24:13.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.856+0000 7f97f0400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80a47b0 con 0x7f97e80afca0 2024-08-17T02:24:13.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.856+0000 7f97f0400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e8155e20 con 0x7f97e80acf10 2024-08-17T02:24:13.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.856+0000 7f97ee400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e81590b0 0x7f97e8142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.856+0000 7f97ee400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e81590b0 0x7f97e8142f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48734/0 (socket says 172.21.15.5:48734) 2024-08-17T02:24:13.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.856+0000 7f97ee400640 1 -- 172.21.15.5:0/3834594162 learned_addr learned my addr 172.21.15.5:0/3834594162 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:13.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.857+0000 7f97ed000640 1 --2- 172.21.15.5:0/3834594162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97e80afca0 0x7f97e8153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.857+0000 7f97eda00640 1 --2- 172.21.15.5:0/3834594162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97e80acf10 0x7f97e816cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.857+0000 7f97ee400640 1 -- 172.21.15.5:0/3834594162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97e80acf10 msgr2=0x7f97e816cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.857+0000 7f97ee400640 1 --2- 172.21.15.5:0/3834594162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97e80acf10 0x7f97e816cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.857+0000 7f97ee400640 1 -- 172.21.15.5:0/3834594162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97e80afca0 msgr2=0x7f97e8153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.857+0000 7f97ee400640 1 --2- 172.21.15.5:0/3834594162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97e80afca0 0x7f97e8153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.857+0000 7f97ee400640 1 -- 172.21.15.5:0/3834594162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e0009a20 con 0x7f97e81590b0 2024-08-17T02:24:13.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.857+0000 7f97ee400640 1 --2- 172.21.15.5:0/3834594162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e81590b0 0x7f97e8142f20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009e90 tx=0x7f97e003a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.857+0000 7f97e4c00640 1 -- 172.21.15.5:0/3834594162 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e003c6e0 con 0x7f97e81590b0 2024-08-17T02:24:13.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.857+0000 7f97e4c00640 1 -- 172.21.15.5:0/3834594162 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e0041070 con 0x7f97e81590b0 2024-08-17T02:24:13.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.858+0000 7f97f0400640 1 -- 172.21.15.5:0/3834594162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e8156100 con 0x7f97e81590b0 2024-08-17T02:24:13.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.858+0000 7f97e4c00640 1 -- 172.21.15.5:0/3834594162 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e003cad0 con 0x7f97e81590b0 2024-08-17T02:24:13.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.858+0000 7f97f0400640 1 -- 172.21.15.5:0/3834594162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e81566c0 con 0x7f97e81590b0 2024-08-17T02:24:13.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.859+0000 7f97f0400640 1 -- 172.21.15.5:0/3834594162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e8063fb0 con 0x7f97e81590b0 2024-08-17T02:24:13.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.860+0000 7f97e4c00640 1 -- 172.21.15.5:0/3834594162 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f97e0047420 con 0x7f97e81590b0 2024-08-17T02:24:13.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.860+0000 7f97e4c00640 1 --2- 172.21.15.5:0/3834594162 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f97c8065150 0x7f97c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.860+0000 7f97e4c00640 1 -- 172.21.15.5:0/3834594162 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97e0043070 con 0x7f97e81590b0 2024-08-17T02:24:13.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.861+0000 7f97eda00640 1 --2- 172.21.15.5:0/3834594162 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f97c8065150 0x7f97c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.861+0000 7f97eda00640 1 --2- 172.21.15.5:0/3834594162 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f97c8065150 0x7f97c8067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f97dc001380 tx=0x7f97dc001b00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:13.864+0000 7f97e4c00640 1 -- 172.21.15.5:0/3834594162 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f97e0071910 con 0x7f97e81590b0 2024-08-17T02:24:14.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.083+0000 7f97f0400640 1 -- 172.21.15.5:0/3834594162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f97e8067b70 con 0x7f97e81590b0 2024-08-17T02:24:14.084 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-17T02:24:14.083+0000 7f09ca200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:24:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.087+0000 7f97e4c00640 1 -- 172.21.15.5:0/3834594162 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f97e004c090 con 0x7f97e81590b0 2024-08-17T02:24:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:24:14.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.089+0000 7f97f0400640 1 -- 172.21.15.5:0/3834594162 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f97c8065150 msgr2=0x7f97c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:14.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.089+0000 7f97f0400640 1 --2- 172.21.15.5:0/3834594162 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f97c8065150 0x7f97c8067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f97dc001380 tx=0x7f97dc001b00 comp rx=0 tx=0).stop 2024-08-17T02:24:14.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.089+0000 7f97f0400640 1 -- 172.21.15.5:0/3834594162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e81590b0 msgr2=0x7f97e8142f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.089+0000 7f97f0400640 1 --2- 172.21.15.5:0/3834594162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e81590b0 0x7f97e8142f20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009e90 tx=0x7f97e003a000 comp rx=0 tx=0).stop 2024-08-17T02:24:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.090+0000 7f97f0400640 1 -- 172.21.15.5:0/3834594162 shutdown_connections 2024-08-17T02:24:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.090+0000 7f97f0400640 1 --2- 172.21.15.5:0/3834594162 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f97c8065150 0x7f97c8067600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.090+0000 7f97f0400640 1 --2- 172.21.15.5:0/3834594162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e81590b0 0x7f97e8142f20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.090+0000 7f97f0400640 1 --2- 172.21.15.5:0/3834594162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97e80afca0 0x7f97e8153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.090+0000 7f97f0400640 1 --2- 172.21.15.5:0/3834594162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97e80acf10 0x7f97e816cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.090+0000 7f97f0400640 1 -- 172.21.15.5:0/3834594162 >> 172.21.15.5:0/3834594162 conn(0x7f97e8066e60 msgr2=0x7f97e80ca7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.090+0000 7f97f0400640 1 -- 172.21.15.5:0/3834594162 shutdown_connections 2024-08-17T02:24:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.090+0000 7f97f0400640 1 -- 172.21.15.5:0/3834594162 wait complete. 2024-08-17T02:24:14.096 INFO:tasks.ceph.mds.b.smithi087.stderr: -1992> 2024-08-17T02:23:39.039+0000 7f82bba00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:24:14.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:24:14.136 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-08-17T02:24:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.259+0000 7f6737000640 1 Processor -- start 2024-08-17T02:24:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.259+0000 7f6737000640 1 -- start start 2024-08-17T02:24:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.260+0000 7f6737000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6730158a20 0x7f67300a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.260+0000 7f6737000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f673006dee0 0x7f67300afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.260+0000 7f6737000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67300aed90 con 0x7f67300ae860 2024-08-17T02:24:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.260+0000 7f6737000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67300af070 con 0x7f6730158a20 2024-08-17T02:24:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.260+0000 7f6737000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67300af350 con 0x7f673006dee0 2024-08-17T02:24:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.261+0000 7f672f400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f67300ae860 0x7f673006d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35922/0 (socket says 172.21.15.5:35922) 2024-08-17T02:24:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.261+0000 7f672f400640 1 -- 172.21.15.5:0/3330484083 learned_addr learned my addr 172.21.15.5:0/3330484083 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.261+0000 7f672fe00640 1 --2- 172.21.15.5:0/3330484083 >> v2:172.21.15.87:3300/0 conn(0x7f6730158a20 0x7f67300a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.261+0000 7f6735000640 1 --2- 172.21.15.5:0/3330484083 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f673006dee0 0x7f67300afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.261+0000 7f672ea00640 1 -- 172.21.15.5:0/3330484083 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458609637 0 0) 0x7f67300aed90 con 0x7f67300ae860 2024-08-17T02:24:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.261+0000 7f672fe00640 1 -- 172.21.15.5:0/3330484083 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f673006dee0 msgr2=0x7f67300afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.261+0000 7f672fe00640 1 --2- 172.21.15.5:0/3330484083 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f673006dee0 0x7f67300afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.261+0000 7f672fe00640 1 -- 172.21.15.5:0/3330484083 >> v1:172.21.15.5:6789/0 conn(0x7f67300ae860 legacy=0x7f673006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.261+0000 7f672fe00640 1 -- 172.21.15.5:0/3330484083 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67300af630 con 0x7f6730158a20 2024-08-17T02:24:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.262+0000 7f672fe00640 1 --2- 172.21.15.5:0/3330484083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6730158a20 0x7f67300a89c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6720009850 tx=0x7f67200090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d2ce2bf07030071 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.262+0000 7f672ea00640 1 -- 172.21.15.5:0/3330484083 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672002ad90 con 0x7f6730158a20 2024-08-17T02:24:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.262+0000 7f672ea00640 1 -- 172.21.15.5:0/3330484083 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6720032440 con 0x7f6730158a20 2024-08-17T02:24:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.263+0000 7f672ea00640 1 -- 172.21.15.5:0/3330484083 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67200327e0 con 0x7f6730158a20 2024-08-17T02:24:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.263+0000 7f6737000640 1 -- 172.21.15.5:0/3330484083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6730158a20 msgr2=0x7f67300a89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.263+0000 7f6737000640 1 --2- 172.21.15.5:0/3330484083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6730158a20 0x7f67300a89c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6720009850 tx=0x7f67200090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.263+0000 7f6737000640 1 -- 172.21.15.5:0/3330484083 shutdown_connections 2024-08-17T02:24:14.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.263+0000 7f6737000640 1 --2- 172.21.15.5:0/3330484083 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f673006dee0 0x7f67300afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.263+0000 7f6737000640 1 --2- 172.21.15.5:0/3330484083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6730158a20 0x7f67300a89c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.263+0000 7f6737000640 1 -- 172.21.15.5:0/3330484083 >> 172.21.15.5:0/3330484083 conn(0x7f6730066e60 msgr2=0x7f6730067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:14.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.263+0000 7f6737000640 1 -- 172.21.15.5:0/3330484083 shutdown_connections 2024-08-17T02:24:14.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.263+0000 7f6737000640 1 -- 172.21.15.5:0/3330484083 wait complete. 2024-08-17T02:24:14.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.265+0000 7f6737000640 1 Processor -- start 2024-08-17T02:24:14.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.265+0000 7f6737000640 1 -- start start 2024-08-17T02:24:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.266+0000 7f6737000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f673006dee0 0x7f6730154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.266+0000 7f6737000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67300ae860 0x7f6730153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.266+0000 7f6737000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6730158a20 0x7f6730146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.267+0000 7f6737000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6730154000 con 0x7f67300ae860 2024-08-17T02:24:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.267+0000 7f6737000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6730155d80 con 0x7f673006dee0 2024-08-17T02:24:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.267+0000 7f6737000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67301441f0 con 0x7f6730158a20 2024-08-17T02:24:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.267+0000 7f672f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67300ae860 0x7f6730153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.267+0000 7f672fe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f673006dee0 0x7f6730154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.267+0000 7f672f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67300ae860 0x7f6730153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48738/0 (socket says 172.21.15.5:48738) 2024-08-17T02:24:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.267+0000 7f672fe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f673006dee0 0x7f6730154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:37456/0 (socket says 172.21.15.5:37456) 2024-08-17T02:24:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.267+0000 7f672f400640 1 -- 172.21.15.5:0/2816226238 learned_addr learned my addr 172.21.15.5:0/2816226238 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.267+0000 7f6735000640 1 --2- 172.21.15.5:0/2816226238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6730158a20 0x7f6730146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.267+0000 7f672fe00640 1 -- 172.21.15.5:0/2816226238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6730158a20 msgr2=0x7f6730146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.267+0000 7f672fe00640 1 --2- 172.21.15.5:0/2816226238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6730158a20 0x7f6730146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.267+0000 7f672fe00640 1 -- 172.21.15.5:0/2816226238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67300ae860 msgr2=0x7f6730153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.267+0000 7f672fe00640 1 --2- 172.21.15.5:0/2816226238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67300ae860 0x7f6730153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.267+0000 7f672fe00640 1 -- 172.21.15.5:0/2816226238 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6720009390 con 0x7f673006dee0 2024-08-17T02:24:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.267+0000 7f672f400640 1 --2- 172.21.15.5:0/2816226238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67300ae860 0x7f6730153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.268+0000 7f672fe00640 1 --2- 172.21.15.5:0/2816226238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f673006dee0 0x7f6730154b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6720031000 tx=0x7f6720032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.268+0000 7f6727400640 1 -- 172.21.15.5:0/2816226238 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720031de0 con 0x7f673006dee0 2024-08-17T02:24:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.268+0000 7f6727400640 1 -- 172.21.15.5:0/2816226238 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672003d420 con 0x7f673006dee0 2024-08-17T02:24:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.268+0000 7f6727400640 1 -- 172.21.15.5:0/2816226238 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672003d7e0 con 0x7f673006dee0 2024-08-17T02:24:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.268+0000 7f6737000640 1 -- 172.21.15.5:0/2816226238 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6730155170 con 0x7f673006dee0 2024-08-17T02:24:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.268+0000 7f6737000640 1 -- 172.21.15.5:0/2816226238 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6730155730 con 0x7f673006dee0 2024-08-17T02:24:14.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.269+0000 7f6737000640 1 -- 172.21.15.5:0/2816226238 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6730063fb0 con 0x7f673006dee0 2024-08-17T02:24:14.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.270+0000 7f6727400640 1 -- 172.21.15.5:0/2816226238 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6720039040 con 0x7f673006dee0 2024-08-17T02:24:14.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.271+0000 7f6727400640 1 --2- 172.21.15.5:0/2816226238 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6710065180 0x7f6710067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:14.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.271+0000 7f6727400640 1 -- 172.21.15.5:0/2816226238 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f67200a2470 con 0x7f673006dee0 2024-08-17T02:24:14.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.271+0000 7f672f400640 1 --2- 172.21.15.5:0/2816226238 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6710065180 0x7f6710067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:14.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.272+0000 7f672f400640 1 --2- 172.21.15.5:0/2816226238 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6710065180 0x7f6710067630 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f67301527d0 tx=0x7f671c007d20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.276+0000 7f6727400640 1 -- 172.21.15.5:0/2816226238 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f67200705b0 con 0x7f673006dee0 2024-08-17T02:24:14.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:14.496+0000 7f6737000640 1 -- 172.21.15.5:0/2816226238 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f673006e4c0 con 0x7f673006dee0 2024-08-17T02:24:15.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.095+0000 7f6727400640 1 -- 172.21.15.5:0/2816226238 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6720073bd0 con 0x7f673006dee0 2024-08-17T02:24:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.097+0000 7f6737000640 1 -- 172.21.15.5:0/2816226238 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6710065180 msgr2=0x7f6710067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.097+0000 7f6737000640 1 --2- 172.21.15.5:0/2816226238 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6710065180 0x7f6710067630 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f67301527d0 tx=0x7f671c007d20 comp rx=0 tx=0).stop 2024-08-17T02:24:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.097+0000 7f6737000640 1 -- 172.21.15.5:0/2816226238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f673006dee0 msgr2=0x7f6730154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.097+0000 7f6737000640 1 --2- 172.21.15.5:0/2816226238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f673006dee0 0x7f6730154b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6720031000 tx=0x7f6720032000 comp rx=0 tx=0).stop 2024-08-17T02:24:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.097+0000 7f6737000640 1 -- 172.21.15.5:0/2816226238 shutdown_connections 2024-08-17T02:24:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.097+0000 7f6737000640 1 --2- 172.21.15.5:0/2816226238 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6710065180 0x7f6710067630 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.097+0000 7f6737000640 1 --2- 172.21.15.5:0/2816226238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6730158a20 0x7f6730146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.097+0000 7f6737000640 1 --2- 172.21.15.5:0/2816226238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67300ae860 0x7f6730153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.097+0000 7f6737000640 1 --2- 172.21.15.5:0/2816226238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f673006dee0 0x7f6730154b20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.097+0000 7f6737000640 1 -- 172.21.15.5:0/2816226238 >> 172.21.15.5:0/2816226238 conn(0x7f6730066e60 msgr2=0x7f67300afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.097+0000 7f6737000640 1 -- 172.21.15.5:0/2816226238 shutdown_connections 2024-08-17T02:24:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.098+0000 7f6737000640 1 -- 172.21.15.5:0/2816226238 wait complete. 2024-08-17T02:24:15.116 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:24:15.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.272+0000 7f708b800640 1 Processor -- start 2024-08-17T02:24:15.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.272+0000 7f708b800640 1 -- start start 2024-08-17T02:24:15.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.273+0000 7f708b800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f70840afc60 0x7f70840aac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:15.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.273+0000 7f708b800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7084156160 0x7f70841597b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:15.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.273+0000 7f708b800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70840aeb60 0x7f70840aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:15.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.273+0000 7f708b800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70840cb450 con 0x7f7084156160 2024-08-17T02:24:15.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.273+0000 7f708b800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70840b0ce0 con 0x7f70840afc60 2024-08-17T02:24:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.273+0000 7f708b800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7084159cf0 con 0x7f70840aeb60 2024-08-17T02:24:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.273+0000 7f7083e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7084156160 0x7f70841597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.273+0000 7f7083e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7084156160 0x7f70841597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48742/0 (socket says 172.21.15.5:48742) 2024-08-17T02:24:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.273+0000 7f7083e00640 1 -- 172.21.15.5:0/2882353223 learned_addr learned my addr 172.21.15.5:0/2882353223 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.274+0000 7f7089800640 1 --2- 172.21.15.5:0/2882353223 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70840aeb60 0x7f70840aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.274+0000 7f7088e00640 1 --2- 172.21.15.5:0/2882353223 >> v2:172.21.15.87:3300/0 conn(0x7f70840afc60 0x7f70840aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.274+0000 7f7083e00640 1 -- 172.21.15.5:0/2882353223 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70840aeb60 msgr2=0x7f70840aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.274+0000 7f7083e00640 1 --2- 172.21.15.5:0/2882353223 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70840aeb60 0x7f70840aefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.274+0000 7f7083e00640 1 -- 172.21.15.5:0/2882353223 >> v2:172.21.15.87:3300/0 conn(0x7f70840afc60 msgr2=0x7f70840aac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.274+0000 7f7083e00640 1 --2- 172.21.15.5:0/2882353223 >> v2:172.21.15.87:3300/0 conn(0x7f70840afc60 0x7f70840aac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.274+0000 7f7083e00640 1 -- 172.21.15.5:0/2882353223 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70840b0160 con 0x7f7084156160 2024-08-17T02:24:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.275+0000 7f7083e00640 1 --2- 172.21.15.5:0/2882353223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7084156160 0x7f70841597b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f70840ae530 tx=0x7f70700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0eecb3cb74089b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.275+0000 7f7083400640 1 -- 172.21.15.5:0/2882353223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707002acb0 con 0x7f7084156160 2024-08-17T02:24:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.275+0000 7f7083400640 1 -- 172.21.15.5:0/2882353223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707002ae10 con 0x7f7084156160 2024-08-17T02:24:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.275+0000 7f7083400640 1 -- 172.21.15.5:0/2882353223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7070032670 con 0x7f7084156160 2024-08-17T02:24:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.276+0000 7f708b800640 1 -- 172.21.15.5:0/2882353223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7084156160 msgr2=0x7f70841597b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.276+0000 7f708b800640 1 --2- 172.21.15.5:0/2882353223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7084156160 0x7f70841597b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f70840ae530 tx=0x7f70700091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.276+0000 7f708b800640 1 -- 172.21.15.5:0/2882353223 shutdown_connections 2024-08-17T02:24:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.276+0000 7f708b800640 1 --2- 172.21.15.5:0/2882353223 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70840aeb60 0x7f70840aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.276+0000 7f708b800640 1 --2- 172.21.15.5:0/2882353223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7084156160 0x7f70841597b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.276+0000 7f708b800640 1 --2- 172.21.15.5:0/2882353223 >> v2:172.21.15.87:3300/0 conn(0x7f70840afc60 0x7f70840aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.276+0000 7f708b800640 1 -- 172.21.15.5:0/2882353223 >> 172.21.15.5:0/2882353223 conn(0x7f7084066e60 msgr2=0x7f7084067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:15.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.276+0000 7f708b800640 1 -- 172.21.15.5:0/2882353223 shutdown_connections 2024-08-17T02:24:15.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.276+0000 7f708b800640 1 -- 172.21.15.5:0/2882353223 wait complete. 2024-08-17T02:24:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.277+0000 7f708b800640 1 Processor -- start 2024-08-17T02:24:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.277+0000 7f708b800640 1 -- start start 2024-08-17T02:24:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.278+0000 7f708b800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70840aeb60 0x7f708416a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.278+0000 7f708b800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70840afc60 0x7f70840aa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.278+0000 7f708b800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7084156160 0x7f7084152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.278+0000 7f708b800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70840aaac0 con 0x7f70840afc60 2024-08-17T02:24:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.278+0000 7f708b800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7084152790 con 0x7f70840aeb60 2024-08-17T02:24:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.278+0000 7f708b800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708416a050 con 0x7f7084156160 2024-08-17T02:24:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.279+0000 7f7083e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70840afc60 0x7f70840aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.279+0000 7f7083e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70840afc60 0x7f70840aa580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48750/0 (socket says 172.21.15.5:48750) 2024-08-17T02:24:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.279+0000 7f7083e00640 1 -- 172.21.15.5:0/2876546483 learned_addr learned my addr 172.21.15.5:0/2876546483 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.279+0000 7f7088e00640 1 --2- 172.21.15.5:0/2876546483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70840aeb60 0x7f708416a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.279+0000 7f7089800640 1 --2- 172.21.15.5:0/2876546483 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7084156160 0x7f7084152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.279+0000 7f7083e00640 1 -- 172.21.15.5:0/2876546483 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7084156160 msgr2=0x7f7084152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.279+0000 7f7083e00640 1 --2- 172.21.15.5:0/2876546483 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7084156160 0x7f7084152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.279+0000 7f7083e00640 1 -- 172.21.15.5:0/2876546483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70840aeb60 msgr2=0x7f708416a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.279+0000 7f7083e00640 1 --2- 172.21.15.5:0/2876546483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70840aeb60 0x7f708416a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.279+0000 7f7083e00640 1 -- 172.21.15.5:0/2876546483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7070009450 con 0x7f70840afc60 2024-08-17T02:24:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.279+0000 7f7089800640 1 --2- 172.21.15.5:0/2876546483 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7084156160 0x7f7084152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.279+0000 7f7088e00640 1 --2- 172.21.15.5:0/2876546483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70840aeb60 0x7f708416a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.279+0000 7f7083e00640 1 --2- 172.21.15.5:0/2876546483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70840afc60 0x7f70840aa580 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7070035040 tx=0x7f7070032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.280+0000 7f7077e00640 1 -- 172.21.15.5:0/2876546483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707003d700 con 0x7f70840afc60 2024-08-17T02:24:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.280+0000 7f7077e00640 1 -- 172.21.15.5:0/2876546483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707003d880 con 0x7f70840afc60 2024-08-17T02:24:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.280+0000 7f7077e00640 1 -- 172.21.15.5:0/2876546483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707003dc80 con 0x7f70840afc60 2024-08-17T02:24:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.280+0000 7f708b800640 1 -- 172.21.15.5:0/2876546483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70840c87e0 con 0x7f70840afc60 2024-08-17T02:24:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.280+0000 7f708b800640 1 -- 172.21.15.5:0/2876546483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7084169a90 con 0x7f70840afc60 2024-08-17T02:24:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.281+0000 7f708b800640 1 -- 172.21.15.5:0/2876546483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70840c8970 con 0x7f70840afc60 2024-08-17T02:24:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.282+0000 7f7077e00640 1 -- 172.21.15.5:0/2876546483 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7070039040 con 0x7f70840afc60 2024-08-17T02:24:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.282+0000 7f7077e00640 1 --2- 172.21.15.5:0/2876546483 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7064065220 0x7f70640676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:15.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.283+0000 7f7077e00640 1 -- 172.21.15.5:0/2876546483 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f70700a2120 con 0x7f70840afc60 2024-08-17T02:24:15.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.283+0000 7f7088e00640 1 --2- 172.21.15.5:0/2876546483 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7064065220 0x7f70640676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:15.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.283+0000 7f7088e00640 1 --2- 172.21.15.5:0/2876546483 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7064065220 0x7f70640676d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7084155cf0 tx=0x7f7078008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:15.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.287+0000 7f7077e00640 1 -- 172.21.15.5:0/2876546483 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7070070210 con 0x7f70840afc60 2024-08-17T02:24:15.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:15.470+0000 7f708b800640 1 -- 172.21.15.5:0/2876546483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7084063fb0 con 0x7f70840afc60 2024-08-17T02:24:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.096+0000 7f7077e00640 1 -- 172.21.15.5:0/2876546483 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7070077e60 con 0x7f70840afc60 2024-08-17T02:24:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:24:16.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.099+0000 7f708b800640 1 -- 172.21.15.5:0/2876546483 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7064065220 msgr2=0x7f70640676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.099+0000 7f708b800640 1 --2- 172.21.15.5:0/2876546483 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7064065220 0x7f70640676d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7084155cf0 tx=0x7f7078008040 comp rx=0 tx=0).stop 2024-08-17T02:24:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.099+0000 7f708b800640 1 -- 172.21.15.5:0/2876546483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70840afc60 msgr2=0x7f70840aa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.099+0000 7f708b800640 1 --2- 172.21.15.5:0/2876546483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70840afc60 0x7f70840aa580 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7070035040 tx=0x7f7070032000 comp rx=0 tx=0).stop 2024-08-17T02:24:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.099+0000 7f708b800640 1 -- 172.21.15.5:0/2876546483 shutdown_connections 2024-08-17T02:24:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.100+0000 7f708b800640 1 --2- 172.21.15.5:0/2876546483 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7064065220 0x7f70640676d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.100+0000 7f708b800640 1 --2- 172.21.15.5:0/2876546483 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7084156160 0x7f7084152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.100+0000 7f708b800640 1 --2- 172.21.15.5:0/2876546483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70840afc60 0x7f70840aa580 secure :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7070035040 tx=0x7f7070032000 comp rx=0 tx=0).stop 2024-08-17T02:24:16.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.100+0000 7f708b800640 1 --2- 172.21.15.5:0/2876546483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70840aeb60 0x7f708416a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.100+0000 7f708b800640 1 -- 172.21.15.5:0/2876546483 >> 172.21.15.5:0/2876546483 conn(0x7f7084066e60 msgr2=0x7f708406d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:16.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.100+0000 7f708b800640 1 -- 172.21.15.5:0/2876546483 shutdown_connections 2024-08-17T02:24:16.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.100+0000 7f708b800640 1 -- 172.21.15.5:0/2876546483 wait complete. 2024-08-17T02:24:16.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:24:16.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.274+0000 7f9cccc00640 1 Processor -- start 2024-08-17T02:24:16.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.275+0000 7f9cccc00640 1 -- start start 2024-08-17T02:24:16.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.276+0000 7f9cccc00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9cc80ad780 0x7f9cc80adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:16.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.276+0000 7f9cccc00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc80cae20 0x7f9cc80ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:16.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.276+0000 7f9cccc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cc80af6c0 0x7f9cc8157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:16.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.276+0000 7f9cccc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc80ca060 con 0x7f9cc80af6c0 2024-08-17T02:24:16.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.276+0000 7f9cccc00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc80ca340 con 0x7f9cc80ad780 2024-08-17T02:24:16.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.276+0000 7f9cccc00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc80ca620 con 0x7f9cc80cae20 2024-08-17T02:24:16.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.276+0000 7f9cc7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cc80af6c0 0x7f9cc8157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.276+0000 7f9cc7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cc80af6c0 0x7f9cc8157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48760/0 (socket says 172.21.15.5:48760) 2024-08-17T02:24:16.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.276+0000 7f9cc7e00640 1 -- 172.21.15.5:0/2913871845 learned_addr learned my addr 172.21.15.5:0/2913871845 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:16.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.277+0000 7f9cc6a00640 1 --2- 172.21.15.5:0/2913871845 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc80cae20 0x7f9cc80ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.277+0000 7f9cc7400640 1 --2- 172.21.15.5:0/2913871845 >> v2:172.21.15.87:3300/0 conn(0x7f9cc80ad780 0x7f9cc80adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.277+0000 7f9cc7e00640 1 -- 172.21.15.5:0/2913871845 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc80cae20 msgr2=0x7f9cc80ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:16.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.277+0000 7f9cc7e00640 1 --2- 172.21.15.5:0/2913871845 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc80cae20 0x7f9cc80ae6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.277+0000 7f9cc7e00640 1 -- 172.21.15.5:0/2913871845 >> v2:172.21.15.87:3300/0 conn(0x7f9cc80ad780 msgr2=0x7f9cc80adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:16.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.277+0000 7f9cc7e00640 1 --2- 172.21.15.5:0/2913871845 >> v2:172.21.15.87:3300/0 conn(0x7f9cc80ad780 0x7f9cc80adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.277+0000 7f9cc7e00640 1 -- 172.21.15.5:0/2913871845 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc80ca900 con 0x7f9cc80af6c0 2024-08-17T02:24:16.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.277+0000 7f9cc6a00640 1 --2- 172.21.15.5:0/2913871845 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc80cae20 0x7f9cc80ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:16.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.277+0000 7f9cc7400640 1 --2- 172.21.15.5:0/2913871845 >> v2:172.21.15.87:3300/0 conn(0x7f9cc80ad780 0x7f9cc80adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:16.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.278+0000 7f9cc7e00640 1 --2- 172.21.15.5:0/2913871845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cc80af6c0 0x7f9cc8157100 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8068830 tx=0x7f9cc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a501b27b9441c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:16.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.278+0000 7f9cc6000640 1 -- 172.21.15.5:0/2913871845 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0031400 con 0x7f9cc80af6c0 2024-08-17T02:24:16.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.278+0000 7f9cc6000640 1 -- 172.21.15.5:0/2913871845 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc002d050 con 0x7f9cc80af6c0 2024-08-17T02:24:16.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.278+0000 7f9cc6000640 1 -- 172.21.15.5:0/2913871845 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc00317d0 con 0x7f9cc80af6c0 2024-08-17T02:24:16.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.278+0000 7f9cccc00640 1 -- 172.21.15.5:0/2913871845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cc80af6c0 msgr2=0x7f9cc8157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.278+0000 7f9cccc00640 1 --2- 172.21.15.5:0/2913871845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cc80af6c0 0x7f9cc8157100 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8068830 tx=0x7f9cc0009840 comp rx=0 tx=0).stop 2024-08-17T02:24:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.279+0000 7f9cccc00640 1 -- 172.21.15.5:0/2913871845 shutdown_connections 2024-08-17T02:24:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.279+0000 7f9cccc00640 1 --2- 172.21.15.5:0/2913871845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cc80af6c0 0x7f9cc8157100 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.279+0000 7f9cccc00640 1 --2- 172.21.15.5:0/2913871845 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc80cae20 0x7f9cc80ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.279+0000 7f9cccc00640 1 --2- 172.21.15.5:0/2913871845 >> v2:172.21.15.87:3300/0 conn(0x7f9cc80ad780 0x7f9cc80adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.279+0000 7f9cccc00640 1 -- 172.21.15.5:0/2913871845 >> 172.21.15.5:0/2913871845 conn(0x7f9cc8066e60 msgr2=0x7f9cc8067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.279+0000 7f9cccc00640 1 -- 172.21.15.5:0/2913871845 shutdown_connections 2024-08-17T02:24:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.279+0000 7f9cccc00640 1 -- 172.21.15.5:0/2913871845 wait complete. 2024-08-17T02:24:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.280+0000 7f9cccc00640 1 Processor -- start 2024-08-17T02:24:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.280+0000 7f9cccc00640 1 -- start start 2024-08-17T02:24:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.281+0000 7f9cccc00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc80ad780 0x7f9cc8159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.281+0000 7f9cccc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cc80af6c0 0x7f9cc8151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.281+0000 7f9cccc00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc80cae20 0x7f9cc8151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.281+0000 7f9cccc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc8168970 con 0x7f9cc80af6c0 2024-08-17T02:24:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.281+0000 7f9cccc00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc8169900 con 0x7f9cc80cae20 2024-08-17T02:24:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.281+0000 7f9cccc00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc8168b60 con 0x7f9cc80ad780 2024-08-17T02:24:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.281+0000 7f9cc6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cc80af6c0 0x7f9cc8151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.281+0000 7f9cc6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cc80af6c0 0x7f9cc8151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48770/0 (socket says 172.21.15.5:48770) 2024-08-17T02:24:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.281+0000 7f9cc6a00640 1 -- 172.21.15.5:0/2238197639 learned_addr learned my addr 172.21.15.5:0/2238197639 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.282+0000 7f9cc7400640 1 --2- 172.21.15.5:0/2238197639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc80ad780 0x7f9cc8159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.282+0000 7f9cc7e00640 1 --2- 172.21.15.5:0/2238197639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc80cae20 0x7f9cc8151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.282+0000 7f9cc6a00640 1 -- 172.21.15.5:0/2238197639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc80ad780 msgr2=0x7f9cc8159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.282+0000 7f9cc6a00640 1 --2- 172.21.15.5:0/2238197639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc80ad780 0x7f9cc8159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.282+0000 7f9cc6a00640 1 -- 172.21.15.5:0/2238197639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc80cae20 msgr2=0x7f9cc8151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.282+0000 7f9cc6a00640 1 --2- 172.21.15.5:0/2238197639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc80cae20 0x7f9cc8151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.282+0000 7f9cc6a00640 1 -- 172.21.15.5:0/2238197639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc0009ae0 con 0x7f9cc80af6c0 2024-08-17T02:24:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.282+0000 7f9cc6a00640 1 --2- 172.21.15.5:0/2238197639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cc80af6c0 0x7f9cc8151020 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400c880 tx=0x7f9cb4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.282+0000 7f9cbea00640 1 -- 172.21.15.5:0/2238197639 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb400ce10 con 0x7f9cc80af6c0 2024-08-17T02:24:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.282+0000 7f9cbea00640 1 -- 172.21.15.5:0/2238197639 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb40077d0 con 0x7f9cc80af6c0 2024-08-17T02:24:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.282+0000 7f9cbea00640 1 -- 172.21.15.5:0/2238197639 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4007bb0 con 0x7f9cc80af6c0 2024-08-17T02:24:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.282+0000 7f9cccc00640 1 -- 172.21.15.5:0/2238197639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc8168e40 con 0x7f9cc80af6c0 2024-08-17T02:24:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.282+0000 7f9cccc00640 1 -- 172.21.15.5:0/2238197639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc8169400 con 0x7f9cc80af6c0 2024-08-17T02:24:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.283+0000 7f9cccc00640 1 -- 172.21.15.5:0/2238197639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc8063f10 con 0x7f9cc80af6c0 2024-08-17T02:24:16.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.284+0000 7f9cbea00640 1 -- 172.21.15.5:0/2238197639 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9cb40113f0 con 0x7f9cc80af6c0 2024-08-17T02:24:16.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.285+0000 7f9cbea00640 1 --2- 172.21.15.5:0/2238197639 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9ca8065150 0x7f9ca8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:16.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.285+0000 7f9cbea00640 1 -- 172.21.15.5:0/2238197639 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f9cb40822f0 con 0x7f9cc80af6c0 2024-08-17T02:24:16.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.285+0000 7f9cc7400640 1 --2- 172.21.15.5:0/2238197639 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9ca8065150 0x7f9ca8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.286+0000 7f9cc7400640 1 --2- 172.21.15.5:0/2238197639 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9ca8065150 0x7f9ca8067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800aa60 tx=0x7f9cb8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:16.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.289+0000 7f9cbea00640 1 -- 172.21.15.5:0/2238197639 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9cb4050470 con 0x7f9cc80af6c0 2024-08-17T02:24:16.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:16.474+0000 7f9cccc00640 1 -- 172.21.15.5:0/2238197639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9cc806e020 con 0x7f9cc80af6c0 2024-08-17T02:24:17.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:17.102+0000 7f9cbea00640 1 -- 172.21.15.5:0/2238197639 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9cb4053a90 con 0x7f9cc80af6c0 2024-08-17T02:24:17.104 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-17T02:24:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:17.106+0000 7f9cccc00640 1 -- 172.21.15.5:0/2238197639 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9ca8065150 msgr2=0x7f9ca8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:17.106+0000 7f9cccc00640 1 --2- 172.21.15.5:0/2238197639 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9ca8065150 0x7f9ca8067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800aa60 tx=0x7f9cb8008040 comp rx=0 tx=0).stop 2024-08-17T02:24:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:17.106+0000 7f9cccc00640 1 -- 172.21.15.5:0/2238197639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cc80af6c0 msgr2=0x7f9cc8151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:17.106+0000 7f9cccc00640 1 --2- 172.21.15.5:0/2238197639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cc80af6c0 0x7f9cc8151020 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400c880 tx=0x7f9cb4008040 comp rx=0 tx=0).stop 2024-08-17T02:24:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:17.106+0000 7f9cccc00640 1 -- 172.21.15.5:0/2238197639 shutdown_connections 2024-08-17T02:24:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:17.106+0000 7f9cccc00640 1 --2- 172.21.15.5:0/2238197639 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9ca8065150 0x7f9ca8067600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:17.106+0000 7f9cccc00640 1 --2- 172.21.15.5:0/2238197639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc80cae20 0x7f9cc8151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:17.106+0000 7f9cccc00640 1 --2- 172.21.15.5:0/2238197639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cc80af6c0 0x7f9cc8151020 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:17.106+0000 7f9cccc00640 1 --2- 172.21.15.5:0/2238197639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc80ad780 0x7f9cc8159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:17.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:17.106+0000 7f9cccc00640 1 -- 172.21.15.5:0/2238197639 >> 172.21.15.5:0/2238197639 conn(0x7f9cc8066e60 msgr2=0x7f9cc806a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:17.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:17.106+0000 7f9cccc00640 1 -- 172.21.15.5:0/2238197639 shutdown_connections 2024-08-17T02:24:17.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:17.106+0000 7f9cccc00640 1 -- 172.21.15.5:0/2238197639 wait complete. 2024-08-17T02:24:17.125 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:24:17.125 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:24:17.125 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:24:17.125 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:24:17.125 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:24:17.126 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:24:17.126 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:24:17.126 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:24:17.126 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:24:17.126 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:24:17.126 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:24:17.126 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:24:17.127 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:24:17.127 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:24:17.127 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:24:17.127 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:24:17.140 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:24:17.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:24:17.141 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:24:17.141 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:24:17.146 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:24:17.146 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:24:17.186 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:24:17.186 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:17.188 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:24:17.188 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:17.192 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:24:17.192 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:17.310 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-17T02:24:17.310 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-17T02:24:17.312 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-08-17T02:24:17.311+0000 7f5f17e00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-08-17T02:24:17.318 INFO:tasks.ceph.mds.d.smithi087.stdout:starting mds.d at 2024-08-17T02:24:22.111 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-08-17T02:24:23.146 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:24:23.147 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:24:23.152 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:24:23.152 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:23.152 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:24:23.280 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-08-17T02:24:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.315+0000 7f4841400640 1 Processor -- start 2024-08-17T02:24:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.315+0000 7f4841400640 1 -- start start 2024-08-17T02:24:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.317+0000 7f4841400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f483c0ae540 0x7f483c068950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.317+0000 7f4841400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f483c068e90 0x7f483c0ae910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.317+0000 7f4841400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483c0aab10 con 0x7f483c0aee50 2024-08-17T02:24:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.317+0000 7f4841400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483c0ac250 con 0x7f483c068e90 2024-08-17T02:24:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.317+0000 7f4841400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483c0693e0 con 0x7f483c0ae540 2024-08-17T02:24:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.317+0000 7f4833e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f483c068e90 0x7f483c0ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.317+0000 7f4833e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f483c068e90 0x7f483c0ae910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57876/0 (socket says 172.21.15.5:57876) 2024-08-17T02:24:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.317+0000 7f4833e00640 1 -- 172.21.15.5:0/1953815150 learned_addr learned my addr 172.21.15.5:0/1953815150 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.317+0000 7f483be00640 1 --2- 172.21.15.5:0/1953815150 >> v2:172.21.15.87:3300/0 conn(0x7f483c0ae540 0x7f483c068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.317+0000 7f4833e00640 1 -- 172.21.15.5:0/1953815150 >> v2:172.21.15.87:3300/0 conn(0x7f483c0ae540 msgr2=0x7f483c068950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.317+0000 7f4833e00640 1 --2- 172.21.15.5:0/1953815150 >> v2:172.21.15.87:3300/0 conn(0x7f483c0ae540 0x7f483c068950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.317+0000 7f4833e00640 1 -- 172.21.15.5:0/1953815150 >> v1:172.21.15.5:6789/0 conn(0x7f483c0aee50 legacy=0x7f483c0aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.317+0000 7f4833e00640 1 -- 172.21.15.5:0/1953815150 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c0696c0 con 0x7f483c068e90 2024-08-17T02:24:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.317+0000 7f483be00640 1 --2- 172.21.15.5:0/1953815150 >> v2:172.21.15.87:3300/0 conn(0x7f483c0ae540 0x7f483c068950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:23.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.319+0000 7f4833e00640 1 --2- 172.21.15.5:0/1953815150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483c068e90 0x7f483c0ae910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f483c06f0c0 tx=0x7f48240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2597bc4c83383d79 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:23.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.319+0000 7f483b400640 1 -- 172.21.15.5:0/1953815150 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482402add0 con 0x7f483c068e90 2024-08-17T02:24:23.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.319+0000 7f483b400640 1 -- 172.21.15.5:0/1953815150 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4824032440 con 0x7f483c068e90 2024-08-17T02:24:23.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.319+0000 7f483b400640 1 -- 172.21.15.5:0/1953815150 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824032820 con 0x7f483c068e90 2024-08-17T02:24:23.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.319+0000 7f4841400640 1 -- 172.21.15.5:0/1953815150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483c068e90 msgr2=0x7f483c0ae910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.319+0000 7f4841400640 1 --2- 172.21.15.5:0/1953815150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483c068e90 0x7f483c0ae910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f483c06f0c0 tx=0x7f48240091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.319+0000 7f4841400640 1 -- 172.21.15.5:0/1953815150 shutdown_connections 2024-08-17T02:24:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.319+0000 7f4841400640 1 --2- 172.21.15.5:0/1953815150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483c068e90 0x7f483c0ae910 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.319+0000 7f4841400640 1 --2- 172.21.15.5:0/1953815150 >> v2:172.21.15.87:3300/0 conn(0x7f483c0ae540 0x7f483c068950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.319+0000 7f4841400640 1 -- 172.21.15.5:0/1953815150 >> 172.21.15.5:0/1953815150 conn(0x7f483c0ce400 msgr2=0x7f483c095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.319+0000 7f4841400640 1 -- 172.21.15.5:0/1953815150 shutdown_connections 2024-08-17T02:24:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.319+0000 7f4841400640 1 -- 172.21.15.5:0/1953815150 wait complete. 2024-08-17T02:24:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.320+0000 7f4841400640 1 Processor -- start 2024-08-17T02:24:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.320+0000 7f4841400640 1 -- start start 2024-08-17T02:24:23.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.321+0000 7f4841400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f483c068e90 0x7f483c09a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.321+0000 7f4841400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483c0ae540 0x7f483c14b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.321+0000 7f4841400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f483c0aee50 0x7f483c15a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.321+0000 7f4841400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c09aa00 con 0x7f483c0ae540 2024-08-17T02:24:23.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.321+0000 7f4841400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c14ba30 con 0x7f483c0aee50 2024-08-17T02:24:23.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.321+0000 7f4841400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483c0c6d00 con 0x7f483c068e90 2024-08-17T02:24:23.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.322+0000 7f4833e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483c0ae540 0x7f483c14b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.322+0000 7f4833e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483c0ae540 0x7f483c14b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57882/0 (socket says 172.21.15.5:57882) 2024-08-17T02:24:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.322+0000 7f4833e00640 1 -- 172.21.15.5:0/1365906806 learned_addr learned my addr 172.21.15.5:0/1365906806 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.322+0000 7f483be00640 1 --2- 172.21.15.5:0/1365906806 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f483c068e90 0x7f483c09a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.322+0000 7f4840a00640 1 --2- 172.21.15.5:0/1365906806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f483c0aee50 0x7f483c15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.322+0000 7f4833e00640 1 -- 172.21.15.5:0/1365906806 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f483c068e90 msgr2=0x7f483c09a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.322+0000 7f4833e00640 1 --2- 172.21.15.5:0/1365906806 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f483c068e90 0x7f483c09a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.322+0000 7f4833e00640 1 -- 172.21.15.5:0/1365906806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f483c0aee50 msgr2=0x7f483c15a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.322+0000 7f4833e00640 1 --2- 172.21.15.5:0/1365906806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f483c0aee50 0x7f483c15a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.322+0000 7f4833e00640 1 -- 172.21.15.5:0/1365906806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4824009450 con 0x7f483c0ae540 2024-08-17T02:24:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.322+0000 7f4840a00640 1 --2- 172.21.15.5:0/1365906806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f483c0aee50 0x7f483c15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.322+0000 7f4833e00640 1 --2- 172.21.15.5:0/1365906806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483c0ae540 0x7f483c14b4f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4824009210 tx=0x7f4824032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.323+0000 7f4833400640 1 -- 172.21.15.5:0/1365906806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824006b30 con 0x7f483c0ae540 2024-08-17T02:24:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.323+0000 7f4833400640 1 -- 172.21.15.5:0/1365906806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4824031a40 con 0x7f483c0ae540 2024-08-17T02:24:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.323+0000 7f4833400640 1 -- 172.21.15.5:0/1365906806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824031e00 con 0x7f483c0ae540 2024-08-17T02:24:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.323+0000 7f4841400640 1 -- 172.21.15.5:0/1365906806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483c0c6fe0 con 0x7f483c0ae540 2024-08-17T02:24:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.323+0000 7f4841400640 1 -- 172.21.15.5:0/1365906806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483c0c75a0 con 0x7f483c0ae540 2024-08-17T02:24:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.324+0000 7f4841400640 1 -- 172.21.15.5:0/1365906806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483c0aacc0 con 0x7f483c0ae540 2024-08-17T02:24:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.326+0000 7f4833400640 1 -- 172.21.15.5:0/1365906806 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4824039040 con 0x7f483c0ae540 2024-08-17T02:24:23.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.326+0000 7f4833400640 1 --2- 172.21.15.5:0/1365906806 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4818065150 0x7f4818067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.326+0000 7f4833400640 1 -- 172.21.15.5:0/1365906806 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f48240a1dd0 con 0x7f483c0ae540 2024-08-17T02:24:23.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.326+0000 7f483be00640 1 --2- 172.21.15.5:0/1365906806 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4818065150 0x7f4818067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.326+0000 7f483be00640 1 --2- 172.21.15.5:0/1365906806 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4818065150 0x7f4818067600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f482c006e70 tx=0x7f482c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:23.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.330+0000 7f4833400640 1 -- 172.21.15.5:0/1365906806 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f483c0aacc0 con 0x7f483c0ae540 2024-08-17T02:24:23.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:23.524+0000 7f4841400640 1 -- 172.21.15.5:0/1365906806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f483c0aacc0 con 0x7f483c0ae540 2024-08-17T02:24:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.128+0000 7f4833400640 1 -- 172.21.15.5:0/1365906806 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f483c0aacc0 con 0x7f483c0ae540 2024-08-17T02:24:25.129 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-08-17T02:24:25.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.132+0000 7f4841400640 1 -- 172.21.15.5:0/1365906806 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4818065150 msgr2=0x7f4818067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.132+0000 7f4841400640 1 --2- 172.21.15.5:0/1365906806 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4818065150 0x7f4818067600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f482c006e70 tx=0x7f482c008040 comp rx=0 tx=0).stop 2024-08-17T02:24:25.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.132+0000 7f4841400640 1 -- 172.21.15.5:0/1365906806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483c0ae540 msgr2=0x7f483c14b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.132+0000 7f4841400640 1 --2- 172.21.15.5:0/1365906806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483c0ae540 0x7f483c14b4f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4824009210 tx=0x7f4824032000 comp rx=0 tx=0).stop 2024-08-17T02:24:25.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.132+0000 7f4841400640 1 -- 172.21.15.5:0/1365906806 shutdown_connections 2024-08-17T02:24:25.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.132+0000 7f4841400640 1 --2- 172.21.15.5:0/1365906806 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4818065150 0x7f4818067600 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.132+0000 7f4841400640 1 --2- 172.21.15.5:0/1365906806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f483c0aee50 0x7f483c15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.132+0000 7f4841400640 1 --2- 172.21.15.5:0/1365906806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483c0ae540 0x7f483c14b4f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.132+0000 7f4841400640 1 --2- 172.21.15.5:0/1365906806 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f483c068e90 0x7f483c09a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.132+0000 7f4841400640 1 -- 172.21.15.5:0/1365906806 >> 172.21.15.5:0/1365906806 conn(0x7f483c0ce400 msgr2=0x7f483c0b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:25.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.132+0000 7f4841400640 1 -- 172.21.15.5:0/1365906806 shutdown_connections 2024-08-17T02:24:25.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.132+0000 7f4841400640 1 -- 172.21.15.5:0/1365906806 wait complete. 2024-08-17T02:24:25.152 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:24:25.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.307+0000 7f9553200640 1 Processor -- start 2024-08-17T02:24:25.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.307+0000 7f9553200640 1 -- start start 2024-08-17T02:24:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.308+0000 7f9553200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9554158c60 0x7f955415a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.308+0000 7f9553200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95540b1920 0x7f95540b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.308+0000 7f9553200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f955415b6b0 con 0x7f9554159030 2024-08-17T02:24:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.308+0000 7f9553200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95540b0540 con 0x7f95540b1920 2024-08-17T02:24:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.308+0000 7f9553200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955415aac0 con 0x7f9554158c60 2024-08-17T02:24:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.308+0000 7f9552800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95540b1920 0x7f95540b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.308+0000 7f9552800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95540b1920 0x7f95540b1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57892/0 (socket says 172.21.15.5:57892) 2024-08-17T02:24:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.308+0000 7f9552800640 1 -- 172.21.15.5:0/554461260 learned_addr learned my addr 172.21.15.5:0/554461260 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.309+0000 7f9551e00640 1 --2- 172.21.15.5:0/554461260 >> v2:172.21.15.87:3300/0 conn(0x7f9554158c60 0x7f955415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.309+0000 7f9552800640 1 -- 172.21.15.5:0/554461260 >> v2:172.21.15.87:3300/0 conn(0x7f9554158c60 msgr2=0x7f955415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:25.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.309+0000 7f9552800640 1 --2- 172.21.15.5:0/554461260 >> v2:172.21.15.87:3300/0 conn(0x7f9554158c60 0x7f955415a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.309+0000 7f9552800640 1 -- 172.21.15.5:0/554461260 >> v1:172.21.15.87:6789/0 conn(0x7f9554159030 legacy=0x7f95540ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.309+0000 7f9552800640 1 -- 172.21.15.5:0/554461260 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955415ad80 con 0x7f95540b1920 2024-08-17T02:24:25.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.310+0000 7f9552800640 1 --2- 172.21.15.5:0/554461260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95540b1920 0x7f95540b1d20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f95540889c0 tx=0x7f954c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704b09395b6ad28d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:25.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.310+0000 7f9551400640 1 -- 172.21.15.5:0/554461260 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c032400 con 0x7f95540b1920 2024-08-17T02:24:25.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.310+0000 7f9551400640 1 -- 172.21.15.5:0/554461260 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954c02e050 con 0x7f95540b1920 2024-08-17T02:24:25.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.310+0000 7f9551400640 1 -- 172.21.15.5:0/554461260 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c0327f0 con 0x7f95540b1920 2024-08-17T02:24:25.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.311+0000 7f9553200640 1 -- 172.21.15.5:0/554461260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95540b1920 msgr2=0x7f95540b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.311+0000 7f9553200640 1 --2- 172.21.15.5:0/554461260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95540b1920 0x7f95540b1d20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f95540889c0 tx=0x7f954c009840 comp rx=0 tx=0).stop 2024-08-17T02:24:25.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.311+0000 7f9553200640 1 -- 172.21.15.5:0/554461260 shutdown_connections 2024-08-17T02:24:25.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.311+0000 7f9553200640 1 --2- 172.21.15.5:0/554461260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95540b1920 0x7f95540b1d20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.311+0000 7f9553200640 1 --2- 172.21.15.5:0/554461260 >> v2:172.21.15.87:3300/0 conn(0x7f9554158c60 0x7f955415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.311+0000 7f9553200640 1 -- 172.21.15.5:0/554461260 >> 172.21.15.5:0/554461260 conn(0x7f955406e590 msgr2=0x7f955406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:25.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.311+0000 7f9553200640 1 -- 172.21.15.5:0/554461260 shutdown_connections 2024-08-17T02:24:25.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.311+0000 7f9553200640 1 -- 172.21.15.5:0/554461260 wait complete. 2024-08-17T02:24:25.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.312+0000 7f9553200640 1 Processor -- start 2024-08-17T02:24:25.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.312+0000 7f9553200640 1 -- start start 2024-08-17T02:24:25.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.313+0000 7f9553200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95540b1920 0x7f9554157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.313+0000 7f9553200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9554158c60 0x7f95540c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.313+0000 7f9553200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9554159030 0x7f955415e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.313+0000 7f9553200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95540c4640 con 0x7f9554158c60 2024-08-17T02:24:25.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.313+0000 7f9553200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95540c4340 con 0x7f95540b1920 2024-08-17T02:24:25.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.313+0000 7f9553200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955415f0b0 con 0x7f9554159030 2024-08-17T02:24:25.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.313+0000 7f954be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9554158c60 0x7f95540c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.313+0000 7f954be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9554158c60 0x7f95540c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57904/0 (socket says 172.21.15.5:57904) 2024-08-17T02:24:25.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.313+0000 7f954be00640 1 -- 172.21.15.5:0/539788843 learned_addr learned my addr 172.21.15.5:0/539788843 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:25.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.314+0000 7f9552800640 1 --2- 172.21.15.5:0/539788843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9554159030 0x7f955415e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.314+0000 7f9551e00640 1 --2- 172.21.15.5:0/539788843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95540b1920 0x7f9554157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.314+0000 7f954be00640 1 -- 172.21.15.5:0/539788843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9554159030 msgr2=0x7f955415e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.314+0000 7f954be00640 1 --2- 172.21.15.5:0/539788843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9554159030 0x7f955415e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.314+0000 7f954be00640 1 -- 172.21.15.5:0/539788843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95540b1920 msgr2=0x7f9554157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.314+0000 7f954be00640 1 --2- 172.21.15.5:0/539788843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95540b1920 0x7f9554157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.314+0000 7f954be00640 1 -- 172.21.15.5:0/539788843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c009ae0 con 0x7f9554158c60 2024-08-17T02:24:25.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.314+0000 7f954be00640 1 --2- 172.21.15.5:0/539788843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9554158c60 0x7f95540c8ff0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f953c00c4f0 tx=0x7f953c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:25.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.314+0000 7f9549600640 1 -- 172.21.15.5:0/539788843 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c011590 con 0x7f9554158c60 2024-08-17T02:24:25.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.314+0000 7f9549600640 1 -- 172.21.15.5:0/539788843 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c011710 con 0x7f9554158c60 2024-08-17T02:24:25.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.314+0000 7f9549600640 1 -- 172.21.15.5:0/539788843 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c011ad0 con 0x7f9554158c60 2024-08-17T02:24:25.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.315+0000 7f9553200640 1 -- 172.21.15.5:0/539788843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955415f390 con 0x7f9554158c60 2024-08-17T02:24:25.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.315+0000 7f9553200640 1 -- 172.21.15.5:0/539788843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95541581b0 con 0x7f9554158c60 2024-08-17T02:24:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.316+0000 7f9553200640 1 -- 172.21.15.5:0/539788843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9554070720 con 0x7f9554158c60 2024-08-17T02:24:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.317+0000 7f9549600640 1 -- 172.21.15.5:0/539788843 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f953c01a360 con 0x7f9554158c60 2024-08-17T02:24:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.317+0000 7f9549600640 1 --2- 172.21.15.5:0/539788843 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9530065150 0x7f9530067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.317+0000 7f9549600640 1 -- 172.21.15.5:0/539788843 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f953c081060 con 0x7f9554158c60 2024-08-17T02:24:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.318+0000 7f9551e00640 1 --2- 172.21.15.5:0/539788843 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9530065150 0x7f9530067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.318+0000 7f9551e00640 1 --2- 172.21.15.5:0/539788843 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9530065150 0x7f9530067600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9544007ba0 tx=0x7f9544008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:25.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.322+0000 7f9549600640 1 -- 172.21.15.5:0/539788843 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f953c04f480 con 0x7f9554158c60 2024-08-17T02:24:25.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.567+0000 7f9553200640 1 -- 172.21.15.5:0/539788843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f955406ed30 con 0x7f9554158c60 2024-08-17T02:24:25.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.567+0000 7f9549600640 1 -- 172.21.15.5:0/539788843 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f953c017090 con 0x7f9554158c60 2024-08-17T02:24:25.568 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:25.568 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:24:25.568 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-08-17T02:24:25.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.568 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-08-17T02:24:25.568 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQByCcBmZAUYEhAASlbkqRzbSYtrkDuGHRqgeg==", 2024-08-17T02:24:25.568 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.568 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-17T02:24:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-17T02:24:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-17T02:24:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:24:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-08-17T02:24:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQByCcBm+uQZJRAAndCEBtQMjLEJy2B1AnKBwQ==", 2024-08-17T02:24:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-17T02:24:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-17T02:24:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-17T02:24:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:24:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-08-17T02:24:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQByCcBmRG6lGxAAR9h6PoSAXnG1wzn56/04Sg==", 2024-08-17T02:24:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-17T02:24:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-17T02:24:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-17T02:24:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:24:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-08-17T02:24:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQByCcBmWPN3LhAAxeirTm0g2oFwOttYg6jByg==", 2024-08-17T02:24:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-17T02:24:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-17T02:24:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-17T02:24:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:24:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-08-17T02:24:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB0CcBmf84uIBAAnwp8fxdBMZwGt6uiuEY02w==", 2024-08-17T02:24:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-17T02:24:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-17T02:24:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:24:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-08-17T02:24:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB3CcBmYl4VJBAAAPI7lWsxEkOJqXmwIV3Y+A==", 2024-08-17T02:24:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-17T02:24:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-17T02:24:25.573 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:24:25.573 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.573 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-08-17T02:24:25.573 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB6CcBmeOcbKBAAdxPpSnn+NPTVjhyGXwUotw==", 2024-08-17T02:24:25.573 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.573 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-17T02:24:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-17T02:24:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:24:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-08-17T02:24:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB9CcBm7w7XLBAAX3OJYNcHdQ4nGAXOBUkj5A==", 2024-08-17T02:24:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-17T02:24:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-17T02:24:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:24:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-08-17T02:24:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCDCcBmGXVtIRAAszEPIslbzNwCapzIZFcotQ==", 2024-08-17T02:24:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-17T02:24:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-17T02:24:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:24:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-08-17T02:24:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCGCcBma29zJhAAEmTKBe6FhVhhcfAGikyH1Q==", 2024-08-17T02:24:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-17T02:24:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-17T02:24:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:24:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-08-17T02:24:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCJCcBmkFspKhAAwhhaQrNy4rCe80G81mYXWQ==", 2024-08-17T02:24:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-17T02:24:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-17T02:24:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:24:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-08-17T02:24:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCMCcBmuzbiLRAAqFCXWg2aLsT/1woIqErqLw==", 2024-08-17T02:24:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-17T02:24:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-17T02:24:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:24:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-08-17T02:24:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQByCcBmP0e4NhAAB1StObxxuyD898gkWnolQA==", 2024-08-17T02:24:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-17T02:24:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-17T02:24:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-17T02:24:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-17T02:24:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-08-17T02:24:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBzCcBm9PVMBxAAqXVhHFkT7SoNj3mFRETi3Q==", 2024-08-17T02:24:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-17T02:24:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-17T02:24:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-17T02:24:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-17T02:24:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-08-17T02:24:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBzCcBmM5I2ARAAOdOcTvcE22/i8hP2vklq0A==", 2024-08-17T02:24:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-17T02:24:25.580 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-17T02:24:25.580 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-17T02:24:25.580 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-17T02:24:25.580 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.582 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-08-17T02:24:25.582 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBzCcBmvE9TDRAAuwbdDPlO3lEYHt0fbYrCvw==", 2024-08-17T02:24:25.582 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.582 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-17T02:24:25.582 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-17T02:24:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-17T02:24:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-17T02:24:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-08-17T02:24:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBxCcBmfNWKHxAA+bltLbBp4aavJ9u4aw84WA==", 2024-08-17T02:24:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-17T02:24:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-17T02:24:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-17T02:24:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:24:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:24:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUCcBmQzQBBxAAajJwTNtoGnVl2t/5WojGBg==", 2024-08-17T02:24:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:24:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:24:25.585 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUCcBmmj0BBxAA+HFS56+Ya2Buz976EaicGg==", 2024-08-17T02:24:25.585 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.585 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:24:25.585 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.585 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:24:25.585 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUCcBmv0YBBxAAWyfgUSshYcUhbIsKMttaUw==", 2024-08-17T02:24:25.585 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.585 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:24:25.585 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.586 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.586 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:24:25.586 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUCcBmR08BBxAAdEkiYuWeJj0K0e7GVo90zQ==", 2024-08-17T02:24:25.586 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.586 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:24:25.586 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.586 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.586 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:24:25.586 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUCcBmzVcBBxAAdwtY9VSWN48TvyliKq3VNw==", 2024-08-17T02:24:25.587 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.587 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:24:25.587 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.587 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.587 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:24:25.587 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUCcBmjWABBxAAZY2aMqWIHTwATip1MgxiLw==", 2024-08-17T02:24:25.587 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.587 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:24:25.587 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.587 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.588 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-08-17T02:24:25.588 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQByCcBm3P/ZCxAANVQk7OeahF/XMp2y9UNDOQ==", 2024-08-17T02:24:25.588 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.588 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-17T02:24:25.588 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-17T02:24:25.588 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:24:25.588 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:25.588 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:25.588 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-08-17T02:24:25.588 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQByCcBmCWxfBRAA6UCwyELcZC+o2GoJSU4hag==", 2024-08-17T02:24:25.589 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:24:25.589 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-17T02:24:25.589 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-17T02:24:25.589 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:24:25.589 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.589 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:25.589 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-17T02:24:25.589 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:24:25.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.569+0000 7f9553200640 1 -- 172.21.15.5:0/539788843 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9530065150 msgr2=0x7f9530067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.569+0000 7f9553200640 1 --2- 172.21.15.5:0/539788843 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9530065150 0x7f9530067600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9544007ba0 tx=0x7f9544008040 comp rx=0 tx=0).stop 2024-08-17T02:24:25.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.569+0000 7f9553200640 1 -- 172.21.15.5:0/539788843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9554158c60 msgr2=0x7f95540c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.569+0000 7f9553200640 1 --2- 172.21.15.5:0/539788843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9554158c60 0x7f95540c8ff0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f953c00c4f0 tx=0x7f953c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.570+0000 7f9553200640 1 -- 172.21.15.5:0/539788843 shutdown_connections 2024-08-17T02:24:25.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.570+0000 7f9553200640 1 --2- 172.21.15.5:0/539788843 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9530065150 0x7f9530067600 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.570+0000 7f9553200640 1 --2- 172.21.15.5:0/539788843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9554159030 0x7f955415e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.570+0000 7f9553200640 1 --2- 172.21.15.5:0/539788843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9554158c60 0x7f95540c8ff0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.570+0000 7f9553200640 1 --2- 172.21.15.5:0/539788843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95540b1920 0x7f9554157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.570+0000 7f9553200640 1 -- 172.21.15.5:0/539788843 >> 172.21.15.5:0/539788843 conn(0x7f955406e590 msgr2=0x7f95540cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:25.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.570+0000 7f9553200640 1 -- 172.21.15.5:0/539788843 shutdown_connections 2024-08-17T02:24:25.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.570+0000 7f9553200640 1 -- 172.21.15.5:0/539788843 wait complete. 2024-08-17T02:24:25.592 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:24:25.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.744+0000 7f31d5600640 1 Processor -- start 2024-08-17T02:24:25.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.744+0000 7f31d5600640 1 -- start start 2024-08-17T02:24:25.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.745+0000 7f31d5600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f31d00ad960 0x7f31d015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.745+0000 7f31d5600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31d00ca050 0x7f31d0156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.745+0000 7f31d5600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d015b5e0 con 0x7f31d00add30 2024-08-17T02:24:25.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.745+0000 7f31d5600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d00cb160 con 0x7f31d00ad960 2024-08-17T02:24:25.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.746+0000 7f31d5600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d00b0d10 con 0x7f31d00ca050 2024-08-17T02:24:25.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.746+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31d00ca050 0x7f31d0156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.746+0000 7f31cea00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f31d00ad960 0x7f31d015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.746+0000 7f31cf400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f31d00add30 0x7f31d0156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:48898/0 (socket says 172.21.15.5:48898) 2024-08-17T02:24:25.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.746+0000 7f31cf400640 1 -- 172.21.15.5:0/3087663616 learned_addr learned my addr 172.21.15.5:0/3087663616 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:25.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.746+0000 7f31ce000640 1 -- 172.21.15.5:0/3087663616 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675719536 0 0) 0x7f31c8001490 con 0x7f31d00add30 2024-08-17T02:24:25.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.746+0000 7f31ce000640 1 -- 172.21.15.5:0/3087663616 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31b40034e0 con 0x7f31d00add30 2024-08-17T02:24:25.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.746+0000 7f31c7e00640 1 -- 172.21.15.5:0/3087663616 >> v2:172.21.15.87:3300/0 conn(0x7f31d00ad960 msgr2=0x7f31d015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:25.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.746+0000 7f31c7e00640 1 --2- 172.21.15.5:0/3087663616 >> v2:172.21.15.87:3300/0 conn(0x7f31d00ad960 0x7f31d015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.746+0000 7f31c7e00640 1 -- 172.21.15.5:0/3087663616 >> v1:172.21.15.87:6789/0 conn(0x7f31d00add30 legacy=0x7f31d0156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.746+0000 7f31c7e00640 1 -- 172.21.15.5:0/3087663616 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d00ca550 con 0x7f31d00ca050 2024-08-17T02:24:25.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.746+0000 7f31cea00640 1 --2- 172.21.15.5:0/3087663616 >> v2:172.21.15.87:3300/0 conn(0x7f31d00ad960 0x7f31d015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:25.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.747+0000 7f31c7e00640 1 --2- 172.21.15.5:0/3087663616 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31d00ca050 0x7f31d0156420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009850 tx=0x7f31b80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63918341be3c23cf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:25.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.748+0000 7f31ce000640 1 -- 172.21.15.5:0/3087663616 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b802ae20 con 0x7f31d00ca050 2024-08-17T02:24:25.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.748+0000 7f31ce000640 1 -- 172.21.15.5:0/3087663616 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b8032440 con 0x7f31d00ca050 2024-08-17T02:24:25.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.748+0000 7f31ce000640 1 -- 172.21.15.5:0/3087663616 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8032800 con 0x7f31d00ca050 2024-08-17T02:24:25.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.748+0000 7f31d5600640 1 -- 172.21.15.5:0/3087663616 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31d00ca050 msgr2=0x7f31d0156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.748+0000 7f31d5600640 1 --2- 172.21.15.5:0/3087663616 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31d00ca050 0x7f31d0156420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009850 tx=0x7f31b80090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.748+0000 7f31d5600640 1 -- 172.21.15.5:0/3087663616 shutdown_connections 2024-08-17T02:24:25.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.748+0000 7f31d5600640 1 --2- 172.21.15.5:0/3087663616 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31d00ca050 0x7f31d0156420 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.748+0000 7f31d5600640 1 --2- 172.21.15.5:0/3087663616 >> v2:172.21.15.87:3300/0 conn(0x7f31d00ad960 0x7f31d015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.748+0000 7f31d5600640 1 -- 172.21.15.5:0/3087663616 >> 172.21.15.5:0/3087663616 conn(0x7f31d0066e60 msgr2=0x7f31d0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:25.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.749+0000 7f31d5600640 1 -- 172.21.15.5:0/3087663616 shutdown_connections 2024-08-17T02:24:25.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.749+0000 7f31d5600640 1 -- 172.21.15.5:0/3087663616 wait complete. 2024-08-17T02:24:25.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.750+0000 7f31d5600640 1 Processor -- start 2024-08-17T02:24:25.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.750+0000 7f31d5600640 1 -- start start 2024-08-17T02:24:25.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.751+0000 7f31d5600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d00ad960 0x7f31d014b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.751+0000 7f31d5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31d00add30 0x7f31d00ac460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.751+0000 7f31d5600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31d00ca050 0x7f31d0152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.751+0000 7f31d5600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d01584c0 con 0x7f31d00add30 2024-08-17T02:24:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.751+0000 7f31d5600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d014f790 con 0x7f31d00ad960 2024-08-17T02:24:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.751+0000 7f31d5600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d014fa70 con 0x7f31d00ca050 2024-08-17T02:24:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.751+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31d00add30 0x7f31d00ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.751+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31d00add30 0x7f31d00ac460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57912/0 (socket says 172.21.15.5:57912) 2024-08-17T02:24:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.751+0000 7f31c7e00640 1 -- 172.21.15.5:0/280773583 learned_addr learned my addr 172.21.15.5:0/280773583 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.752+0000 7f31cea00640 1 --2- 172.21.15.5:0/280773583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d00ad960 0x7f31d014b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.752+0000 7f31cf400640 1 --2- 172.21.15.5:0/280773583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31d00ca050 0x7f31d0152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.752+0000 7f31c7e00640 1 -- 172.21.15.5:0/280773583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31d00ca050 msgr2=0x7f31d0152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.752+0000 7f31c7e00640 1 --2- 172.21.15.5:0/280773583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31d00ca050 0x7f31d0152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.752+0000 7f31c7e00640 1 -- 172.21.15.5:0/280773583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d00ad960 msgr2=0x7f31d014b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.752+0000 7f31c7e00640 1 --2- 172.21.15.5:0/280773583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d00ad960 0x7f31d014b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.752+0000 7f31c7e00640 1 -- 172.21.15.5:0/280773583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c0009390 con 0x7f31d00add30 2024-08-17T02:24:25.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.752+0000 7f31cf400640 1 --2- 172.21.15.5:0/280773583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31d00ca050 0x7f31d0152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:25.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.752+0000 7f31c7e00640 1 --2- 172.21.15.5:0/280773583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31d00add30 0x7f31d00ac460 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009130 tx=0x7f31b8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:25.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.752+0000 7f31c6000640 1 -- 172.21.15.5:0/280773583 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8031830 con 0x7f31d00add30 2024-08-17T02:24:25.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.752+0000 7f31c6000640 1 -- 172.21.15.5:0/280773583 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b80319b0 con 0x7f31d00add30 2024-08-17T02:24:25.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.752+0000 7f31c6000640 1 -- 172.21.15.5:0/280773583 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8031d70 con 0x7f31d00add30 2024-08-17T02:24:25.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.752+0000 7f31d5600640 1 -- 172.21.15.5:0/280773583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b8009390 con 0x7f31d00add30 2024-08-17T02:24:25.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.753+0000 7f31d5600640 1 -- 172.21.15.5:0/280773583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d0150030 con 0x7f31d00add30 2024-08-17T02:24:25.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.754+0000 7f31d5600640 1 -- 172.21.15.5:0/280773583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d0063fb0 con 0x7f31d00add30 2024-08-17T02:24:25.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.754+0000 7f31c6000640 1 -- 172.21.15.5:0/280773583 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f31b8039050 con 0x7f31d00add30 2024-08-17T02:24:25.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.756+0000 7f31c6000640 1 --2- 172.21.15.5:0/280773583 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f31ac065180 0x7f31ac067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.756+0000 7f31c6000640 1 -- 172.21.15.5:0/280773583 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f31b80a2b80 con 0x7f31d00add30 2024-08-17T02:24:25.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.756+0000 7f31cea00640 1 --2- 172.21.15.5:0/280773583 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f31ac065180 0x7f31ac067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.757+0000 7f31cea00640 1 --2- 172.21.15.5:0/280773583 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f31ac065180 0x7f31ac067630 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009eb0 tx=0x7f31c00090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:25.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:25.760+0000 7f31c6000640 1 -- 172.21.15.5:0/280773583 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f31b8071040 con 0x7f31d00add30 2024-08-17T02:24:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.012+0000 7f31d5600640 1 -- 172.21.15.5:0/280773583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f31d006b850 con 0x7f31d00add30 2024-08-17T02:24:26.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.017+0000 7f31c6000640 1 -- 172.21.15.5:0/280773583 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f31b80370a0 con 0x7f31d00add30 2024-08-17T02:24:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.019+0000 7f31d5600640 1 -- 172.21.15.5:0/280773583 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f31ac065180 msgr2=0x7f31ac067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.019+0000 7f31d5600640 1 --2- 172.21.15.5:0/280773583 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f31ac065180 0x7f31ac067630 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009eb0 tx=0x7f31c00090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.019+0000 7f31d5600640 1 -- 172.21.15.5:0/280773583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31d00add30 msgr2=0x7f31d00ac460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.019+0000 7f31d5600640 1 --2- 172.21.15.5:0/280773583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31d00add30 0x7f31d00ac460 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009130 tx=0x7f31b8032000 comp rx=0 tx=0).stop 2024-08-17T02:24:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.019+0000 7f31d5600640 1 -- 172.21.15.5:0/280773583 shutdown_connections 2024-08-17T02:24:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.019+0000 7f31d5600640 1 --2- 172.21.15.5:0/280773583 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f31ac065180 0x7f31ac067630 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.019+0000 7f31d5600640 1 --2- 172.21.15.5:0/280773583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31d00ca050 0x7f31d0152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.019+0000 7f31d5600640 1 --2- 172.21.15.5:0/280773583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31d00add30 0x7f31d00ac460 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.019+0000 7f31d5600640 1 --2- 172.21.15.5:0/280773583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d00ad960 0x7f31d014b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.019+0000 7f31d5600640 1 -- 172.21.15.5:0/280773583 >> 172.21.15.5:0/280773583 conn(0x7f31d0066e60 msgr2=0x7f31d00b02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.019+0000 7f31d5600640 1 -- 172.21.15.5:0/280773583 shutdown_connections 2024-08-17T02:24:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.019+0000 7f31d5600640 1 -- 172.21.15.5:0/280773583 wait complete. 2024-08-17T02:24:26.035 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:24:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.187+0000 7f0023200640 1 Processor -- start 2024-08-17T02:24:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.188+0000 7f0023200640 1 -- start start 2024-08-17T02:24:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.189+0000 7f0023200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f001c156ef0 0x7f001c0ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.189+0000 7f0023200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001c0adf60 con 0x7f001c0adb00 2024-08-17T02:24:26.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.189+0000 7f0023200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001c0cb1e0 con 0x7f001c159eb0 2024-08-17T02:24:26.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.189+0000 7f0023200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001c0b0c50 con 0x7f001c156ef0 2024-08-17T02:24:26.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.189+0000 7f0022800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f001c0adb00 0x7f001c0af080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44942/0 (socket says 172.21.15.5:44942) 2024-08-17T02:24:26.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.189+0000 7f0022800640 1 -- 172.21.15.5:0/1770202936 learned_addr learned my addr 172.21.15.5:0/1770202936 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:26.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.189+0000 7f0021400640 1 --2- 172.21.15.5:0/1770202936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f001c156ef0 0x7f001c0ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.189+0000 7f0020a00640 1 -- 172.21.15.5:0/1770202936 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773257139 0 0) 0x7f0018001490 con 0x7f001c0adb00 2024-08-17T02:24:26.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.190+0000 7f0020a00640 1 -- 172.21.15.5:0/1770202936 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00040034e0 con 0x7f001c0adb00 2024-08-17T02:24:26.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.190+0000 7f0020a00640 1 -- 172.21.15.5:0/1770202936 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006489765 0 0) 0x7f001c0cb1e0 con 0x7f001c159eb0 2024-08-17T02:24:26.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.190+0000 7f0020a00640 1 -- 172.21.15.5:0/1770202936 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0018001490 con 0x7f001c159eb0 2024-08-17T02:24:26.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.190+0000 7f0021400640 1 -- 172.21.15.5:0/1770202936 >> v1:172.21.15.87:6789/0 conn(0x7f001c159eb0 legacy=0x7f001c0c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.190+0000 7f0021400640 1 -- 172.21.15.5:0/1770202936 >> v1:172.21.15.5:6789/0 conn(0x7f001c0adb00 legacy=0x7f001c0af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.190+0000 7f0021400640 1 -- 172.21.15.5:0/1770202936 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001c0cac20 con 0x7f001c156ef0 2024-08-17T02:24:26.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.191+0000 7f0021400640 1 --2- 172.21.15.5:0/1770202936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f001c156ef0 0x7f001c0ad5c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f000c009880 tx=0x7f000c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d485c4f1e2762e70 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:26.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.191+0000 7f0020a00640 1 -- 172.21.15.5:0/1770202936 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c02ad70 con 0x7f001c156ef0 2024-08-17T02:24:26.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.191+0000 7f0020a00640 1 -- 172.21.15.5:0/1770202936 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c032440 con 0x7f001c156ef0 2024-08-17T02:24:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.191+0000 7f0020a00640 1 -- 172.21.15.5:0/1770202936 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c0327e0 con 0x7f001c156ef0 2024-08-17T02:24:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.192+0000 7f0023200640 1 -- 172.21.15.5:0/1770202936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f001c156ef0 msgr2=0x7f001c0ad5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.192+0000 7f0023200640 1 --2- 172.21.15.5:0/1770202936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f001c156ef0 0x7f001c0ad5c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f000c009880 tx=0x7f000c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.192+0000 7f0023200640 1 -- 172.21.15.5:0/1770202936 shutdown_connections 2024-08-17T02:24:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.192+0000 7f0023200640 1 --2- 172.21.15.5:0/1770202936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f001c156ef0 0x7f001c0ad5c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.192+0000 7f0023200640 1 -- 172.21.15.5:0/1770202936 >> 172.21.15.5:0/1770202936 conn(0x7f001c066e60 msgr2=0x7f001c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.192+0000 7f0023200640 1 -- 172.21.15.5:0/1770202936 shutdown_connections 2024-08-17T02:24:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.192+0000 7f0023200640 1 -- 172.21.15.5:0/1770202936 wait complete. 2024-08-17T02:24:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.193+0000 7f0023200640 1 Processor -- start 2024-08-17T02:24:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.193+0000 7f0023200640 1 -- start start 2024-08-17T02:24:26.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.194+0000 7f0023200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f001c0adb00 0x7f001c14b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.194+0000 7f0023200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f001c156ef0 0x7f001c0abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.194+0000 7f0023200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f001c159eb0 0x7f001c15b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.194+0000 7f0023200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c0a97d0 con 0x7f001c0adb00 2024-08-17T02:24:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.194+0000 7f0023200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c0a9ab0 con 0x7f001c159eb0 2024-08-17T02:24:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.194+0000 7f0023200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001c0a9d90 con 0x7f001c156ef0 2024-08-17T02:24:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.195+0000 7f0021e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f001c0adb00 0x7f001c14b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.195+0000 7f0021e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f001c0adb00 0x7f001c14b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57928/0 (socket says 172.21.15.5:57928) 2024-08-17T02:24:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.195+0000 7f0021e00640 1 -- 172.21.15.5:0/2729760040 learned_addr learned my addr 172.21.15.5:0/2729760040 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.195+0000 7f0021400640 1 --2- 172.21.15.5:0/2729760040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f001c156ef0 0x7f001c0abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.195+0000 7f0022800640 1 --2- 172.21.15.5:0/2729760040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f001c159eb0 0x7f001c15b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.195+0000 7f0021e00640 1 -- 172.21.15.5:0/2729760040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f001c156ef0 msgr2=0x7f001c0abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.195+0000 7f0021e00640 1 --2- 172.21.15.5:0/2729760040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f001c156ef0 0x7f001c0abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.195+0000 7f0021e00640 1 -- 172.21.15.5:0/2729760040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f001c159eb0 msgr2=0x7f001c15b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.195+0000 7f0021e00640 1 --2- 172.21.15.5:0/2729760040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f001c159eb0 0x7f001c15b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.195+0000 7f0021e00640 1 -- 172.21.15.5:0/2729760040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c009390 con 0x7f001c0adb00 2024-08-17T02:24:26.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.195+0000 7f0021e00640 1 --2- 172.21.15.5:0/2729760040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f001c0adb00 0x7f001c14b3d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f001000c4e0 tx=0x7f0010007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:26.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.196+0000 7f0015600640 1 -- 172.21.15.5:0/2729760040 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0010016070 con 0x7f001c0adb00 2024-08-17T02:24:26.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.196+0000 7f0015600640 1 -- 172.21.15.5:0/2729760040 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0010011590 con 0x7f001c0adb00 2024-08-17T02:24:26.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.196+0000 7f0023200640 1 -- 172.21.15.5:0/2729760040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001c0aa070 con 0x7f001c0adb00 2024-08-17T02:24:26.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.196+0000 7f0015600640 1 -- 172.21.15.5:0/2729760040 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0010011990 con 0x7f001c0adb00 2024-08-17T02:24:26.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.196+0000 7f0023200640 1 -- 172.21.15.5:0/2729760040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001c0ac370 con 0x7f001c0adb00 2024-08-17T02:24:26.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.197+0000 7f0023200640 1 -- 172.21.15.5:0/2729760040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001c14cab0 con 0x7f001c0adb00 2024-08-17T02:24:26.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.197+0000 7f0015600640 1 -- 172.21.15.5:0/2729760040 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0010012420 con 0x7f001c0adb00 2024-08-17T02:24:26.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.198+0000 7f0015600640 1 --2- 172.21.15.5:0/2729760040 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0000065150 0x7f0000067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.198+0000 7f0015600640 1 -- 172.21.15.5:0/2729760040 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0010081b30 con 0x7f001c0adb00 2024-08-17T02:24:26.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.199+0000 7f0021400640 1 --2- 172.21.15.5:0/2729760040 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0000065150 0x7f0000067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.199+0000 7f0021400640 1 --2- 172.21.15.5:0/2729760040 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0000065150 0x7f0000067600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f000c034000 tx=0x7f000c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:26.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.203+0000 7f0015600640 1 -- 172.21.15.5:0/2729760040 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f001c14cab0 con 0x7f001c0adb00 2024-08-17T02:24:26.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.449+0000 7f0023200640 1 -- 172.21.15.5:0/2729760040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f001c14cab0 con 0x7f001c0adb00 2024-08-17T02:24:26.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.453+0000 7f0015600640 1 -- 172.21.15.5:0/2729760040 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f001c14cab0 con 0x7f001c0adb00 2024-08-17T02:24:26.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.455+0000 7f0023200640 1 -- 172.21.15.5:0/2729760040 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0000065150 msgr2=0x7f0000067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.455+0000 7f0023200640 1 --2- 172.21.15.5:0/2729760040 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0000065150 0x7f0000067600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f000c034000 tx=0x7f000c032000 comp rx=0 tx=0).stop 2024-08-17T02:24:26.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.455+0000 7f0023200640 1 -- 172.21.15.5:0/2729760040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f001c0adb00 msgr2=0x7f001c14b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.455+0000 7f0023200640 1 --2- 172.21.15.5:0/2729760040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f001c0adb00 0x7f001c14b3d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f001000c4e0 tx=0x7f0010007d80 comp rx=0 tx=0).stop 2024-08-17T02:24:26.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.455+0000 7f0023200640 1 -- 172.21.15.5:0/2729760040 shutdown_connections 2024-08-17T02:24:26.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.455+0000 7f0023200640 1 --2- 172.21.15.5:0/2729760040 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0000065150 0x7f0000067600 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.455+0000 7f0023200640 1 --2- 172.21.15.5:0/2729760040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f001c156ef0 0x7f001c0abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.455+0000 7f0023200640 1 --2- 172.21.15.5:0/2729760040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f001c159eb0 0x7f001c15b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.455+0000 7f0023200640 1 --2- 172.21.15.5:0/2729760040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f001c0adb00 0x7f001c14b3d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.455+0000 7f0023200640 1 -- 172.21.15.5:0/2729760040 >> 172.21.15.5:0/2729760040 conn(0x7f001c066e60 msgr2=0x7f001c06a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:26.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.456+0000 7f0023200640 1 -- 172.21.15.5:0/2729760040 shutdown_connections 2024-08-17T02:24:26.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.456+0000 7f0023200640 1 -- 172.21.15.5:0/2729760040 wait complete. 2024-08-17T02:24:26.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:24:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.623+0000 7fe4f5c00640 1 Processor -- start 2024-08-17T02:24:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.623+0000 7fe4f5c00640 1 -- start start 2024-08-17T02:24:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.625+0000 7fe4f5c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4f00afca0 0x7fe4f00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.625+0000 7fe4f5c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe4f01590b0 0x7fe4f0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.625+0000 7fe4f5c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f015a4e0 con 0x7fe4f00acf10 2024-08-17T02:24:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.625+0000 7fe4f5c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f00b0980 con 0x7fe4f01590b0 2024-08-17T02:24:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.625+0000 7fe4f5c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f00c92b0 con 0x7fe4f00afca0 2024-08-17T02:24:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.625+0000 7fe4ef400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe4f01590b0 0x7fe4f0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.625+0000 7fe4ef400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe4f01590b0 0x7fe4f0159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57938/0 (socket says 172.21.15.5:57938) 2024-08-17T02:24:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.625+0000 7fe4ef400640 1 -- 172.21.15.5:0/3112184107 learned_addr learned my addr 172.21.15.5:0/3112184107 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:26.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.625+0000 7fe4eea00640 1 --2- 172.21.15.5:0/3112184107 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4f00afca0 0x7fe4f00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.625+0000 7fe4ef400640 1 -- 172.21.15.5:0/3112184107 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4f00afca0 msgr2=0x7fe4f00b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:26.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.625+0000 7fe4ef400640 1 --2- 172.21.15.5:0/3112184107 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4f00afca0 0x7fe4f00b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.625+0000 7fe4ef400640 1 -- 172.21.15.5:0/3112184107 >> v1:172.21.15.87:6789/0 conn(0x7fe4f00acf10 legacy=0x7fe4f01589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.625+0000 7fe4ef400640 1 -- 172.21.15.5:0/3112184107 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f00ad480 con 0x7fe4f01590b0 2024-08-17T02:24:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.626+0000 7fe4ef400640 1 --2- 172.21.15.5:0/3112184107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4f01590b0 0x7fe4f0159fa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009f20 tx=0x7fe4e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5427850f0c848041 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.627+0000 7fe4ee000640 1 -- 172.21.15.5:0/3112184107 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8031400 con 0x7fe4f01590b0 2024-08-17T02:24:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.627+0000 7fe4ee000640 1 -- 172.21.15.5:0/3112184107 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e802d050 con 0x7fe4f01590b0 2024-08-17T02:24:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.627+0000 7fe4ee000640 1 -- 172.21.15.5:0/3112184107 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80317d0 con 0x7fe4f01590b0 2024-08-17T02:24:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.627+0000 7fe4f5c00640 1 -- 172.21.15.5:0/3112184107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4f01590b0 msgr2=0x7fe4f0159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.627+0000 7fe4f5c00640 1 --2- 172.21.15.5:0/3112184107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4f01590b0 0x7fe4f0159fa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009f20 tx=0x7fe4e8009840 comp rx=0 tx=0).stop 2024-08-17T02:24:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.627+0000 7fe4f5c00640 1 -- 172.21.15.5:0/3112184107 shutdown_connections 2024-08-17T02:24:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.627+0000 7fe4f5c00640 1 --2- 172.21.15.5:0/3112184107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4f01590b0 0x7fe4f0159fa0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.627+0000 7fe4f5c00640 1 --2- 172.21.15.5:0/3112184107 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4f00afca0 0x7fe4f00b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.627+0000 7fe4f5c00640 1 -- 172.21.15.5:0/3112184107 >> 172.21.15.5:0/3112184107 conn(0x7fe4f0066e60 msgr2=0x7fe4f0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:26.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.627+0000 7fe4f5c00640 1 -- 172.21.15.5:0/3112184107 shutdown_connections 2024-08-17T02:24:26.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.627+0000 7fe4f5c00640 1 -- 172.21.15.5:0/3112184107 wait complete. 2024-08-17T02:24:26.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.629+0000 7fe4f5c00640 1 Processor -- start 2024-08-17T02:24:26.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.629+0000 7fe4f5c00640 1 -- start start 2024-08-17T02:24:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.630+0000 7fe4f5c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4f00acf10 0x7fe4f015e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.630+0000 7fe4f5c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4f00afca0 0x7fe4f00c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.630+0000 7fe4f5c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4f01590b0 0x7fe4f0168ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.630+0000 7fe4f5c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f01515c0 con 0x7fe4f01590b0 2024-08-17T02:24:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.630+0000 7fe4f5c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f015c990 con 0x7fe4f00acf10 2024-08-17T02:24:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.630+0000 7fe4f5c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f015e9d0 con 0x7fe4f00afca0 2024-08-17T02:24:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.630+0000 7fe4ef400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4f01590b0 0x7fe4f0168ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.630+0000 7fe4ef400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4f01590b0 0x7fe4f0168ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57954/0 (socket says 172.21.15.5:57954) 2024-08-17T02:24:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.630+0000 7fe4ef400640 1 -- 172.21.15.5:0/3459079708 learned_addr learned my addr 172.21.15.5:0/3459079708 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:26.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.630+0000 7fe4eea00640 1 --2- 172.21.15.5:0/3459079708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4f00acf10 0x7fe4f015e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.630+0000 7fe4e7e00640 1 --2- 172.21.15.5:0/3459079708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4f00afca0 0x7fe4f00c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.630+0000 7fe4ef400640 1 -- 172.21.15.5:0/3459079708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4f00afca0 msgr2=0x7fe4f00c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.630+0000 7fe4ef400640 1 --2- 172.21.15.5:0/3459079708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4f00afca0 0x7fe4f00c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.630+0000 7fe4ef400640 1 -- 172.21.15.5:0/3459079708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4f00acf10 msgr2=0x7fe4f015e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.630+0000 7fe4ef400640 1 --2- 172.21.15.5:0/3459079708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4f00acf10 0x7fe4f015e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.630+0000 7fe4ef400640 1 -- 172.21.15.5:0/3459079708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e8009ae0 con 0x7fe4f01590b0 2024-08-17T02:24:26.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.631+0000 7fe4ef400640 1 --2- 172.21.15.5:0/3459079708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4f01590b0 0x7fe4f0168ef0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009f80 tx=0x7fe4e8036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:26.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.631+0000 7fe4e6000640 1 -- 172.21.15.5:0/3459079708 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8007e40 con 0x7fe4f01590b0 2024-08-17T02:24:26.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.631+0000 7fe4e6000640 1 -- 172.21.15.5:0/3459079708 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e803c420 con 0x7fe4f01590b0 2024-08-17T02:24:26.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.631+0000 7fe4f5c00640 1 -- 172.21.15.5:0/3459079708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f015c060 con 0x7fe4f01590b0 2024-08-17T02:24:26.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.631+0000 7fe4e6000640 1 -- 172.21.15.5:0/3459079708 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e803c7e0 con 0x7fe4f01590b0 2024-08-17T02:24:26.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.631+0000 7fe4f5c00640 1 -- 172.21.15.5:0/3459079708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f015c620 con 0x7fe4f01590b0 2024-08-17T02:24:26.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.632+0000 7fe4f5c00640 1 -- 172.21.15.5:0/3459079708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f015cb40 con 0x7fe4f01590b0 2024-08-17T02:24:26.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.633+0000 7fe4e6000640 1 -- 172.21.15.5:0/3459079708 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe4e803cb50 con 0x7fe4f01590b0 2024-08-17T02:24:26.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.634+0000 7fe4e6000640 1 --2- 172.21.15.5:0/3459079708 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe4cc065150 0x7fe4cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.634+0000 7fe4e6000640 1 -- 172.21.15.5:0/3459079708 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe4e80a3390 con 0x7fe4f01590b0 2024-08-17T02:24:26.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.634+0000 7fe4eea00640 1 --2- 172.21.15.5:0/3459079708 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe4cc065150 0x7fe4cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.635+0000 7fe4eea00640 1 --2- 172.21.15.5:0/3459079708 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe4cc065150 0x7fe4cc067600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0007ba0 tx=0x7fe4e0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:26.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.638+0000 7fe4e6000640 1 -- 172.21.15.5:0/3459079708 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe4f015cb40 con 0x7fe4f01590b0 2024-08-17T02:24:26.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.890+0000 7fe4f5c00640 1 -- 172.21.15.5:0/3459079708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fe4f015cb00 con 0x7fe4f01590b0 2024-08-17T02:24:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.894+0000 7fe4e6000640 1 -- 172.21.15.5:0/3459079708 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe4e80717b0 con 0x7fe4f01590b0 2024-08-17T02:24:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.896+0000 7fe4f5c00640 1 -- 172.21.15.5:0/3459079708 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe4cc065150 msgr2=0x7fe4cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.896+0000 7fe4f5c00640 1 --2- 172.21.15.5:0/3459079708 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe4cc065150 0x7fe4cc067600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0007ba0 tx=0x7fe4e0008040 comp rx=0 tx=0).stop 2024-08-17T02:24:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.896+0000 7fe4f5c00640 1 -- 172.21.15.5:0/3459079708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4f01590b0 msgr2=0x7fe4f0168ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.896+0000 7fe4f5c00640 1 --2- 172.21.15.5:0/3459079708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4f01590b0 0x7fe4f0168ef0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009f80 tx=0x7fe4e8036000 comp rx=0 tx=0).stop 2024-08-17T02:24:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.896+0000 7fe4f5c00640 1 -- 172.21.15.5:0/3459079708 shutdown_connections 2024-08-17T02:24:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.896+0000 7fe4f5c00640 1 --2- 172.21.15.5:0/3459079708 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe4cc065150 0x7fe4cc067600 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.896+0000 7fe4f5c00640 1 --2- 172.21.15.5:0/3459079708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4f00afca0 0x7fe4f00c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.896+0000 7fe4f5c00640 1 --2- 172.21.15.5:0/3459079708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4f01590b0 0x7fe4f0168ef0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.896+0000 7fe4f5c00640 1 --2- 172.21.15.5:0/3459079708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4f00acf10 0x7fe4f015e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.896+0000 7fe4f5c00640 1 -- 172.21.15.5:0/3459079708 >> 172.21.15.5:0/3459079708 conn(0x7fe4f0066e60 msgr2=0x7fe4f00ca980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.896+0000 7fe4f5c00640 1 -- 172.21.15.5:0/3459079708 shutdown_connections 2024-08-17T02:24:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:26.896+0000 7fe4f5c00640 1 -- 172.21.15.5:0/3459079708 wait complete. 2024-08-17T02:24:26.912 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:24:27.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.064+0000 7f8bab600640 1 Processor -- start 2024-08-17T02:24:27.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.064+0000 7f8bab600640 1 -- start start 2024-08-17T02:24:27.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.065+0000 7f8bab600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ba4158a20 0x7f8ba40a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.066+0000 7f8bab600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ba406dee0 0x7f8ba40afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.066+0000 7f8bab600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ba40aed90 con 0x7f8ba40ae860 2024-08-17T02:24:27.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.066+0000 7f8bab600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba40af070 con 0x7f8ba4158a20 2024-08-17T02:24:27.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.066+0000 7f8bab600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba40af350 con 0x7f8ba406dee0 2024-08-17T02:24:27.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.066+0000 7f8ba8c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ba4158a20 0x7f8ba40a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.066+0000 7f8ba8c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ba4158a20 0x7f8ba40a89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57962/0 (socket says 172.21.15.5:57962) 2024-08-17T02:24:27.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.066+0000 7f8ba8c00640 1 -- 172.21.15.5:0/454388405 learned_addr learned my addr 172.21.15.5:0/454388405 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:27.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.066+0000 7f8ba9600640 1 --2- 172.21.15.5:0/454388405 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ba406dee0 0x7f8ba40afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.066+0000 7f8ba8c00640 1 -- 172.21.15.5:0/454388405 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ba406dee0 msgr2=0x7f8ba40afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:27.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.066+0000 7f8ba8c00640 1 --2- 172.21.15.5:0/454388405 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ba406dee0 0x7f8ba40afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.066+0000 7f8ba8c00640 1 -- 172.21.15.5:0/454388405 >> v1:172.21.15.87:6789/0 conn(0x7f8ba40ae860 legacy=0x7f8ba406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.066+0000 7f8ba8c00640 1 -- 172.21.15.5:0/454388405 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba40af630 con 0x7f8ba4158a20 2024-08-17T02:24:27.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.067+0000 7f8ba8c00640 1 --2- 172.21.15.5:0/454388405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ba4158a20 0x7f8ba40a89c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009910 tx=0x7f8b980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9054673ce93c6e39 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:27.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.068+0000 7f8ba3400640 1 -- 172.21.15.5:0/454388405 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9802ae40 con 0x7f8ba4158a20 2024-08-17T02:24:27.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.068+0000 7f8ba3400640 1 -- 172.21.15.5:0/454388405 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b98032440 con 0x7f8ba4158a20 2024-08-17T02:24:27.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.068+0000 7f8ba3400640 1 -- 172.21.15.5:0/454388405 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98032820 con 0x7f8ba4158a20 2024-08-17T02:24:27.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.068+0000 7f8bab600640 1 -- 172.21.15.5:0/454388405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ba4158a20 msgr2=0x7f8ba40a89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.068+0000 7f8bab600640 1 --2- 172.21.15.5:0/454388405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ba4158a20 0x7f8ba40a89c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009910 tx=0x7f8b980091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.068+0000 7f8bab600640 1 -- 172.21.15.5:0/454388405 shutdown_connections 2024-08-17T02:24:27.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.068+0000 7f8bab600640 1 --2- 172.21.15.5:0/454388405 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ba406dee0 0x7f8ba40afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.068+0000 7f8bab600640 1 --2- 172.21.15.5:0/454388405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ba4158a20 0x7f8ba40a89c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.068+0000 7f8bab600640 1 -- 172.21.15.5:0/454388405 >> 172.21.15.5:0/454388405 conn(0x7f8ba4066e60 msgr2=0x7f8ba4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:27.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.068+0000 7f8bab600640 1 -- 172.21.15.5:0/454388405 shutdown_connections 2024-08-17T02:24:27.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.069+0000 7f8bab600640 1 -- 172.21.15.5:0/454388405 wait complete. 2024-08-17T02:24:27.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.070+0000 7f8bab600640 1 Processor -- start 2024-08-17T02:24:27.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.070+0000 7f8bab600640 1 -- start start 2024-08-17T02:24:27.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.071+0000 7f8bab600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ba406dee0 0x7f8ba416d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.071+0000 7f8bab600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba40ae860 0x7f8ba4143660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.071+0000 7f8bab600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ba4158a20 0x7f8ba41573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.071+0000 7f8bab600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba40c0b30 con 0x7f8ba406dee0 2024-08-17T02:24:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.071+0000 7f8bab600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba415b1a0 con 0x7f8ba40ae860 2024-08-17T02:24:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.071+0000 7f8bab600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba416d5a0 con 0x7f8ba4158a20 2024-08-17T02:24:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.071+0000 7f8ba8c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ba406dee0 0x7f8ba416d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.071+0000 7f8ba8c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ba406dee0 0x7f8ba416d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57964/0 (socket says 172.21.15.5:57964) 2024-08-17T02:24:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.071+0000 7f8ba8c00640 1 -- 172.21.15.5:0/727659929 learned_addr learned my addr 172.21.15.5:0/727659929 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.071+0000 7f8ba3e00640 1 --2- 172.21.15.5:0/727659929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba40ae860 0x7f8ba4143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.071+0000 7f8ba9600640 1 --2- 172.21.15.5:0/727659929 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ba4158a20 0x7f8ba41573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.071+0000 7f8ba8c00640 1 -- 172.21.15.5:0/727659929 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ba4158a20 msgr2=0x7f8ba41573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.071+0000 7f8ba8c00640 1 --2- 172.21.15.5:0/727659929 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ba4158a20 0x7f8ba41573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.071+0000 7f8ba8c00640 1 -- 172.21.15.5:0/727659929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba40ae860 msgr2=0x7f8ba4143660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.071+0000 7f8ba8c00640 1 --2- 172.21.15.5:0/727659929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba40ae860 0x7f8ba4143660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.071+0000 7f8ba8c00640 1 -- 172.21.15.5:0/727659929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b98009450 con 0x7f8ba406dee0 2024-08-17T02:24:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.072+0000 7f8ba8c00640 1 --2- 172.21.15.5:0/727659929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ba406dee0 0x7f8ba416d060 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8b98035040 tx=0x7f8b98032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.072+0000 7f8b97e00640 1 -- 172.21.15.5:0/727659929 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98031c80 con 0x7f8ba406dee0 2024-08-17T02:24:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.072+0000 7f8b97e00640 1 -- 172.21.15.5:0/727659929 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b98031e00 con 0x7f8ba406dee0 2024-08-17T02:24:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.072+0000 7f8b97e00640 1 -- 172.21.15.5:0/727659929 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9803d670 con 0x7f8ba406dee0 2024-08-17T02:24:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.072+0000 7f8bab600640 1 -- 172.21.15.5:0/727659929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba415a510 con 0x7f8ba406dee0 2024-08-17T02:24:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.072+0000 7f8bab600640 1 -- 172.21.15.5:0/727659929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba415ab50 con 0x7f8ba406dee0 2024-08-17T02:24:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.073+0000 7f8bab600640 1 -- 172.21.15.5:0/727659929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba4063fb0 con 0x7f8ba406dee0 2024-08-17T02:24:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.074+0000 7f8b97e00640 1 -- 172.21.15.5:0/727659929 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8b98039040 con 0x7f8ba406dee0 2024-08-17T02:24:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.075+0000 7f8b97e00640 1 --2- 172.21.15.5:0/727659929 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8b84065180 0x7f8b84067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.075+0000 7f8b97e00640 1 -- 172.21.15.5:0/727659929 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8b9802ae40 con 0x7f8ba406dee0 2024-08-17T02:24:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.075+0000 7f8ba3e00640 1 --2- 172.21.15.5:0/727659929 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8b84065180 0x7f8b84067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.076+0000 7f8ba3e00640 1 --2- 172.21.15.5:0/727659929 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8b84065180 0x7f8b84067630 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40b09e0 tx=0x7f8b90009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:27.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.079+0000 7f8b97e00640 1 -- 172.21.15.5:0/727659929 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8b98070440 con 0x7f8ba406dee0 2024-08-17T02:24:27.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.330+0000 7f8bab600640 1 -- 172.21.15.5:0/727659929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f8ba406e4c0 con 0x7f8ba406dee0 2024-08-17T02:24:27.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.334+0000 7f8b97e00640 1 -- 172.21.15.5:0/727659929 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8b980370a0 con 0x7f8ba406dee0 2024-08-17T02:24:27.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.336+0000 7f8bab600640 1 -- 172.21.15.5:0/727659929 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8b84065180 msgr2=0x7f8b84067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.336+0000 7f8bab600640 1 --2- 172.21.15.5:0/727659929 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8b84065180 0x7f8b84067630 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40b09e0 tx=0x7f8b90009040 comp rx=0 tx=0).stop 2024-08-17T02:24:27.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.336+0000 7f8bab600640 1 -- 172.21.15.5:0/727659929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ba406dee0 msgr2=0x7f8ba416d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.336+0000 7f8bab600640 1 --2- 172.21.15.5:0/727659929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ba406dee0 0x7f8ba416d060 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8b98035040 tx=0x7f8b98032000 comp rx=0 tx=0).stop 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.336+0000 7f8bab600640 1 -- 172.21.15.5:0/727659929 shutdown_connections 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.336+0000 7f8bab600640 1 --2- 172.21.15.5:0/727659929 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8b84065180 0x7f8b84067630 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.336+0000 7f8bab600640 1 --2- 172.21.15.5:0/727659929 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ba4158a20 0x7f8ba41573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.336+0000 7f8bab600640 1 --2- 172.21.15.5:0/727659929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba40ae860 0x7f8ba4143660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.336+0000 7f8bab600640 1 --2- 172.21.15.5:0/727659929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ba406dee0 0x7f8ba416d060 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.336+0000 7f8bab600640 1 -- 172.21.15.5:0/727659929 >> 172.21.15.5:0/727659929 conn(0x7f8ba4066e60 msgr2=0x7f8ba40ab8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.336+0000 7f8bab600640 1 -- 172.21.15.5:0/727659929 shutdown_connections 2024-08-17T02:24:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.336+0000 7f8bab600640 1 -- 172.21.15.5:0/727659929 wait complete. 2024-08-17T02:24:27.351 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:24:27.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.503+0000 7f0919200640 1 Processor -- start 2024-08-17T02:24:27.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.503+0000 7f0919200640 1 -- start start 2024-08-17T02:24:27.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.504+0000 7f0919200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0914158a00 0x7f0914158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.504+0000 7f0919200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09140cb190 0x7f09140cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.504+0000 7f0919200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f091406e590 0x7f091406e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.504+0000 7f0919200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f091406ef10 con 0x7f091406e590 2024-08-17T02:24:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.504+0000 7f0919200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09140cbc50 con 0x7f0914158a00 2024-08-17T02:24:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.504+0000 7f0919200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09140cbf30 con 0x7f09140cb190 2024-08-17T02:24:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.504+0000 7f0913e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f091406e590 0x7f091406e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.504+0000 7f0913e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f091406e590 0x7f091406e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57972/0 (socket says 172.21.15.5:57972) 2024-08-17T02:24:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.504+0000 7f0913e00640 1 -- 172.21.15.5:0/3735492591 learned_addr learned my addr 172.21.15.5:0/3735492591 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.504+0000 7f090be00640 1 --2- 172.21.15.5:0/3735492591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09140cb190 0x7f09140cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.505+0000 7f0913400640 1 --2- 172.21.15.5:0/3735492591 >> v2:172.21.15.87:3300/0 conn(0x7f0914158a00 0x7f0914158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.505+0000 7f0913e00640 1 -- 172.21.15.5:0/3735492591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09140cb190 msgr2=0x7f09140cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:27.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.505+0000 7f0913e00640 1 --2- 172.21.15.5:0/3735492591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09140cb190 0x7f09140cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.505+0000 7f0913e00640 1 -- 172.21.15.5:0/3735492591 >> v2:172.21.15.87:3300/0 conn(0x7f0914158a00 msgr2=0x7f0914158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:27.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.505+0000 7f0913e00640 1 --2- 172.21.15.5:0/3735492591 >> v2:172.21.15.87:3300/0 conn(0x7f0914158a00 0x7f0914158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.505+0000 7f0913e00640 1 -- 172.21.15.5:0/3735492591 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09140cc210 con 0x7f091406e590 2024-08-17T02:24:27.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.505+0000 7f090be00640 1 --2- 172.21.15.5:0/3735492591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09140cb190 0x7f09140cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:27.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.505+0000 7f0913400640 1 --2- 172.21.15.5:0/3735492591 >> v2:172.21.15.87:3300/0 conn(0x7f0914158a00 0x7f0914158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.506+0000 7f0913e00640 1 --2- 172.21.15.5:0/3735492591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f091406e590 0x7f091406e9d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f09140cfae0 tx=0x7f090c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178cd1ffde2b0dcf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.506+0000 7f0912a00640 1 -- 172.21.15.5:0/3735492591 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c031400 con 0x7f091406e590 2024-08-17T02:24:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.506+0000 7f0912a00640 1 -- 172.21.15.5:0/3735492591 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c02d050 con 0x7f091406e590 2024-08-17T02:24:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.506+0000 7f0912a00640 1 -- 172.21.15.5:0/3735492591 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0317d0 con 0x7f091406e590 2024-08-17T02:24:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.507+0000 7f0919200640 1 -- 172.21.15.5:0/3735492591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f091406e590 msgr2=0x7f091406e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.507+0000 7f0919200640 1 --2- 172.21.15.5:0/3735492591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f091406e590 0x7f091406e9d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f09140cfae0 tx=0x7f090c009840 comp rx=0 tx=0).stop 2024-08-17T02:24:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.507+0000 7f0919200640 1 -- 172.21.15.5:0/3735492591 shutdown_connections 2024-08-17T02:24:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.507+0000 7f0919200640 1 --2- 172.21.15.5:0/3735492591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f091406e590 0x7f091406e9d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.507+0000 7f0919200640 1 --2- 172.21.15.5:0/3735492591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09140cb190 0x7f09140cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.507+0000 7f0919200640 1 --2- 172.21.15.5:0/3735492591 >> v2:172.21.15.87:3300/0 conn(0x7f0914158a00 0x7f0914158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.507+0000 7f0919200640 1 -- 172.21.15.5:0/3735492591 >> 172.21.15.5:0/3735492591 conn(0x7f09140cfb80 msgr2=0x7f09140cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.507+0000 7f0919200640 1 -- 172.21.15.5:0/3735492591 shutdown_connections 2024-08-17T02:24:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.507+0000 7f0919200640 1 -- 172.21.15.5:0/3735492591 wait complete. 2024-08-17T02:24:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.508+0000 7f0919200640 1 Processor -- start 2024-08-17T02:24:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.508+0000 7f0919200640 1 -- start start 2024-08-17T02:24:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.509+0000 7f0919200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f091406e590 0x7f091415bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.509+0000 7f0919200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09140cb190 0x7f0914156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.509+0000 7f0919200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0914158a00 0x7f091415a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.509+0000 7f0919200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091415b760 con 0x7f09140cb190 2024-08-17T02:24:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.509+0000 7f0919200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091415c130 con 0x7f0914158a00 2024-08-17T02:24:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.509+0000 7f0919200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091415ab50 con 0x7f091406e590 2024-08-17T02:24:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.510+0000 7f090be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09140cb190 0x7f0914156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.510+0000 7f090be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09140cb190 0x7f0914156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57980/0 (socket says 172.21.15.5:57980) 2024-08-17T02:24:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.510+0000 7f090be00640 1 -- 172.21.15.5:0/1578125394 learned_addr learned my addr 172.21.15.5:0/1578125394 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.510+0000 7f0913400640 1 --2- 172.21.15.5:0/1578125394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f091406e590 0x7f091415bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.510+0000 7f0913e00640 1 --2- 172.21.15.5:0/1578125394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0914158a00 0x7f091415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.510+0000 7f090be00640 1 -- 172.21.15.5:0/1578125394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f091406e590 msgr2=0x7f091415bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.510+0000 7f090be00640 1 --2- 172.21.15.5:0/1578125394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f091406e590 0x7f091415bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.510+0000 7f090be00640 1 -- 172.21.15.5:0/1578125394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0914158a00 msgr2=0x7f091415a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.510+0000 7f090be00640 1 --2- 172.21.15.5:0/1578125394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0914158a00 0x7f091415a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.510+0000 7f090be00640 1 -- 172.21.15.5:0/1578125394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c009ae0 con 0x7f09140cb190 2024-08-17T02:24:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.510+0000 7f0913e00640 1 --2- 172.21.15.5:0/1578125394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0914158a00 0x7f091415a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.510+0000 7f090be00640 1 --2- 172.21.15.5:0/1578125394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09140cb190 0x7f0914156200 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00d890 tx=0x7f08fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.510+0000 7f090aa00640 1 -- 172.21.15.5:0/1578125394 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc00de80 con 0x7f09140cb190 2024-08-17T02:24:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.511+0000 7f090aa00640 1 -- 172.21.15.5:0/1578125394 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08fc00b8d0 con 0x7f09140cb190 2024-08-17T02:24:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.511+0000 7f090aa00640 1 -- 172.21.15.5:0/1578125394 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc00bc90 con 0x7f09140cb190 2024-08-17T02:24:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.511+0000 7f0919200640 1 -- 172.21.15.5:0/1578125394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091415ae30 con 0x7f09140cb190 2024-08-17T02:24:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.511+0000 7f0919200640 1 -- 172.21.15.5:0/1578125394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091415b3f0 con 0x7f09140cb190 2024-08-17T02:24:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.512+0000 7f0919200640 1 -- 172.21.15.5:0/1578125394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0914070720 con 0x7f09140cb190 2024-08-17T02:24:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.513+0000 7f090aa00640 1 -- 172.21.15.5:0/1578125394 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f08fc01e460 con 0x7f09140cb190 2024-08-17T02:24:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.513+0000 7f090aa00640 1 --2- 172.21.15.5:0/1578125394 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f08f0065150 0x7f08f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.513+0000 7f090aa00640 1 -- 172.21.15.5:0/1578125394 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f08fc082810 con 0x7f09140cb190 2024-08-17T02:24:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.514+0000 7f0913400640 1 --2- 172.21.15.5:0/1578125394 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f08f0065150 0x7f08f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.514+0000 7f0913400640 1 --2- 172.21.15.5:0/1578125394 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f08f0065150 0x7f08f0067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f090400bd40 tx=0x7f0904008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.517+0000 7f090aa00640 1 -- 172.21.15.5:0/1578125394 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f08fc054610 con 0x7f09140cb190 2024-08-17T02:24:27.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.764+0000 7f0919200640 1 -- 172.21.15.5:0/1578125394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f09140cb7e0 con 0x7f09140cb190 2024-08-17T02:24:27.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.768+0000 7f090aa00640 1 -- 172.21.15.5:0/1578125394 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f08fc0541a0 con 0x7f09140cb190 2024-08-17T02:24:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.770+0000 7f0919200640 1 -- 172.21.15.5:0/1578125394 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f08f0065150 msgr2=0x7f08f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.770+0000 7f0919200640 1 --2- 172.21.15.5:0/1578125394 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f08f0065150 0x7f08f0067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f090400bd40 tx=0x7f0904008040 comp rx=0 tx=0).stop 2024-08-17T02:24:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.770+0000 7f0919200640 1 -- 172.21.15.5:0/1578125394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09140cb190 msgr2=0x7f0914156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.770+0000 7f0919200640 1 --2- 172.21.15.5:0/1578125394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09140cb190 0x7f0914156200 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00d890 tx=0x7f08fc008040 comp rx=0 tx=0).stop 2024-08-17T02:24:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.771+0000 7f0919200640 1 -- 172.21.15.5:0/1578125394 shutdown_connections 2024-08-17T02:24:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.771+0000 7f0919200640 1 --2- 172.21.15.5:0/1578125394 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f08f0065150 0x7f08f0067600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.771+0000 7f0919200640 1 --2- 172.21.15.5:0/1578125394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0914158a00 0x7f091415a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.771+0000 7f0919200640 1 --2- 172.21.15.5:0/1578125394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09140cb190 0x7f0914156200 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.771+0000 7f0919200640 1 --2- 172.21.15.5:0/1578125394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f091406e590 0x7f091415bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.771+0000 7f0919200640 1 -- 172.21.15.5:0/1578125394 >> 172.21.15.5:0/1578125394 conn(0x7f09140cfb80 msgr2=0x7f09140cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.771+0000 7f0919200640 1 -- 172.21.15.5:0/1578125394 shutdown_connections 2024-08-17T02:24:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.771+0000 7f0919200640 1 -- 172.21.15.5:0/1578125394 wait complete. 2024-08-17T02:24:27.786 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:24:27.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.938+0000 7fcc18a00640 1 Processor -- start 2024-08-17T02:24:27.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.938+0000 7fcc18a00640 1 -- start start 2024-08-17T02:24:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.939+0000 7fcc18a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc140ae540 0x7fcc14068950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.939+0000 7fcc18a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcc14068e90 0x7fcc140ae910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.939+0000 7fcc18a00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc140aab10 con 0x7fcc140aee50 2024-08-17T02:24:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.939+0000 7fcc18a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc140ac250 con 0x7fcc14068e90 2024-08-17T02:24:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.939+0000 7fcc18a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc140693e0 con 0x7fcc140ae540 2024-08-17T02:24:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.940+0000 7fcc0be00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcc14068e90 0x7fcc140ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.940+0000 7fcc12800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc140ae540 0x7fcc14068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.940+0000 7fcc13200640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fcc140aee50 0x7fcc140aafa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:48934/0 (socket says 172.21.15.5:48934) 2024-08-17T02:24:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.940+0000 7fcc13200640 1 -- 172.21.15.5:0/2615496757 learned_addr learned my addr 172.21.15.5:0/2615496757 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.940+0000 7fcc0be00640 1 -- 172.21.15.5:0/2615496757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc140ae540 msgr2=0x7fcc14068950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.940+0000 7fcc0be00640 1 --2- 172.21.15.5:0/2615496757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc140ae540 0x7fcc14068950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.940+0000 7fcc0be00640 1 -- 172.21.15.5:0/2615496757 >> v1:172.21.15.87:6789/0 conn(0x7fcc140aee50 legacy=0x7fcc140aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.940+0000 7fcc0be00640 1 -- 172.21.15.5:0/2615496757 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc140696c0 con 0x7fcc14068e90 2024-08-17T02:24:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.940+0000 7fcc12800640 1 --2- 172.21.15.5:0/2615496757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc140ae540 0x7fcc14068950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.941+0000 7fcc0be00640 1 --2- 172.21.15.5:0/2615496757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc14068e90 0x7fcc140ae910 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009850 tx=0x7fcbfc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e99fb101bfc0b0b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.941+0000 7fcc11e00640 1 -- 172.21.15.5:0/2615496757 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc02ad00 con 0x7fcc14068e90 2024-08-17T02:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.941+0000 7fcc11e00640 1 -- 172.21.15.5:0/2615496757 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc02ae60 con 0x7fcc14068e90 2024-08-17T02:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.942+0000 7fcc11e00640 1 -- 172.21.15.5:0/2615496757 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc032670 con 0x7fcc14068e90 2024-08-17T02:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.942+0000 7fcc18a00640 1 -- 172.21.15.5:0/2615496757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc14068e90 msgr2=0x7fcc140ae910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.942+0000 7fcc18a00640 1 --2- 172.21.15.5:0/2615496757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc14068e90 0x7fcc140ae910 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009850 tx=0x7fcbfc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.942+0000 7fcc18a00640 1 -- 172.21.15.5:0/2615496757 shutdown_connections 2024-08-17T02:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.942+0000 7fcc18a00640 1 --2- 172.21.15.5:0/2615496757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc14068e90 0x7fcc140ae910 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.942+0000 7fcc18a00640 1 --2- 172.21.15.5:0/2615496757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc140ae540 0x7fcc14068950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.942+0000 7fcc18a00640 1 -- 172.21.15.5:0/2615496757 >> 172.21.15.5:0/2615496757 conn(0x7fcc140ce400 msgr2=0x7fcc14095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.942+0000 7fcc18a00640 1 -- 172.21.15.5:0/2615496757 shutdown_connections 2024-08-17T02:24:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.942+0000 7fcc18a00640 1 -- 172.21.15.5:0/2615496757 wait complete. 2024-08-17T02:24:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.943+0000 7fcc18a00640 1 Processor -- start 2024-08-17T02:24:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.944+0000 7fcc18a00640 1 -- start start 2024-08-17T02:24:27.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.944+0000 7fcc18a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc14068e90 0x7fcc1409b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.944+0000 7fcc18a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc140ae540 0x7fcc140c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.944+0000 7fcc18a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc140aee50 0x7fcc1414f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.944+0000 7fcc18a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1409b650 con 0x7fcc140aee50 2024-08-17T02:24:27.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.944+0000 7fcc18a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc141689b0 con 0x7fcc140ae540 2024-08-17T02:24:27.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.944+0000 7fcc18a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1416c3b0 con 0x7fcc14068e90 2024-08-17T02:24:27.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.945+0000 7fcc13200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc140aee50 0x7fcc1414f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.945+0000 7fcc13200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc140aee50 0x7fcc1414f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57990/0 (socket says 172.21.15.5:57990) 2024-08-17T02:24:27.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.945+0000 7fcc13200640 1 -- 172.21.15.5:0/2661629026 learned_addr learned my addr 172.21.15.5:0/2661629026 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:27.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.945+0000 7fcc12800640 1 --2- 172.21.15.5:0/2661629026 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc14068e90 0x7fcc1409b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.945+0000 7fcc0be00640 1 --2- 172.21.15.5:0/2661629026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc140ae540 0x7fcc140c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.945+0000 7fcc13200640 1 -- 172.21.15.5:0/2661629026 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc14068e90 msgr2=0x7fcc1409b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.945+0000 7fcc13200640 1 --2- 172.21.15.5:0/2661629026 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc14068e90 0x7fcc1409b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.945+0000 7fcc13200640 1 -- 172.21.15.5:0/2661629026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc140ae540 msgr2=0x7fcc140c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.945+0000 7fcc13200640 1 --2- 172.21.15.5:0/2661629026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc140ae540 0x7fcc140c6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.945+0000 7fcc13200640 1 -- 172.21.15.5:0/2661629026 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc04009390 con 0x7fcc140aee50 2024-08-17T02:24:27.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.946+0000 7fcc13200640 1 --2- 172.21.15.5:0/2661629026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc140aee50 0x7fcc1414f430 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00cc40 tx=0x7fcc0c001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:27.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.946+0000 7fcc0a000640 1 -- 172.21.15.5:0/2661629026 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c00ce60 con 0x7fcc140aee50 2024-08-17T02:24:27.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.946+0000 7fcc0a000640 1 -- 172.21.15.5:0/2661629026 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0c00a850 con 0x7fcc140aee50 2024-08-17T02:24:27.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.946+0000 7fcc0a000640 1 -- 172.21.15.5:0/2661629026 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c00ac10 con 0x7fcc140aee50 2024-08-17T02:24:27.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.946+0000 7fcc18a00640 1 -- 172.21.15.5:0/2661629026 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbfc009390 con 0x7fcc140aee50 2024-08-17T02:24:27.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.946+0000 7fcc18a00640 1 -- 172.21.15.5:0/2661629026 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1416c970 con 0x7fcc140aee50 2024-08-17T02:24:27.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.947+0000 7fcc18a00640 1 -- 172.21.15.5:0/2661629026 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc14070720 con 0x7fcc140aee50 2024-08-17T02:24:27.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.948+0000 7fcc0a000640 1 -- 172.21.15.5:0/2661629026 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcc0c0070f0 con 0x7fcc140aee50 2024-08-17T02:24:27.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.949+0000 7fcc0a000640 1 --2- 172.21.15.5:0/2661629026 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcbf0065180 0x7fcbf0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.949+0000 7fcc0a000640 1 -- 172.21.15.5:0/2661629026 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fcc0c082090 con 0x7fcc140aee50 2024-08-17T02:24:27.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.949+0000 7fcc12800640 1 --2- 172.21.15.5:0/2661629026 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcbf0065180 0x7fcbf0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.949+0000 7fcc12800640 1 --2- 172.21.15.5:0/2661629026 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcbf0065180 0x7fcbf0067630 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009eb0 tx=0x7fcc040090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:27.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:27.953+0000 7fcc0a000640 1 -- 172.21.15.5:0/2661629026 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcc0c050690 con 0x7fcc140aee50 2024-08-17T02:24:28.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.204+0000 7fcc18a00640 1 -- 172.21.15.5:0/2661629026 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fcc140c70a0 con 0x7fcc140aee50 2024-08-17T02:24:28.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.208+0000 7fcc0a000640 1 -- 172.21.15.5:0/2661629026 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcc0c053cb0 con 0x7fcc140aee50 2024-08-17T02:24:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.210+0000 7fcc18a00640 1 -- 172.21.15.5:0/2661629026 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcbf0065180 msgr2=0x7fcbf0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.210+0000 7fcc18a00640 1 --2- 172.21.15.5:0/2661629026 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcbf0065180 0x7fcbf0067630 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009eb0 tx=0x7fcc040090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.210+0000 7fcc18a00640 1 -- 172.21.15.5:0/2661629026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc140aee50 msgr2=0x7fcc1414f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.210+0000 7fcc18a00640 1 --2- 172.21.15.5:0/2661629026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc140aee50 0x7fcc1414f430 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00cc40 tx=0x7fcc0c001a50 comp rx=0 tx=0).stop 2024-08-17T02:24:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.210+0000 7fcc18a00640 1 -- 172.21.15.5:0/2661629026 shutdown_connections 2024-08-17T02:24:28.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.210+0000 7fcc18a00640 1 --2- 172.21.15.5:0/2661629026 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcbf0065180 0x7fcbf0067630 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.210+0000 7fcc18a00640 1 --2- 172.21.15.5:0/2661629026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc140aee50 0x7fcc1414f430 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.210+0000 7fcc18a00640 1 --2- 172.21.15.5:0/2661629026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc140ae540 0x7fcc140c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.210+0000 7fcc18a00640 1 --2- 172.21.15.5:0/2661629026 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc14068e90 0x7fcc1409b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.210+0000 7fcc18a00640 1 -- 172.21.15.5:0/2661629026 >> 172.21.15.5:0/2661629026 conn(0x7fcc140ce400 msgr2=0x7fcc140b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:28.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.211+0000 7fcc18a00640 1 -- 172.21.15.5:0/2661629026 shutdown_connections 2024-08-17T02:24:28.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.211+0000 7fcc18a00640 1 -- 172.21.15.5:0/2661629026 wait complete. 2024-08-17T02:24:28.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:28.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.377+0000 7f77c6000640 1 Processor -- start 2024-08-17T02:24:28.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.378+0000 7f77c6000640 1 -- start start 2024-08-17T02:24:28.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.379+0000 7f77c6000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77c00cd810 0x7f77c00cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.379+0000 7f77c6000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f77c0158d60 0x7f77c00cca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.379+0000 7f77c6000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c00ce930 con 0x7f77c0158990 2024-08-17T02:24:28.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.379+0000 7f77c6000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c00ccfa0 con 0x7f77c00cd810 2024-08-17T02:24:28.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.379+0000 7f77c6000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c00cdd20 con 0x7f77c0158d60 2024-08-17T02:24:28.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.379+0000 7f77bfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77c00cd810 0x7f77c00cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.379+0000 7f77bfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77c00cd810 0x7f77c00cc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57994/0 (socket says 172.21.15.5:57994) 2024-08-17T02:24:28.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.379+0000 7f77bfe00640 1 -- 172.21.15.5:0/4046132743 learned_addr learned my addr 172.21.15.5:0/4046132743 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:28.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.380+0000 7f77bfe00640 1 -- 172.21.15.5:0/4046132743 >> v2:172.21.15.87:3300/0 conn(0x7f77c0158d60 msgr2=0x7f77c00cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.380+0000 7f77c5600640 1 --2- 172.21.15.5:0/4046132743 >> v2:172.21.15.87:3300/0 conn(0x7f77c0158d60 0x7f77c00cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.380+0000 7f77bfe00640 1 --2- 172.21.15.5:0/4046132743 >> v2:172.21.15.87:3300/0 conn(0x7f77c0158d60 0x7f77c00cca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.380+0000 7f77bfe00640 1 -- 172.21.15.5:0/4046132743 >> v1:172.21.15.5:6789/0 conn(0x7f77c0158990 legacy=0x7f77c00ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.380+0000 7f77bfe00640 1 -- 172.21.15.5:0/4046132743 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c00ce000 con 0x7f77c00cd810 2024-08-17T02:24:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.380+0000 7f77c5600640 1 --2- 172.21.15.5:0/4046132743 >> v2:172.21.15.87:3300/0 conn(0x7f77c0158d60 0x7f77c00cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.381+0000 7f77bfe00640 1 --2- 172.21.15.5:0/4046132743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77c00cd810 0x7f77c00cc520 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f77c0069790 tx=0x7f77ac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4e6c21ee037940 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.381+0000 7f77bf400640 1 -- 172.21.15.5:0/4046132743 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac032440 con 0x7f77c00cd810 2024-08-17T02:24:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.381+0000 7f77bf400640 1 -- 172.21.15.5:0/4046132743 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac0325a0 con 0x7f77c00cd810 2024-08-17T02:24:28.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.381+0000 7f77bf400640 1 -- 172.21.15.5:0/4046132743 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac032980 con 0x7f77c00cd810 2024-08-17T02:24:28.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.381+0000 7f77c6000640 1 -- 172.21.15.5:0/4046132743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77c00cd810 msgr2=0x7f77c00cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.381+0000 7f77c6000640 1 --2- 172.21.15.5:0/4046132743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77c00cd810 0x7f77c00cc520 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f77c0069790 tx=0x7f77ac0091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.382+0000 7f77c6000640 1 -- 172.21.15.5:0/4046132743 shutdown_connections 2024-08-17T02:24:28.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.382+0000 7f77c6000640 1 --2- 172.21.15.5:0/4046132743 >> v2:172.21.15.87:3300/0 conn(0x7f77c0158d60 0x7f77c00cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.382+0000 7f77c6000640 1 --2- 172.21.15.5:0/4046132743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77c00cd810 0x7f77c00cc520 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.382+0000 7f77c6000640 1 -- 172.21.15.5:0/4046132743 >> 172.21.15.5:0/4046132743 conn(0x7f77c006e590 msgr2=0x7f77c006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:28.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.382+0000 7f77c6000640 1 -- 172.21.15.5:0/4046132743 shutdown_connections 2024-08-17T02:24:28.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.382+0000 7f77c6000640 1 -- 172.21.15.5:0/4046132743 wait complete. 2024-08-17T02:24:28.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.383+0000 7f77c6000640 1 Processor -- start 2024-08-17T02:24:28.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.383+0000 7f77c6000640 1 -- start start 2024-08-17T02:24:28.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.384+0000 7f77c6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77c00cd810 0x7f77c01694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.384+0000 7f77c6000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77c0158990 0x7f77c00c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.384+0000 7f77c6000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77c0158d60 0x7f77c0154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.384+0000 7f77c6000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c00b4c10 con 0x7f77c00cd810 2024-08-17T02:24:28.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.384+0000 7f77c6000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c0169a10 con 0x7f77c0158990 2024-08-17T02:24:28.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.384+0000 7f77c6000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c00b4930 con 0x7f77c0158d60 2024-08-17T02:24:28.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.384+0000 7f77c4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77c00cd810 0x7f77c01694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.384+0000 7f77c4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77c00cd810 0x7f77c01694d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58002/0 (socket says 172.21.15.5:58002) 2024-08-17T02:24:28.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.384+0000 7f77c4c00640 1 -- 172.21.15.5:0/1924075096 learned_addr learned my addr 172.21.15.5:0/1924075096 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:28.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.385+0000 7f77c4c00640 1 -- 172.21.15.5:0/1924075096 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77c0158d60 msgr2=0x7f77c0154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.385+0000 7f77c4c00640 1 --2- 172.21.15.5:0/1924075096 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77c0158d60 0x7f77c0154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.385+0000 7f77c4c00640 1 -- 172.21.15.5:0/1924075096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77c0158990 msgr2=0x7f77c00c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.385+0000 7f77c4c00640 1 --2- 172.21.15.5:0/1924075096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77c0158990 0x7f77c00c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.385+0000 7f77c4c00640 1 -- 172.21.15.5:0/1924075096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ac009450 con 0x7f77c00cd810 2024-08-17T02:24:28.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.385+0000 7f77c4c00640 1 --2- 172.21.15.5:0/1924075096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77c00cd810 0x7f77c01694d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f77b400c560 tx=0x7f77b4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:28.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.385+0000 7f77b3e00640 1 -- 172.21.15.5:0/1924075096 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b4011590 con 0x7f77c00cd810 2024-08-17T02:24:28.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.385+0000 7f77b3e00640 1 -- 172.21.15.5:0/1924075096 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b4011710 con 0x7f77c00cd810 2024-08-17T02:24:28.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.385+0000 7f77c6000640 1 -- 172.21.15.5:0/1924075096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c00b2b10 con 0x7f77c00cd810 2024-08-17T02:24:28.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.385+0000 7f77b3e00640 1 -- 172.21.15.5:0/1924075096 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b4011ad0 con 0x7f77c00cd810 2024-08-17T02:24:28.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.385+0000 7f77c6000640 1 -- 172.21.15.5:0/1924075096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c00b30d0 con 0x7f77c00cd810 2024-08-17T02:24:28.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.386+0000 7f77c6000640 1 -- 172.21.15.5:0/1924075096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c00b2970 con 0x7f77c00cd810 2024-08-17T02:24:28.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.387+0000 7f77b3e00640 1 -- 172.21.15.5:0/1924075096 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f77b401b3b0 con 0x7f77c00cd810 2024-08-17T02:24:28.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.388+0000 7f77b3e00640 1 --2- 172.21.15.5:0/1924075096 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f77a0065150 0x7f77a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.388+0000 7f77b3e00640 1 -- 172.21.15.5:0/1924075096 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f77b40816a0 con 0x7f77c00cd810 2024-08-17T02:24:28.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.388+0000 7f77bfe00640 1 --2- 172.21.15.5:0/1924075096 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f77a0065150 0x7f77a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.389+0000 7f77bfe00640 1 --2- 172.21.15.5:0/1924075096 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f77a0065150 0x7f77a0067600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f77ac034000 tx=0x7f77ac032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:28.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.392+0000 7f77b3e00640 1 -- 172.21.15.5:0/1924075096 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f77c00b2970 con 0x7f77c00cd810 2024-08-17T02:24:28.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.574+0000 7f77c6000640 1 -- 172.21.15.5:0/1924075096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77c00b2970 con 0x7f77c00cd810 2024-08-17T02:24:28.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.574+0000 7f77b3e00640 1 -- 172.21.15.5:0/1924075096 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12038 (secure 0 0 0) 0x7f77c00b2970 con 0x7f77c00cd810 2024-08-17T02:24:28.575 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:28.575 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:24:25.125313+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:28.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.577+0000 7f77c6000640 1 -- 172.21.15.5:0/1924075096 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f77a0065150 msgr2=0x7f77a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.577+0000 7f77c6000640 1 --2- 172.21.15.5:0/1924075096 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f77a0065150 0x7f77a0067600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f77ac034000 tx=0x7f77ac032000 comp rx=0 tx=0).stop 2024-08-17T02:24:28.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.577+0000 7f77c6000640 1 -- 172.21.15.5:0/1924075096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77c00cd810 msgr2=0x7f77c01694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.577+0000 7f77c6000640 1 --2- 172.21.15.5:0/1924075096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77c00cd810 0x7f77c01694d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f77b400c560 tx=0x7f77b4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.577+0000 7f77c6000640 1 -- 172.21.15.5:0/1924075096 shutdown_connections 2024-08-17T02:24:28.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.577+0000 7f77c6000640 1 --2- 172.21.15.5:0/1924075096 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f77a0065150 0x7f77a0067600 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.577+0000 7f77c6000640 1 --2- 172.21.15.5:0/1924075096 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77c0158d60 0x7f77c0154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.577+0000 7f77c6000640 1 --2- 172.21.15.5:0/1924075096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77c0158990 0x7f77c00c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.577+0000 7f77c6000640 1 --2- 172.21.15.5:0/1924075096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77c00cd810 0x7f77c01694d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.577+0000 7f77c6000640 1 -- 172.21.15.5:0/1924075096 >> 172.21.15.5:0/1924075096 conn(0x7f77c006e590 msgr2=0x7f77c00685c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:28.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.577+0000 7f77c6000640 1 -- 172.21.15.5:0/1924075096 shutdown_connections 2024-08-17T02:24:28.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.577+0000 7f77c6000640 1 -- 172.21.15.5:0/1924075096 wait complete. 2024-08-17T02:24:28.592 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:28.773677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:24:28.592 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:28.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.745+0000 7f565e200640 1 Processor -- start 2024-08-17T02:24:28.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.745+0000 7f565e200640 1 -- start start 2024-08-17T02:24:28.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.747+0000 7f565e200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f56580cc7e0 0x7f56580ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.747+0000 7f565e200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56580cdc60 con 0x7f565815bbd0 2024-08-17T02:24:28.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.747+0000 7f565e200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56580cdf40 con 0x7f56580cd780 2024-08-17T02:24:28.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.747+0000 7f565e200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56580ce220 con 0x7f56580cc7e0 2024-08-17T02:24:28.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.747+0000 7f565ce00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f56580cc7e0 0x7f56580ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.747+0000 7f565ce00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f56580cc7e0 0x7f56580ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58010/0 (socket says 172.21.15.5:58010) 2024-08-17T02:24:28.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.747+0000 7f565ce00640 1 -- 172.21.15.5:0/4008319187 learned_addr learned my addr 172.21.15.5:0/4008319187 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:28.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.747+0000 7f565ce00640 1 -- 172.21.15.5:0/4008319187 >> v1:172.21.15.87:6789/0 conn(0x7f56580cd780 legacy=0x7f56580cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.747+0000 7f565ce00640 1 -- 172.21.15.5:0/4008319187 >> v1:172.21.15.5:6789/0 conn(0x7f565815bbd0 legacy=0x7f565815c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.748+0000 7f565ce00640 1 -- 172.21.15.5:0/4008319187 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56580ce500 con 0x7f56580cc7e0 2024-08-17T02:24:28.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.749+0000 7f565ce00640 1 --2- 172.21.15.5:0/4008319187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56580cc7e0 0x7f56580ccbb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f564c009910 tx=0x7f564c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48bc90af84c28b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:28.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.749+0000 7f5657400640 1 -- 172.21.15.5:0/4008319187 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c032440 con 0x7f56580cc7e0 2024-08-17T02:24:28.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.749+0000 7f5657400640 1 -- 172.21.15.5:0/4008319187 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c0325a0 con 0x7f56580cc7e0 2024-08-17T02:24:28.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.749+0000 7f5657400640 1 -- 172.21.15.5:0/4008319187 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c032980 con 0x7f56580cc7e0 2024-08-17T02:24:28.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.749+0000 7f565e200640 1 -- 172.21.15.5:0/4008319187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56580cc7e0 msgr2=0x7f56580ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.749+0000 7f565e200640 1 --2- 172.21.15.5:0/4008319187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56580cc7e0 0x7f56580ccbb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f564c009910 tx=0x7f564c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.749+0000 7f565e200640 1 -- 172.21.15.5:0/4008319187 shutdown_connections 2024-08-17T02:24:28.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.749+0000 7f565e200640 1 --2- 172.21.15.5:0/4008319187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56580cc7e0 0x7f56580ccbb0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.750+0000 7f565e200640 1 -- 172.21.15.5:0/4008319187 >> 172.21.15.5:0/4008319187 conn(0x7f5658087a80 msgr2=0x7f565806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:28.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.750+0000 7f565e200640 1 -- 172.21.15.5:0/4008319187 shutdown_connections 2024-08-17T02:24:28.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.750+0000 7f565e200640 1 -- 172.21.15.5:0/4008319187 wait complete. 2024-08-17T02:24:28.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.751+0000 7f565e200640 1 Processor -- start 2024-08-17T02:24:28.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.751+0000 7f565e200640 1 -- start start 2024-08-17T02:24:28.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.752+0000 7f565e200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56580cc7e0 0x7f56580c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.752+0000 7f565e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56580cd780 0x7f5658155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.752+0000 7f565e200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f565815bbd0 0x7f5658155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.752+0000 7f565e200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5658169230 con 0x7f56580cd780 2024-08-17T02:24:28.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.752+0000 7f565e200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5658169510 con 0x7f56580cc7e0 2024-08-17T02:24:28.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.752+0000 7f565e200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56581697f0 con 0x7f565815bbd0 2024-08-17T02:24:28.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.752+0000 7f5657e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56580cd780 0x7f5658155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.752+0000 7f5657e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56580cd780 0x7f5658155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58018/0 (socket says 172.21.15.5:58018) 2024-08-17T02:24:28.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.752+0000 7f5657e00640 1 -- 172.21.15.5:0/3573377328 learned_addr learned my addr 172.21.15.5:0/3573377328 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:28.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.752+0000 7f565ce00640 1 --2- 172.21.15.5:0/3573377328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56580cc7e0 0x7f56580c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.752+0000 7f565d800640 1 --2- 172.21.15.5:0/3573377328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f565815bbd0 0x7f5658155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.753+0000 7f5657e00640 1 -- 172.21.15.5:0/3573377328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f565815bbd0 msgr2=0x7f5658155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.753+0000 7f5657e00640 1 --2- 172.21.15.5:0/3573377328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f565815bbd0 0x7f5658155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.753+0000 7f5657e00640 1 -- 172.21.15.5:0/3573377328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56580cc7e0 msgr2=0x7f56580c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.753+0000 7f5657e00640 1 --2- 172.21.15.5:0/3573377328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56580cc7e0 0x7f56580c5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.753+0000 7f5657e00640 1 -- 172.21.15.5:0/3573377328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c009450 con 0x7f56580cd780 2024-08-17T02:24:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.753+0000 7f5657e00640 1 --2- 172.21.15.5:0/3573377328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56580cd780 0x7f5658155320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f564400c560 tx=0x7f5644007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.753+0000 7f564be00640 1 -- 172.21.15.5:0/3573377328 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5644011590 con 0x7f56580cd780 2024-08-17T02:24:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.753+0000 7f564be00640 1 -- 172.21.15.5:0/3573377328 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5644011710 con 0x7f56580cd780 2024-08-17T02:24:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.753+0000 7f565e200640 1 -- 172.21.15.5:0/3573377328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5658169ad0 con 0x7f56580cd780 2024-08-17T02:24:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.753+0000 7f564be00640 1 -- 172.21.15.5:0/3573377328 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5644011ad0 con 0x7f56580cd780 2024-08-17T02:24:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.753+0000 7f565e200640 1 -- 172.21.15.5:0/3573377328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56580b2950 con 0x7f56580cd780 2024-08-17T02:24:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.754+0000 7f565e200640 1 -- 172.21.15.5:0/3573377328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56580b2b10 con 0x7f56580cd780 2024-08-17T02:24:28.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.755+0000 7f564be00640 1 -- 172.21.15.5:0/3573377328 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f564401b3b0 con 0x7f56580cd780 2024-08-17T02:24:28.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.756+0000 7f564be00640 1 --2- 172.21.15.5:0/3573377328 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5638065150 0x7f5638067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.756+0000 7f564be00640 1 -- 172.21.15.5:0/3573377328 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5644081740 con 0x7f56580cd780 2024-08-17T02:24:28.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.756+0000 7f565ce00640 1 --2- 172.21.15.5:0/3573377328 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5638065150 0x7f5638067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.757+0000 7f565ce00640 1 --2- 172.21.15.5:0/3573377328 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5638065150 0x7f5638067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f564c034000 tx=0x7f564c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:28.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.760+0000 7f564be00640 1 -- 172.21.15.5:0/3573377328 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f564404fab0 con 0x7f56580cd780 2024-08-17T02:24:28.824 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-08-17T02:24:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.945+0000 7f565e200640 1 -- 172.21.15.5:0/3573377328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5658169370 con 0x7f56580cd780 2024-08-17T02:24:28.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.945+0000 7f564be00640 1 -- 172.21.15.5:0/3573377328 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5658169370 con 0x7f56580cd780 2024-08-17T02:24:28.946 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:24:28.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.947+0000 7f565e200640 1 -- 172.21.15.5:0/3573377328 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5638065150 msgr2=0x7f5638067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.947+0000 7f565e200640 1 --2- 172.21.15.5:0/3573377328 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5638065150 0x7f5638067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f564c034000 tx=0x7f564c032000 comp rx=0 tx=0).stop 2024-08-17T02:24:28.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.947+0000 7f565e200640 1 -- 172.21.15.5:0/3573377328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56580cd780 msgr2=0x7f5658155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.947+0000 7f565e200640 1 --2- 172.21.15.5:0/3573377328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56580cd780 0x7f5658155320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f564400c560 tx=0x7f5644007ef0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.947+0000 7f565e200640 1 -- 172.21.15.5:0/3573377328 shutdown_connections 2024-08-17T02:24:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.947+0000 7f565e200640 1 --2- 172.21.15.5:0/3573377328 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5638065150 0x7f5638067600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.947+0000 7f565e200640 1 --2- 172.21.15.5:0/3573377328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f565815bbd0 0x7f5658155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.947+0000 7f565e200640 1 --2- 172.21.15.5:0/3573377328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56580cd780 0x7f5658155320 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.947+0000 7f565e200640 1 --2- 172.21.15.5:0/3573377328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56580cc7e0 0x7f56580c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.947+0000 7f565e200640 1 -- 172.21.15.5:0/3573377328 >> 172.21.15.5:0/3573377328 conn(0x7f5658087a80 msgr2=0x7f56580afba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.948+0000 7f565e200640 1 -- 172.21.15.5:0/3573377328 shutdown_connections 2024-08-17T02:24:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:28.948+0000 7f565e200640 1 -- 172.21.15.5:0/3573377328 wait complete. 2024-08-17T02:24:28.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:24:29.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.114+0000 7fcb86c00640 1 Processor -- start 2024-08-17T02:24:29.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.115+0000 7fcb86c00640 1 -- start start 2024-08-17T02:24:29.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.116+0000 7fcb86c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcb80158c60 0x7fcb8015a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.116+0000 7fcb86c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcb800b1920 0x7fcb800b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.116+0000 7fcb86c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8015b6b0 con 0x7fcb80159030 2024-08-17T02:24:29.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.116+0000 7fcb86c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb800b0540 con 0x7fcb80158c60 2024-08-17T02:24:29.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.116+0000 7fcb86c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8015aac0 con 0x7fcb800b1920 2024-08-17T02:24:29.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.116+0000 7fcb85800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcb80158c60 0x7fcb8015a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.116+0000 7fcb85800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcb80158c60 0x7fcb8015a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58026/0 (socket says 172.21.15.5:58026) 2024-08-17T02:24:29.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.116+0000 7fcb85800640 1 -- 172.21.15.5:0/90120781 learned_addr learned my addr 172.21.15.5:0/90120781 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:29.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.116+0000 7fcb86200640 1 --2- 172.21.15.5:0/90120781 >> v2:172.21.15.87:3300/0 conn(0x7fcb800b1920 0x7fcb800b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.116+0000 7fcb85800640 1 -- 172.21.15.5:0/90120781 >> v2:172.21.15.87:3300/0 conn(0x7fcb800b1920 msgr2=0x7fcb800b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:29.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.116+0000 7fcb85800640 1 --2- 172.21.15.5:0/90120781 >> v2:172.21.15.87:3300/0 conn(0x7fcb800b1920 0x7fcb800b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.116+0000 7fcb85800640 1 -- 172.21.15.5:0/90120781 >> v1:172.21.15.5:6789/0 conn(0x7fcb80159030 legacy=0x7fcb800ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.116+0000 7fcb85800640 1 -- 172.21.15.5:0/90120781 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8015ad80 con 0x7fcb80158c60 2024-08-17T02:24:29.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.118+0000 7fcb85800640 1 --2- 172.21.15.5:0/90120781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb80158c60 0x7fcb8015a490 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcb800c6b30 tx=0x7fcb740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c68672822f8f098 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.118+0000 7fcb7fe00640 1 -- 172.21.15.5:0/90120781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7402ae80 con 0x7fcb80158c60 2024-08-17T02:24:29.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.118+0000 7fcb7fe00640 1 -- 172.21.15.5:0/90120781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb74032440 con 0x7fcb80158c60 2024-08-17T02:24:29.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.118+0000 7fcb7fe00640 1 -- 172.21.15.5:0/90120781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb74032800 con 0x7fcb80158c60 2024-08-17T02:24:29.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.118+0000 7fcb86c00640 1 -- 172.21.15.5:0/90120781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb80158c60 msgr2=0x7fcb8015a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.118+0000 7fcb86c00640 1 --2- 172.21.15.5:0/90120781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb80158c60 0x7fcb8015a490 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcb800c6b30 tx=0x7fcb740091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.119+0000 7fcb86c00640 1 -- 172.21.15.5:0/90120781 shutdown_connections 2024-08-17T02:24:29.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.119+0000 7fcb86c00640 1 --2- 172.21.15.5:0/90120781 >> v2:172.21.15.87:3300/0 conn(0x7fcb800b1920 0x7fcb800b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.119+0000 7fcb86c00640 1 --2- 172.21.15.5:0/90120781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb80158c60 0x7fcb8015a490 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.119+0000 7fcb86c00640 1 -- 172.21.15.5:0/90120781 >> 172.21.15.5:0/90120781 conn(0x7fcb8006e590 msgr2=0x7fcb8006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.119+0000 7fcb86c00640 1 -- 172.21.15.5:0/90120781 shutdown_connections 2024-08-17T02:24:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.119+0000 7fcb86c00640 1 -- 172.21.15.5:0/90120781 wait complete. 2024-08-17T02:24:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.120+0000 7fcb86c00640 1 Processor -- start 2024-08-17T02:24:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.120+0000 7fcb86c00640 1 -- start start 2024-08-17T02:24:29.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.121+0000 7fcb86c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb800b1920 0x7fcb800c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.121+0000 7fcb86c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb80158c60 0x7fcb8015bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.121+0000 7fcb86c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb80159030 0x7fcb8015c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.121+0000 7fcb86c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8015c5c0 con 0x7fcb80159030 2024-08-17T02:24:29.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.121+0000 7fcb86c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb800c79d0 con 0x7fcb80158c60 2024-08-17T02:24:29.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.121+0000 7fcb86c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb800c7c80 con 0x7fcb800b1920 2024-08-17T02:24:29.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.121+0000 7fcb86200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb80159030 0x7fcb8015c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.121+0000 7fcb86200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb80159030 0x7fcb8015c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58034/0 (socket says 172.21.15.5:58034) 2024-08-17T02:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.121+0000 7fcb86200640 1 -- 172.21.15.5:0/4282146556 learned_addr learned my addr 172.21.15.5:0/4282146556 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.122+0000 7fcb85800640 1 --2- 172.21.15.5:0/4282146556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb800b1920 0x7fcb800c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.122+0000 7fcb84e00640 1 --2- 172.21.15.5:0/4282146556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb80158c60 0x7fcb8015bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.122+0000 7fcb86200640 1 -- 172.21.15.5:0/4282146556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb800b1920 msgr2=0x7fcb800c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.122+0000 7fcb86200640 1 --2- 172.21.15.5:0/4282146556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb800b1920 0x7fcb800c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.122+0000 7fcb86200640 1 -- 172.21.15.5:0/4282146556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb80158c60 msgr2=0x7fcb8015bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.122+0000 7fcb86200640 1 --2- 172.21.15.5:0/4282146556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb80158c60 0x7fcb8015bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.122+0000 7fcb86200640 1 -- 172.21.15.5:0/4282146556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb74009450 con 0x7fcb80159030 2024-08-17T02:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.122+0000 7fcb85800640 1 --2- 172.21.15.5:0/4282146556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb800b1920 0x7fcb800c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.122+0000 7fcb84e00640 1 --2- 172.21.15.5:0/4282146556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb80158c60 0x7fcb8015bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.122+0000 7fcb86200640 1 --2- 172.21.15.5:0/4282146556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb80159030 0x7fcb8015c080 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcb78009fa0 tx=0x7fcb78009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.122+0000 7fcb7cc00640 1 -- 172.21.15.5:0/4282146556 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7800ee60 con 0x7fcb80159030 2024-08-17T02:24:29.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.122+0000 7fcb7cc00640 1 -- 172.21.15.5:0/4282146556 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb78014420 con 0x7fcb80159030 2024-08-17T02:24:29.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.122+0000 7fcb7cc00640 1 -- 172.21.15.5:0/4282146556 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb780147e0 con 0x7fcb80159030 2024-08-17T02:24:29.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.122+0000 7fcb86c00640 1 -- 172.21.15.5:0/4282146556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb800c7f60 con 0x7fcb80159030 2024-08-17T02:24:29.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.122+0000 7fcb86c00640 1 -- 172.21.15.5:0/4282146556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb800c8800 con 0x7fcb80159030 2024-08-17T02:24:29.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.123+0000 7fcb86c00640 1 -- 172.21.15.5:0/4282146556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb800c8150 con 0x7fcb80159030 2024-08-17T02:24:29.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.124+0000 7fcb7cc00640 1 -- 172.21.15.5:0/4282146556 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcb78014b50 con 0x7fcb80159030 2024-08-17T02:24:29.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.125+0000 7fcb7cc00640 1 --2- 172.21.15.5:0/4282146556 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcb60065180 0x7fcb60067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.125+0000 7fcb7cc00640 1 -- 172.21.15.5:0/4282146556 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fcb780828f0 con 0x7fcb80159030 2024-08-17T02:24:29.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.125+0000 7fcb85800640 1 --2- 172.21.15.5:0/4282146556 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcb60065180 0x7fcb60067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.126+0000 7fcb85800640 1 --2- 172.21.15.5:0/4282146556 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcb60065180 0x7fcb60067630 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcb74034000 tx=0x7fcb74032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.129+0000 7fcb7cc00640 1 -- 172.21.15.5:0/4282146556 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcb78050d00 con 0x7fcb80159030 2024-08-17T02:24:29.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.317+0000 7fcb86c00640 1 -- 172.21.15.5:0/4282146556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcb800c8360 con 0x7fcb80159030 2024-08-17T02:24:29.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.317+0000 7fcb7cc00640 1 -- 172.21.15.5:0/4282146556 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7fcb78054320 con 0x7fcb80159030 2024-08-17T02:24:29.318 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:29.318 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-17T02:24:29.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:29.318 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-17T02:24:29.318 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-17T02:24:29.318 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:29.318 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-17T02:24:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.319+0000 7fcb86c00640 1 -- 172.21.15.5:0/4282146556 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcb60065180 msgr2=0x7fcb60067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.319+0000 7fcb86c00640 1 --2- 172.21.15.5:0/4282146556 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcb60065180 0x7fcb60067630 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcb74034000 tx=0x7fcb74032000 comp rx=0 tx=0).stop 2024-08-17T02:24:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.319+0000 7fcb86c00640 1 -- 172.21.15.5:0/4282146556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb80159030 msgr2=0x7fcb8015c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.319+0000 7fcb86c00640 1 --2- 172.21.15.5:0/4282146556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb80159030 0x7fcb8015c080 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcb78009fa0 tx=0x7fcb78009900 comp rx=0 tx=0).stop 2024-08-17T02:24:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.319+0000 7fcb86c00640 1 -- 172.21.15.5:0/4282146556 shutdown_connections 2024-08-17T02:24:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.319+0000 7fcb86c00640 1 --2- 172.21.15.5:0/4282146556 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcb60065180 0x7fcb60067630 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.319+0000 7fcb86c00640 1 --2- 172.21.15.5:0/4282146556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb80159030 0x7fcb8015c080 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.319+0000 7fcb86c00640 1 --2- 172.21.15.5:0/4282146556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb80158c60 0x7fcb8015bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.319+0000 7fcb86c00640 1 --2- 172.21.15.5:0/4282146556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb800b1920 0x7fcb800c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.319+0000 7fcb86c00640 1 -- 172.21.15.5:0/4282146556 >> 172.21.15.5:0/4282146556 conn(0x7fcb8006e590 msgr2=0x7fcb8006e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.320+0000 7fcb86c00640 1 -- 172.21.15.5:0/4282146556 shutdown_connections 2024-08-17T02:24:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.320+0000 7fcb86c00640 1 -- 172.21.15.5:0/4282146556 wait complete. 2024-08-17T02:24:29.335 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:24:29.335 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:24:29.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.488+0000 7f7137e00640 1 Processor -- start 2024-08-17T02:24:29.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.489+0000 7f7137e00640 1 -- start start 2024-08-17T02:24:29.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.490+0000 7f7137e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f71300ad020 0x7f7130159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.490+0000 7f7137e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71300afa00 0x7f71300afe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.490+0000 7f7137e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7130159ad0 con 0x7f71300ac000 2024-08-17T02:24:29.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.490+0000 7f7137e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71300b0340 con 0x7f71300afa00 2024-08-17T02:24:29.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.490+0000 7f7137e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71300ad590 con 0x7f71300ad020 2024-08-17T02:24:29.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.490+0000 7f7135e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71300afa00 0x7f71300afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.490+0000 7f7135e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71300afa00 0x7f71300afe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58050/0 (socket says 172.21.15.5:58050) 2024-08-17T02:24:29.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.490+0000 7f7135e00640 1 -- 172.21.15.5:0/1443347534 learned_addr learned my addr 172.21.15.5:0/1443347534 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:29.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.490+0000 7f7134a00640 1 --2- 172.21.15.5:0/1443347534 >> v2:172.21.15.87:3300/0 conn(0x7f71300ad020 0x7f7130159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.491+0000 7f7135e00640 1 -- 172.21.15.5:0/1443347534 >> v2:172.21.15.87:3300/0 conn(0x7f71300ad020 msgr2=0x7f7130159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:29.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.491+0000 7f7135e00640 1 --2- 172.21.15.5:0/1443347534 >> v2:172.21.15.87:3300/0 conn(0x7f71300ad020 0x7f7130159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.491+0000 7f7135e00640 1 -- 172.21.15.5:0/1443347534 >> v1:172.21.15.87:6789/0 conn(0x7f71300ac000 legacy=0x7f7130156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.491+0000 7f7135e00640 1 -- 172.21.15.5:0/1443347534 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71300ad870 con 0x7f71300afa00 2024-08-17T02:24:29.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.492+0000 7f7135e00640 1 --2- 172.21.15.5:0/1443347534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71300afa00 0x7f71300afe00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f713006b9b0 tx=0x7f7128009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acfc57a221cbf975 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.492+0000 7f712fe00640 1 -- 172.21.15.5:0/1443347534 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128031400 con 0x7f71300afa00 2024-08-17T02:24:29.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.492+0000 7f712fe00640 1 -- 172.21.15.5:0/1443347534 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712802d050 con 0x7f71300afa00 2024-08-17T02:24:29.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.492+0000 7f712fe00640 1 -- 172.21.15.5:0/1443347534 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71280317d0 con 0x7f71300afa00 2024-08-17T02:24:29.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.492+0000 7f7137e00640 1 -- 172.21.15.5:0/1443347534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71300afa00 msgr2=0x7f71300afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.492+0000 7f7137e00640 1 --2- 172.21.15.5:0/1443347534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71300afa00 0x7f71300afe00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f713006b9b0 tx=0x7f7128009840 comp rx=0 tx=0).stop 2024-08-17T02:24:29.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.493+0000 7f7137e00640 1 -- 172.21.15.5:0/1443347534 shutdown_connections 2024-08-17T02:24:29.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.493+0000 7f7137e00640 1 --2- 172.21.15.5:0/1443347534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71300afa00 0x7f71300afe00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.493+0000 7f7137e00640 1 --2- 172.21.15.5:0/1443347534 >> v2:172.21.15.87:3300/0 conn(0x7f71300ad020 0x7f7130159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.493+0000 7f7137e00640 1 -- 172.21.15.5:0/1443347534 >> 172.21.15.5:0/1443347534 conn(0x7f7130066e60 msgr2=0x7f7130067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:29.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.493+0000 7f7137e00640 1 -- 172.21.15.5:0/1443347534 shutdown_connections 2024-08-17T02:24:29.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.493+0000 7f7137e00640 1 -- 172.21.15.5:0/1443347534 wait complete. 2024-08-17T02:24:29.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.494+0000 7f7137e00640 1 Processor -- start 2024-08-17T02:24:29.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.494+0000 7f7137e00640 1 -- start start 2024-08-17T02:24:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.495+0000 7f7137e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71300ac000 0x7f713014c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.495+0000 7f7137e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71300ad020 0x7f71300aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.495+0000 7f7137e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71300afa00 0x7f71300aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.495+0000 7f7137e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713014ceb0 con 0x7f71300ac000 2024-08-17T02:24:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.495+0000 7f7137e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71300c12d0 con 0x7f71300ad020 2024-08-17T02:24:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.495+0000 7f7137e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71300c9d80 con 0x7f71300afa00 2024-08-17T02:24:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.495+0000 7f7135400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71300ac000 0x7f713014c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.495+0000 7f7135400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71300ac000 0x7f713014c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58052/0 (socket says 172.21.15.5:58052) 2024-08-17T02:24:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.495+0000 7f7135400640 1 -- 172.21.15.5:0/4056601269 learned_addr learned my addr 172.21.15.5:0/4056601269 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.495+0000 7f7135e00640 1 --2- 172.21.15.5:0/4056601269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71300afa00 0x7f71300aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.496+0000 7f7134a00640 1 --2- 172.21.15.5:0/4056601269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71300ad020 0x7f71300aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.496+0000 7f7135400640 1 -- 172.21.15.5:0/4056601269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71300afa00 msgr2=0x7f71300aadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.496+0000 7f7135400640 1 --2- 172.21.15.5:0/4056601269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71300afa00 0x7f71300aadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.496+0000 7f7135400640 1 -- 172.21.15.5:0/4056601269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71300ad020 msgr2=0x7f71300aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.496+0000 7f7135400640 1 --2- 172.21.15.5:0/4056601269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71300ad020 0x7f71300aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.496+0000 7f7135400640 1 -- 172.21.15.5:0/4056601269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7128009ae0 con 0x7f71300ac000 2024-08-17T02:24:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.496+0000 7f7135400640 1 --2- 172.21.15.5:0/4056601269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71300ac000 0x7f713014c970 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f712400c4c0 tx=0x7f7124007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.496+0000 7f712cc00640 1 -- 172.21.15.5:0/4056601269 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7124011590 con 0x7f71300ac000 2024-08-17T02:24:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.496+0000 7f712cc00640 1 -- 172.21.15.5:0/4056601269 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7124011710 con 0x7f71300ac000 2024-08-17T02:24:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.496+0000 7f712cc00640 1 -- 172.21.15.5:0/4056601269 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7124011ad0 con 0x7f71300ac000 2024-08-17T02:24:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.496+0000 7f7137e00640 1 -- 172.21.15.5:0/4056601269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71300c09a0 con 0x7f71300ac000 2024-08-17T02:24:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.497+0000 7f7137e00640 1 -- 172.21.15.5:0/4056601269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71300c0f60 con 0x7f71300ac000 2024-08-17T02:24:29.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.498+0000 7f7137e00640 1 -- 172.21.15.5:0/4056601269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7130063fb0 con 0x7f71300ac000 2024-08-17T02:24:29.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.498+0000 7f712cc00640 1 -- 172.21.15.5:0/4056601269 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f712401c440 con 0x7f71300ac000 2024-08-17T02:24:29.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.499+0000 7f712cc00640 1 --2- 172.21.15.5:0/4056601269 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7110065220 0x7f71100676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.499+0000 7f712cc00640 1 -- 172.21.15.5:0/4056601269 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7124081560 con 0x7f71300ac000 2024-08-17T02:24:29.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.500+0000 7f7134a00640 1 --2- 172.21.15.5:0/4056601269 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7110065220 0x7f71100676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.500+0000 7f7134a00640 1 --2- 172.21.15.5:0/4056601269 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7110065220 0x7f71100676d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f71300c29c0 tx=0x7f711c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.503+0000 7f712cc00640 1 -- 172.21.15.5:0/4056601269 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f712404fa00 con 0x7f71300ac000 2024-08-17T02:24:29.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:29.683+0000 7f7137e00640 1 -- 172.21.15.5:0/4056601269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7130067c10 con 0x7f71300ac000 2024-08-17T02:24:30.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.212+0000 7f712cc00640 1 -- 172.21.15.5:0/4056601269 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7124053020 con 0x7f71300ac000 2024-08-17T02:24:30.213 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-17T02:24:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.215+0000 7f7137e00640 1 -- 172.21.15.5:0/4056601269 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7110065220 msgr2=0x7f71100676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.215+0000 7f7137e00640 1 --2- 172.21.15.5:0/4056601269 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7110065220 0x7f71100676d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f71300c29c0 tx=0x7f711c008040 comp rx=0 tx=0).stop 2024-08-17T02:24:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.216+0000 7f7137e00640 1 -- 172.21.15.5:0/4056601269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71300ac000 msgr2=0x7f713014c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.216+0000 7f7137e00640 1 --2- 172.21.15.5:0/4056601269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71300ac000 0x7f713014c970 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f712400c4c0 tx=0x7f7124007ef0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.216+0000 7f7137e00640 1 -- 172.21.15.5:0/4056601269 shutdown_connections 2024-08-17T02:24:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.216+0000 7f7137e00640 1 --2- 172.21.15.5:0/4056601269 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7110065220 0x7f71100676d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.216+0000 7f7137e00640 1 --2- 172.21.15.5:0/4056601269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71300afa00 0x7f71300aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.216+0000 7f7137e00640 1 --2- 172.21.15.5:0/4056601269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71300ad020 0x7f71300aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.216+0000 7f7137e00640 1 --2- 172.21.15.5:0/4056601269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71300ac000 0x7f713014c970 secure :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f712400c4c0 tx=0x7f7124007ef0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.216+0000 7f7137e00640 1 -- 172.21.15.5:0/4056601269 >> 172.21.15.5:0/4056601269 conn(0x7f7130066e60 msgr2=0x7f71300ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.218+0000 7f7137e00640 1 -- 172.21.15.5:0/4056601269 shutdown_connections 2024-08-17T02:24:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.218+0000 7f7137e00640 1 -- 172.21.15.5:0/4056601269 wait complete. 2024-08-17T02:24:30.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:24:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.396+0000 7f7d6c000640 1 Processor -- start 2024-08-17T02:24:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.396+0000 7f7d6c000640 1 -- start start 2024-08-17T02:24:30.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.397+0000 7f7d6c000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7d640afca0 0x7f7d640b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:30.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.397+0000 7f7d6c000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d641590b0 0x7f7d64159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:30.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.397+0000 7f7d6c000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d6415a4e0 con 0x7f7d640acf10 2024-08-17T02:24:30.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.397+0000 7f7d6c000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d640b0980 con 0x7f7d640afca0 2024-08-17T02:24:30.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.397+0000 7f7d6c000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d640c92b0 con 0x7f7d641590b0 2024-08-17T02:24:30.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.398+0000 7f7d69600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7d640afca0 0x7f7d640b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:30.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.398+0000 7f7d69600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7d640afca0 0x7f7d640b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43866/0 (socket says 172.21.15.5:43866) 2024-08-17T02:24:30.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.398+0000 7f7d69600640 1 -- 172.21.15.5:0/2086389670 learned_addr learned my addr 172.21.15.5:0/2086389670 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:30.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.398+0000 7f7d6a000640 1 --2- 172.21.15.5:0/2086389670 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d641590b0 0x7f7d64159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:30.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.398+0000 7f7d69600640 1 -- 172.21.15.5:0/2086389670 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d641590b0 msgr2=0x7f7d64159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.398+0000 7f7d69600640 1 --2- 172.21.15.5:0/2086389670 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d641590b0 0x7f7d64159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.398+0000 7f7d69600640 1 -- 172.21.15.5:0/2086389670 >> v1:172.21.15.5:6789/0 conn(0x7f7d640acf10 legacy=0x7f7d641589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.398+0000 7f7d69600640 1 -- 172.21.15.5:0/2086389670 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d640ad480 con 0x7f7d640afca0 2024-08-17T02:24:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.399+0000 7f7d69600640 1 --2- 172.21.15.5:0/2086389670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d640afca0 0x7f7d640b0070 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009910 tx=0x7f7d580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39cb7b39d51c068 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.399+0000 7f7d63e00640 1 -- 172.21.15.5:0/2086389670 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5802ae40 con 0x7f7d640afca0 2024-08-17T02:24:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.399+0000 7f7d63e00640 1 -- 172.21.15.5:0/2086389670 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d58032440 con 0x7f7d640afca0 2024-08-17T02:24:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.399+0000 7f7d63e00640 1 -- 172.21.15.5:0/2086389670 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d58032820 con 0x7f7d640afca0 2024-08-17T02:24:30.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.400+0000 7f7d6c000640 1 -- 172.21.15.5:0/2086389670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d640afca0 msgr2=0x7f7d640b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:30.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.400+0000 7f7d6c000640 1 --2- 172.21.15.5:0/2086389670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d640afca0 0x7f7d640b0070 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009910 tx=0x7f7d580091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.400+0000 7f7d6c000640 1 -- 172.21.15.5:0/2086389670 shutdown_connections 2024-08-17T02:24:30.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.400+0000 7f7d6c000640 1 --2- 172.21.15.5:0/2086389670 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d641590b0 0x7f7d64159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.400+0000 7f7d6c000640 1 --2- 172.21.15.5:0/2086389670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d640afca0 0x7f7d640b0070 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.400+0000 7f7d6c000640 1 -- 172.21.15.5:0/2086389670 >> 172.21.15.5:0/2086389670 conn(0x7f7d64066e60 msgr2=0x7f7d64067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:30.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.400+0000 7f7d6c000640 1 -- 172.21.15.5:0/2086389670 shutdown_connections 2024-08-17T02:24:30.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.400+0000 7f7d6c000640 1 -- 172.21.15.5:0/2086389670 wait complete. 2024-08-17T02:24:30.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.401+0000 7f7d6c000640 1 Processor -- start 2024-08-17T02:24:30.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.402+0000 7f7d6c000640 1 -- start start 2024-08-17T02:24:30.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.402+0000 7f7d6c000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d640acf10 0x7f7d6415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:30.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.402+0000 7f7d6c000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d640afca0 0x7f7d64069830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:30.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.402+0000 7f7d6c000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d641590b0 0x7f7d64151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:30.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.402+0000 7f7d6c000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6406af70 con 0x7f7d640afca0 2024-08-17T02:24:30.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.402+0000 7f7d6c000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6415b450 con 0x7f7d641590b0 2024-08-17T02:24:30.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.402+0000 7f7d6c000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6406a2f0 con 0x7f7d640acf10 2024-08-17T02:24:30.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.403+0000 7f7d68c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d640afca0 0x7f7d64069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:30.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.403+0000 7f7d69600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d640acf10 0x7f7d6415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:30.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.403+0000 7f7d69600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d640acf10 0x7f7d6415a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:44576/0 (socket says 172.21.15.5:44576) 2024-08-17T02:24:30.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.403+0000 7f7d69600640 1 -- 172.21.15.5:0/1053682656 learned_addr learned my addr 172.21.15.5:0/1053682656 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:30.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.403+0000 7f7d6a000640 1 --2- 172.21.15.5:0/1053682656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d641590b0 0x7f7d64151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:30.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.403+0000 7f7d68c00640 1 -- 172.21.15.5:0/1053682656 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d640acf10 msgr2=0x7f7d6415a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:30.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.403+0000 7f7d68c00640 1 --2- 172.21.15.5:0/1053682656 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d640acf10 0x7f7d6415a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.403+0000 7f7d68c00640 1 -- 172.21.15.5:0/1053682656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d641590b0 msgr2=0x7f7d64151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:30.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.403+0000 7f7d68c00640 1 --2- 172.21.15.5:0/1053682656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d641590b0 0x7f7d64151a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.403+0000 7f7d68c00640 1 -- 172.21.15.5:0/1053682656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d58009450 con 0x7f7d640afca0 2024-08-17T02:24:30.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.403+0000 7f7d69600640 1 --2- 172.21.15.5:0/1053682656 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d640acf10 0x7f7d6415a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:30.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.404+0000 7f7d68c00640 1 --2- 172.21.15.5:0/1053682656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d640afca0 0x7f7d64069830 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000c4b0 tx=0x7f7d50007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:30.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.404+0000 7f7d60c00640 1 -- 172.21.15.5:0/1053682656 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d50011590 con 0x7f7d640afca0 2024-08-17T02:24:30.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.404+0000 7f7d60c00640 1 -- 172.21.15.5:0/1053682656 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d500116f0 con 0x7f7d640afca0 2024-08-17T02:24:30.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.404+0000 7f7d60c00640 1 -- 172.21.15.5:0/1053682656 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d50011ab0 con 0x7f7d640afca0 2024-08-17T02:24:30.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.404+0000 7f7d6c000640 1 -- 172.21.15.5:0/1053682656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6406a5d0 con 0x7f7d640afca0 2024-08-17T02:24:30.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.404+0000 7f7d6c000640 1 -- 172.21.15.5:0/1053682656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6406ab90 con 0x7f7d640afca0 2024-08-17T02:24:30.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.405+0000 7f7d6c000640 1 -- 172.21.15.5:0/1053682656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d6406b0b0 con 0x7f7d640afca0 2024-08-17T02:24:30.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.406+0000 7f7d60c00640 1 -- 172.21.15.5:0/1053682656 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7d5001b3b0 con 0x7f7d640afca0 2024-08-17T02:24:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.407+0000 7f7d60c00640 1 --2- 172.21.15.5:0/1053682656 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7d44065150 0x7f7d44067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.407+0000 7f7d60c00640 1 -- 172.21.15.5:0/1053682656 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f7d500817d0 con 0x7f7d640afca0 2024-08-17T02:24:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.407+0000 7f7d69600640 1 --2- 172.21.15.5:0/1053682656 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7d44065150 0x7f7d44067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.408+0000 7f7d69600640 1 --2- 172.21.15.5:0/1053682656 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7d44065150 0x7f7d44067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009910 tx=0x7f7d58032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:30.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.410+0000 7f7d60c00640 1 -- 172.21.15.5:0/1053682656 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7d5004fb00 con 0x7f7d640afca0 2024-08-17T02:24:30.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:30.596+0000 7f7d6c000640 1 -- 172.21.15.5:0/1053682656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7d6415a4e0 con 0x7f7d640afca0 2024-08-17T02:24:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.220+0000 7f7d60c00640 1 -- 172.21.15.5:0/1053682656 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7d6415a4e0 con 0x7f7d640afca0 2024-08-17T02:24:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-17T02:24:31.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.230+0000 7f7d6c000640 1 -- 172.21.15.5:0/1053682656 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7d44065150 msgr2=0x7f7d44067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.230+0000 7f7d6c000640 1 --2- 172.21.15.5:0/1053682656 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7d44065150 0x7f7d44067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009910 tx=0x7f7d58032000 comp rx=0 tx=0).stop 2024-08-17T02:24:31.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.230+0000 7f7d6c000640 1 -- 172.21.15.5:0/1053682656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d640afca0 msgr2=0x7f7d64069830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.230+0000 7f7d6c000640 1 --2- 172.21.15.5:0/1053682656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d640afca0 0x7f7d64069830 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000c4b0 tx=0x7f7d50007e30 comp rx=0 tx=0).stop 2024-08-17T02:24:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.231+0000 7f7d6c000640 1 -- 172.21.15.5:0/1053682656 shutdown_connections 2024-08-17T02:24:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.231+0000 7f7d6c000640 1 --2- 172.21.15.5:0/1053682656 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7d44065150 0x7f7d44067600 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.231+0000 7f7d6c000640 1 --2- 172.21.15.5:0/1053682656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d641590b0 0x7f7d64151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.231+0000 7f7d6c000640 1 --2- 172.21.15.5:0/1053682656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d640afca0 0x7f7d64069830 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.231+0000 7f7d6c000640 1 --2- 172.21.15.5:0/1053682656 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d640acf10 0x7f7d6415a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.231+0000 7f7d6c000640 1 -- 172.21.15.5:0/1053682656 >> 172.21.15.5:0/1053682656 conn(0x7f7d64066e60 msgr2=0x7f7d64149f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:31.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.232+0000 7f7d6c000640 1 -- 172.21.15.5:0/1053682656 shutdown_connections 2024-08-17T02:24:31.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.232+0000 7f7d6c000640 1 -- 172.21.15.5:0/1053682656 wait complete. 2024-08-17T02:24:31.260 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:24:31.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.416+0000 7f42c7200640 1 Processor -- start 2024-08-17T02:24:31.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.416+0000 7f42c7200640 1 -- start start 2024-08-17T02:24:31.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.418+0000 7f42c7200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42c8158a40 0x7f42c80abe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.418+0000 7f42c7200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f42c80af9b0 0x7f42c8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.418+0000 7f42c7200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c80686f0 con 0x7f42c80ac380 2024-08-17T02:24:31.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.418+0000 7f42c7200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c80ac7d0 con 0x7f42c80af9b0 2024-08-17T02:24:31.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.418+0000 7f42c7200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c80b0270 con 0x7f42c8158a40 2024-08-17T02:24:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.418+0000 7f42bfe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f42c80ac380 0x7f42c80af2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55670/0 (socket says 172.21.15.5:55670) 2024-08-17T02:24:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.418+0000 7f42bfe00640 1 -- 172.21.15.5:0/3211170356 learned_addr learned my addr 172.21.15.5:0/3211170356 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.418+0000 7f42c6800640 1 --2- 172.21.15.5:0/3211170356 >> v2:172.21.15.87:3300/0 conn(0x7f42c80af9b0 0x7f42c8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.418+0000 7f42c5e00640 1 --2- 172.21.15.5:0/3211170356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42c8158a40 0x7f42c80abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.418+0000 7f42c5400640 1 -- 172.21.15.5:0/3211170356 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757743982 0 0) 0x7f42c80686f0 con 0x7f42c80ac380 2024-08-17T02:24:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.419+0000 7f42c5400640 1 -- 172.21.15.5:0/3211170356 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42ac0034e0 con 0x7f42c80ac380 2024-08-17T02:24:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.419+0000 7f42c5e00640 1 -- 172.21.15.5:0/3211170356 >> v2:172.21.15.87:3300/0 conn(0x7f42c80af9b0 msgr2=0x7f42c8068b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.419+0000 7f42c5e00640 1 --2- 172.21.15.5:0/3211170356 >> v2:172.21.15.87:3300/0 conn(0x7f42c80af9b0 0x7f42c8068b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.419+0000 7f42c5e00640 1 -- 172.21.15.5:0/3211170356 >> v1:172.21.15.5:6789/0 conn(0x7f42c80ac380 legacy=0x7f42c80af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.419+0000 7f42c5400640 1 -- 172.21.15.5:0/3211170356 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3070129246 0 0) 0x7f42ac0034e0 con 0x7f42c80ac380 2024-08-17T02:24:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.419+0000 7f42c5e00640 1 -- 172.21.15.5:0/3211170356 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c80aff90 con 0x7f42c8158a40 2024-08-17T02:24:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.420+0000 7f42c5e00640 1 --2- 172.21.15.5:0/3211170356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42c8158a40 0x7f42c80abe40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009850 tx=0x7f42b80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5a1f7ed42b3af30 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.420+0000 7f42c5400640 1 -- 172.21.15.5:0/3211170356 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b802ad00 con 0x7f42c8158a40 2024-08-17T02:24:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.420+0000 7f42c5400640 1 -- 172.21.15.5:0/3211170356 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b802ae60 con 0x7f42c8158a40 2024-08-17T02:24:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.420+0000 7f42c5400640 1 -- 172.21.15.5:0/3211170356 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8032670 con 0x7f42c8158a40 2024-08-17T02:24:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.421+0000 7f42c7200640 1 -- 172.21.15.5:0/3211170356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42c8158a40 msgr2=0x7f42c80abe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.421+0000 7f42c7200640 1 --2- 172.21.15.5:0/3211170356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42c8158a40 0x7f42c80abe40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009850 tx=0x7f42b80090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.421+0000 7f42c7200640 1 -- 172.21.15.5:0/3211170356 shutdown_connections 2024-08-17T02:24:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.421+0000 7f42c7200640 1 --2- 172.21.15.5:0/3211170356 >> v2:172.21.15.87:3300/0 conn(0x7f42c80af9b0 0x7f42c8068b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.421+0000 7f42c7200640 1 --2- 172.21.15.5:0/3211170356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42c8158a40 0x7f42c80abe40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.421+0000 7f42c7200640 1 -- 172.21.15.5:0/3211170356 >> 172.21.15.5:0/3211170356 conn(0x7f42c80ce400 msgr2=0x7f42c8095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.421+0000 7f42c7200640 1 -- 172.21.15.5:0/3211170356 shutdown_connections 2024-08-17T02:24:31.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.421+0000 7f42c7200640 1 -- 172.21.15.5:0/3211170356 wait complete. 2024-08-17T02:24:31.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.422+0000 7f42c7200640 1 Processor -- start 2024-08-17T02:24:31.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.423+0000 7f42c7200640 1 -- start start 2024-08-17T02:24:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.423+0000 7f42c7200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42c80ac380 0x7f42c80b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.423+0000 7f42c7200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c80af9b0 0x7f42c815b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.424+0000 7f42c7200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42c8158a40 0x7f42c814e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.424+0000 7f42c7200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c8150380 con 0x7f42c80af9b0 2024-08-17T02:24:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.424+0000 7f42c7200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c815b660 con 0x7f42c80ac380 2024-08-17T02:24:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.424+0000 7f42c7200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c815b900 con 0x7f42c8158a40 2024-08-17T02:24:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.424+0000 7f42bfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c80af9b0 0x7f42c815b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.424+0000 7f42bfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c80af9b0 0x7f42c815b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43888/0 (socket says 172.21.15.5:43888) 2024-08-17T02:24:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.424+0000 7f42bfe00640 1 -- 172.21.15.5:0/4106990175 learned_addr learned my addr 172.21.15.5:0/4106990175 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.424+0000 7f42c5e00640 1 --2- 172.21.15.5:0/4106990175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42c80ac380 0x7f42c80b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.424+0000 7f42c6800640 1 --2- 172.21.15.5:0/4106990175 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42c8158a40 0x7f42c814e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.424+0000 7f42bfe00640 1 -- 172.21.15.5:0/4106990175 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42c8158a40 msgr2=0x7f42c814e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.424+0000 7f42bfe00640 1 --2- 172.21.15.5:0/4106990175 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42c8158a40 0x7f42c814e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.424+0000 7f42bfe00640 1 -- 172.21.15.5:0/4106990175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42c80ac380 msgr2=0x7f42c80b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.424+0000 7f42bfe00640 1 --2- 172.21.15.5:0/4106990175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42c80ac380 0x7f42c80b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.424+0000 7f42bfe00640 1 -- 172.21.15.5:0/4106990175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b8009390 con 0x7f42c80af9b0 2024-08-17T02:24:31.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.425+0000 7f42bfe00640 1 --2- 172.21.15.5:0/4106990175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c80af9b0 0x7f42c815b120 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f42b0007fd0 tx=0x7f42b0007ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:31.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.425+0000 7f42bd600640 1 -- 172.21.15.5:0/4106990175 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b0007360 con 0x7f42c80af9b0 2024-08-17T02:24:31.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.425+0000 7f42bd600640 1 -- 172.21.15.5:0/4106990175 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b00074c0 con 0x7f42c80af9b0 2024-08-17T02:24:31.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.425+0000 7f42bd600640 1 -- 172.21.15.5:0/4106990175 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b00049d0 con 0x7f42c80af9b0 2024-08-17T02:24:31.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.425+0000 7f42c7200640 1 -- 172.21.15.5:0/4106990175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c815bbe0 con 0x7f42c80af9b0 2024-08-17T02:24:31.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.425+0000 7f42c7200640 1 -- 172.21.15.5:0/4106990175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c815c1a0 con 0x7f42c80af9b0 2024-08-17T02:24:31.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.426+0000 7f42c7200640 1 -- 172.21.15.5:0/4106990175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c81504f0 con 0x7f42c80af9b0 2024-08-17T02:24:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.427+0000 7f42bd600640 1 -- 172.21.15.5:0/4106990175 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f42b001c3b0 con 0x7f42c80af9b0 2024-08-17T02:24:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.428+0000 7f42bd600640 1 --2- 172.21.15.5:0/4106990175 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f42a4065150 0x7f42a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.428+0000 7f42bd600640 1 -- 172.21.15.5:0/4106990175 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f42b0081a10 con 0x7f42c80af9b0 2024-08-17T02:24:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.428+0000 7f42c5e00640 1 --2- 172.21.15.5:0/4106990175 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f42a4065150 0x7f42a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.429+0000 7f42c5e00640 1 --2- 172.21.15.5:0/4106990175 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f42a4065150 0x7f42a4067600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42b8034000 tx=0x7f42b8032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.432+0000 7f42bd600640 1 -- 172.21.15.5:0/4106990175 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f42b004fb10 con 0x7f42c80af9b0 2024-08-17T02:24:31.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:31.650+0000 7f42c7200640 1 -- 172.21.15.5:0/4106990175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f42c8070720 con 0x7f42c80af9b0 2024-08-17T02:24:32.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.224+0000 7f42bd600640 1 -- 172.21.15.5:0/4106990175 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f42b0018020 con 0x7f42c80af9b0 2024-08-17T02:24:32.225 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:24:32.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.232+0000 7f42c7200640 1 -- 172.21.15.5:0/4106990175 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f42a4065150 msgr2=0x7f42a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.232+0000 7f42c7200640 1 --2- 172.21.15.5:0/4106990175 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f42a4065150 0x7f42a4067600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42b8034000 tx=0x7f42b8032000 comp rx=0 tx=0).stop 2024-08-17T02:24:32.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.232+0000 7f42c7200640 1 -- 172.21.15.5:0/4106990175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c80af9b0 msgr2=0x7f42c815b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.232+0000 7f42c7200640 1 --2- 172.21.15.5:0/4106990175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c80af9b0 0x7f42c815b120 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f42b0007fd0 tx=0x7f42b0007ae0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.237+0000 7f42c7200640 1 -- 172.21.15.5:0/4106990175 shutdown_connections 2024-08-17T02:24:32.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.237+0000 7f42c7200640 1 --2- 172.21.15.5:0/4106990175 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f42a4065150 0x7f42a4067600 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.237+0000 7f42c7200640 1 --2- 172.21.15.5:0/4106990175 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42c8158a40 0x7f42c814e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.237+0000 7f42c7200640 1 --2- 172.21.15.5:0/4106990175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c80af9b0 0x7f42c815b120 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.237+0000 7f42c7200640 1 --2- 172.21.15.5:0/4106990175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42c80ac380 0x7f42c80b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.237+0000 7f42c7200640 1 -- 172.21.15.5:0/4106990175 >> 172.21.15.5:0/4106990175 conn(0x7f42c80ce400 msgr2=0x7f42c806c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:32.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.239+0000 7f42c7200640 1 -- 172.21.15.5:0/4106990175 shutdown_connections 2024-08-17T02:24:32.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.239+0000 7f42c7200640 1 -- 172.21.15.5:0/4106990175 wait complete. 2024-08-17T02:24:32.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:32.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.427+0000 7f149d400640 1 Processor -- start 2024-08-17T02:24:32.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.427+0000 7f149d400640 1 -- start start 2024-08-17T02:24:32.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.428+0000 7f149d400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14980ad960 0x7f149815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.428+0000 7f149d400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14980ca050 0x7f1498156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.428+0000 7f149d400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f14980add30 0x7f1498156960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.428+0000 7f149d400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149815b5e0 con 0x7f14980ad960 2024-08-17T02:24:32.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.428+0000 7f149d400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14980cb160 con 0x7f14980add30 2024-08-17T02:24:32.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.428+0000 7f149d400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14980b0d10 con 0x7f14980ca050 2024-08-17T02:24:32.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.428+0000 7f1496800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14980ad960 0x7f149815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.429+0000 7f1496800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14980ad960 0x7f149815b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43892/0 (socket says 172.21.15.5:43892) 2024-08-17T02:24:32.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.429+0000 7f1496800640 1 -- 172.21.15.5:0/2962155726 learned_addr learned my addr 172.21.15.5:0/2962155726 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:32.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.429+0000 7f1495e00640 1 --2- 172.21.15.5:0/2962155726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14980ca050 0x7f1498156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.429+0000 7f1497200640 1 --2- 172.21.15.5:0/2962155726 >> v2:172.21.15.87:3300/0 conn(0x7f14980add30 0x7f1498156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.429+0000 7f1496800640 1 -- 172.21.15.5:0/2962155726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14980ca050 msgr2=0x7f1498156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:32.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.429+0000 7f1496800640 1 --2- 172.21.15.5:0/2962155726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14980ca050 0x7f1498156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.429+0000 7f1496800640 1 -- 172.21.15.5:0/2962155726 >> v2:172.21.15.87:3300/0 conn(0x7f14980add30 msgr2=0x7f1498156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:32.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.429+0000 7f1496800640 1 --2- 172.21.15.5:0/2962155726 >> v2:172.21.15.87:3300/0 conn(0x7f14980add30 0x7f1498156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.429+0000 7f1496800640 1 -- 172.21.15.5:0/2962155726 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14980ca550 con 0x7f14980ad960 2024-08-17T02:24:32.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.429+0000 7f1497200640 1 --2- 172.21.15.5:0/2962155726 >> v2:172.21.15.87:3300/0 conn(0x7f14980add30 0x7f1498156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:32.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.430+0000 7f1496800640 1 --2- 172.21.15.5:0/2962155726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14980ad960 0x7f149815b0a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f149806eda0 tx=0x7f14880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b70a838b4a74048 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:32.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.430+0000 7f1495400640 1 -- 172.21.15.5:0/2962155726 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148802ae60 con 0x7f14980ad960 2024-08-17T02:24:32.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.430+0000 7f1495400640 1 -- 172.21.15.5:0/2962155726 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1488032440 con 0x7f14980ad960 2024-08-17T02:24:32.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.430+0000 7f1495400640 1 -- 172.21.15.5:0/2962155726 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14880327e0 con 0x7f14980ad960 2024-08-17T02:24:32.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.431+0000 7f149d400640 1 -- 172.21.15.5:0/2962155726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14980ad960 msgr2=0x7f149815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.431+0000 7f149d400640 1 --2- 172.21.15.5:0/2962155726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14980ad960 0x7f149815b0a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f149806eda0 tx=0x7f14880091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.431+0000 7f149d400640 1 -- 172.21.15.5:0/2962155726 shutdown_connections 2024-08-17T02:24:32.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.431+0000 7f149d400640 1 --2- 172.21.15.5:0/2962155726 >> v2:172.21.15.87:3300/0 conn(0x7f14980add30 0x7f1498156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.431+0000 7f149d400640 1 --2- 172.21.15.5:0/2962155726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14980ca050 0x7f1498156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.431+0000 7f149d400640 1 --2- 172.21.15.5:0/2962155726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14980ad960 0x7f149815b0a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.431+0000 7f149d400640 1 -- 172.21.15.5:0/2962155726 >> 172.21.15.5:0/2962155726 conn(0x7f1498066e60 msgr2=0x7f1498067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:32.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.431+0000 7f149d400640 1 -- 172.21.15.5:0/2962155726 shutdown_connections 2024-08-17T02:24:32.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.431+0000 7f149d400640 1 -- 172.21.15.5:0/2962155726 wait complete. 2024-08-17T02:24:32.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.432+0000 7f149d400640 1 Processor -- start 2024-08-17T02:24:32.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.433+0000 7f149d400640 1 -- start start 2024-08-17T02:24:32.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.433+0000 7f149d400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14980ad960 0x7f1498157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.433+0000 7f149d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14980add30 0x7f1498150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.433+0000 7f149d400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14980ca050 0x7f1498151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.433+0000 7f149d400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1498158aa0 con 0x7f14980add30 2024-08-17T02:24:32.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.433+0000 7f149d400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14980a4e80 con 0x7f14980ca050 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.433+0000 7f149d400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14980a50f0 con 0x7f14980ad960 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.434+0000 7f1495e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14980add30 0x7f1498150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.434+0000 7f1495e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14980add30 0x7f1498150780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43894/0 (socket says 172.21.15.5:43894) 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.434+0000 7f1495e00640 1 -- 172.21.15.5:0/3994585896 learned_addr learned my addr 172.21.15.5:0/3994585896 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.434+0000 7f1496800640 1 --2- 172.21.15.5:0/3994585896 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14980ad960 0x7f1498157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.434+0000 7f1497200640 1 --2- 172.21.15.5:0/3994585896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14980ca050 0x7f1498151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.434+0000 7f1495e00640 1 -- 172.21.15.5:0/3994585896 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14980ad960 msgr2=0x7f1498157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.434+0000 7f1495e00640 1 --2- 172.21.15.5:0/3994585896 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14980ad960 0x7f1498157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.434+0000 7f1495e00640 1 -- 172.21.15.5:0/3994585896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14980ca050 msgr2=0x7f1498151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.434+0000 7f1495e00640 1 --2- 172.21.15.5:0/3994585896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14980ca050 0x7f1498151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.434+0000 7f1495e00640 1 -- 172.21.15.5:0/3994585896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1488009450 con 0x7f14980add30 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.434+0000 7f1495e00640 1 --2- 172.21.15.5:0/3994585896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14980add30 0x7f1498150780 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f148400ea20 tx=0x7f14840090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.435+0000 7f148e000640 1 -- 172.21.15.5:0/3994585896 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148400ca10 con 0x7f14980add30 2024-08-17T02:24:32.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.435+0000 7f148e000640 1 -- 172.21.15.5:0/3994585896 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148400cb70 con 0x7f14980add30 2024-08-17T02:24:32.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.435+0000 7f148e000640 1 -- 172.21.15.5:0/3994585896 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484013470 con 0x7f14980add30 2024-08-17T02:24:32.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.435+0000 7f149d400640 1 -- 172.21.15.5:0/3994585896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14980a53d0 con 0x7f14980add30 2024-08-17T02:24:32.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.435+0000 7f149d400640 1 -- 172.21.15.5:0/3994585896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14981517a0 con 0x7f14980add30 2024-08-17T02:24:32.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.436+0000 7f149d400640 1 -- 172.21.15.5:0/3994585896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1498158c50 con 0x7f14980add30 2024-08-17T02:24:32.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.437+0000 7f148e000640 1 -- 172.21.15.5:0/3994585896 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1484013860 con 0x7f14980add30 2024-08-17T02:24:32.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.438+0000 7f148e000640 1 --2- 172.21.15.5:0/3994585896 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14780652a0 0x7f1478067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.438+0000 7f148e000640 1 -- 172.21.15.5:0/3994585896 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1484082720 con 0x7f14980add30 2024-08-17T02:24:32.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.438+0000 7f1496800640 1 --2- 172.21.15.5:0/3994585896 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14780652a0 0x7f1478067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.439+0000 7f1496800640 1 --2- 172.21.15.5:0/3994585896 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14780652a0 0x7f1478067750 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1488034000 tx=0x7f1488032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:32.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.442+0000 7f148e000640 1 -- 172.21.15.5:0/3994585896 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1498158c50 con 0x7f14980add30 2024-08-17T02:24:32.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.627+0000 7f149d400640 1 -- 172.21.15.5:0/3994585896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1498158c50 con 0x7f14980add30 2024-08-17T02:24:32.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.628+0000 7f148e000640 1 -- 172.21.15.5:0/3994585896 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15267 (secure 0 0 0) 0x7f1498158c50 con 0x7f14980add30 2024-08-17T02:24:32.629 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:32.629 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":33,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:24:31.652134+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:29.724167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:30.637206+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:32.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.630+0000 7f149d400640 1 -- 172.21.15.5:0/3994585896 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14780652a0 msgr2=0x7f1478067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.630+0000 7f149d400640 1 --2- 172.21.15.5:0/3994585896 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14780652a0 0x7f1478067750 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1488034000 tx=0x7f1488032000 comp rx=0 tx=0).stop 2024-08-17T02:24:32.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.630+0000 7f149d400640 1 -- 172.21.15.5:0/3994585896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14980add30 msgr2=0x7f1498150780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.630+0000 7f149d400640 1 --2- 172.21.15.5:0/3994585896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14980add30 0x7f1498150780 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f148400ea20 tx=0x7f14840090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.631+0000 7f149d400640 1 -- 172.21.15.5:0/3994585896 shutdown_connections 2024-08-17T02:24:32.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.631+0000 7f149d400640 1 --2- 172.21.15.5:0/3994585896 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14780652a0 0x7f1478067750 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.631+0000 7f149d400640 1 --2- 172.21.15.5:0/3994585896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14980ca050 0x7f1498151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.631+0000 7f149d400640 1 --2- 172.21.15.5:0/3994585896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14980add30 0x7f1498150780 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.631+0000 7f149d400640 1 --2- 172.21.15.5:0/3994585896 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14980ad960 0x7f1498157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.631+0000 7f149d400640 1 -- 172.21.15.5:0/3994585896 >> 172.21.15.5:0/3994585896 conn(0x7f1498066e60 msgr2=0x7f1498069830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:32.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.631+0000 7f149d400640 1 -- 172.21.15.5:0/3994585896 shutdown_connections 2024-08-17T02:24:32.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.631+0000 7f149d400640 1 -- 172.21.15.5:0/3994585896 wait complete. 2024-08-17T02:24:32.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:32.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.797+0000 7f57d5800640 1 Processor -- start 2024-08-17T02:24:32.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.797+0000 7f57d5800640 1 -- start start 2024-08-17T02:24:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.798+0000 7f57d5800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f57d00afca0 0x7f57d00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.798+0000 7f57d5800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57d00acf10 0x7f57d0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.798+0000 7f57d5800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d015a4e0 con 0x7f57d01589a0 2024-08-17T02:24:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.798+0000 7f57d5800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d00b0980 con 0x7f57d00afca0 2024-08-17T02:24:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.798+0000 7f57d5800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d00c92b0 con 0x7f57d00acf10 2024-08-17T02:24:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.799+0000 7f57cf400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f57d01589a0 0x7f57d006d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55686/0 (socket says 172.21.15.5:55686) 2024-08-17T02:24:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.799+0000 7f57cf400640 1 -- 172.21.15.5:0/30741313 learned_addr learned my addr 172.21.15.5:0/30741313 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.799+0000 7f57ce000640 1 --2- 172.21.15.5:0/30741313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57d00acf10 0x7f57d0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.799+0000 7f57cea00640 1 --2- 172.21.15.5:0/30741313 >> v2:172.21.15.87:3300/0 conn(0x7f57d00afca0 0x7f57d00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.799+0000 7f57ce000640 1 -- 172.21.15.5:0/30741313 >> v2:172.21.15.87:3300/0 conn(0x7f57d00afca0 msgr2=0x7f57d00b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:32.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.799+0000 7f57ce000640 1 --2- 172.21.15.5:0/30741313 >> v2:172.21.15.87:3300/0 conn(0x7f57d00afca0 0x7f57d00b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.799+0000 7f57ce000640 1 -- 172.21.15.5:0/30741313 >> v1:172.21.15.5:6789/0 conn(0x7f57d01589a0 legacy=0x7f57d006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.799+0000 7f57ce000640 1 -- 172.21.15.5:0/30741313 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d00ad480 con 0x7f57d00acf10 2024-08-17T02:24:32.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.799+0000 7f57cd600640 1 -- 172.21.15.5:0/30741313 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437457396 0 0) 0x7f57c8001490 con 0x7f57d01589a0 2024-08-17T02:24:32.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.800+0000 7f57ce000640 1 --2- 172.21.15.5:0/30741313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57d00acf10 0x7f57d0159fa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f57bc009880 tx=0x7f57bc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=796f98de357dd0a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.801+0000 7f57cd600640 1 -- 172.21.15.5:0/30741313 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc02ad90 con 0x7f57d00acf10 2024-08-17T02:24:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.801+0000 7f57cd600640 1 -- 172.21.15.5:0/30741313 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc032440 con 0x7f57d00acf10 2024-08-17T02:24:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.801+0000 7f57cd600640 1 -- 172.21.15.5:0/30741313 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc0327e0 con 0x7f57d00acf10 2024-08-17T02:24:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.801+0000 7f57d5800640 1 -- 172.21.15.5:0/30741313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57d00acf10 msgr2=0x7f57d0159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.801+0000 7f57d5800640 1 --2- 172.21.15.5:0/30741313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57d00acf10 0x7f57d0159fa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f57bc009880 tx=0x7f57bc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.801+0000 7f57d5800640 1 -- 172.21.15.5:0/30741313 shutdown_connections 2024-08-17T02:24:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.801+0000 7f57d5800640 1 --2- 172.21.15.5:0/30741313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57d00acf10 0x7f57d0159fa0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.801+0000 7f57d5800640 1 --2- 172.21.15.5:0/30741313 >> v2:172.21.15.87:3300/0 conn(0x7f57d00afca0 0x7f57d00b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.801+0000 7f57d5800640 1 -- 172.21.15.5:0/30741313 >> 172.21.15.5:0/30741313 conn(0x7f57d0066e60 msgr2=0x7f57d0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:32.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.801+0000 7f57d5800640 1 -- 172.21.15.5:0/30741313 shutdown_connections 2024-08-17T02:24:32.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.801+0000 7f57d5800640 1 -- 172.21.15.5:0/30741313 wait complete. 2024-08-17T02:24:32.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.803+0000 7f57d5800640 1 Processor -- start 2024-08-17T02:24:32.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.803+0000 7f57d5800640 1 -- start start 2024-08-17T02:24:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.804+0000 7f57d5800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d00acf10 0x7f57d0144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.804+0000 7f57d5800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57d00afca0 0x7f57d0149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.804+0000 7f57d5800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d01589a0 0x7f57d014a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.804+0000 7f57d5800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d0144ed0 con 0x7f57d01589a0 2024-08-17T02:24:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.804+0000 7f57d5800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d01451b0 con 0x7f57d00acf10 2024-08-17T02:24:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.804+0000 7f57d5800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d0145490 con 0x7f57d00afca0 2024-08-17T02:24:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.804+0000 7f57cf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d01589a0 0x7f57d014a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.804+0000 7f57cf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d01589a0 0x7f57d014a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43904/0 (socket says 172.21.15.5:43904) 2024-08-17T02:24:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.804+0000 7f57cf400640 1 -- 172.21.15.5:0/2583106558 learned_addr learned my addr 172.21.15.5:0/2583106558 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.804+0000 7f57ce000640 1 --2- 172.21.15.5:0/2583106558 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57d00afca0 0x7f57d0149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.804+0000 7f57cea00640 1 --2- 172.21.15.5:0/2583106558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d00acf10 0x7f57d0144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.804+0000 7f57cf400640 1 -- 172.21.15.5:0/2583106558 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57d00afca0 msgr2=0x7f57d0149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.804+0000 7f57cf400640 1 --2- 172.21.15.5:0/2583106558 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57d00afca0 0x7f57d0149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.804+0000 7f57cf400640 1 -- 172.21.15.5:0/2583106558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d00acf10 msgr2=0x7f57d0144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.804+0000 7f57cf400640 1 --2- 172.21.15.5:0/2583106558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d00acf10 0x7f57d0144810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.804+0000 7f57cf400640 1 -- 172.21.15.5:0/2583106558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57bc009390 con 0x7f57d01589a0 2024-08-17T02:24:32.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.805+0000 7f57cf400640 1 --2- 172.21.15.5:0/2583106558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d01589a0 0x7f57d014a4e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f57c800cc10 tx=0x7f57c8001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:32.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.805+0000 7f57c6000640 1 -- 172.21.15.5:0/2583106558 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c800ce30 con 0x7f57d01589a0 2024-08-17T02:24:32.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.805+0000 7f57c6000640 1 -- 172.21.15.5:0/2583106558 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c800a7f0 con 0x7f57d01589a0 2024-08-17T02:24:32.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.805+0000 7f57c6000640 1 -- 172.21.15.5:0/2583106558 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c800abf0 con 0x7f57d01589a0 2024-08-17T02:24:32.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.805+0000 7f57d5800640 1 -- 172.21.15.5:0/2583106558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d0145770 con 0x7f57d01589a0 2024-08-17T02:24:32.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.805+0000 7f57d5800640 1 -- 172.21.15.5:0/2583106558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d012f990 con 0x7f57d01589a0 2024-08-17T02:24:32.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.806+0000 7f57d5800640 1 -- 172.21.15.5:0/2583106558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d00b0530 con 0x7f57d01589a0 2024-08-17T02:24:32.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.807+0000 7f57c6000640 1 -- 172.21.15.5:0/2583106558 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f57c800ad50 con 0x7f57d01589a0 2024-08-17T02:24:32.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.808+0000 7f57c6000640 1 --2- 172.21.15.5:0/2583106558 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f57b0065150 0x7f57b0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.808+0000 7f57c6000640 1 -- 172.21.15.5:0/2583106558 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f57c8082350 con 0x7f57d01589a0 2024-08-17T02:24:32.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.808+0000 7f57cea00640 1 --2- 172.21.15.5:0/2583106558 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f57b0065150 0x7f57b0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.809+0000 7f57cea00640 1 --2- 172.21.15.5:0/2583106558 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f57b0065150 0x7f57b0067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f57c0009d20 tx=0x7f57c00090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.812+0000 7f57c6000640 1 -- 172.21.15.5:0/2583106558 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f57d00b0530 con 0x7f57d01589a0 2024-08-17T02:24:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.998+0000 7f57d5800640 1 -- 172.21.15.5:0/2583106558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57d00b0530 con 0x7f57d01589a0 2024-08-17T02:24:32.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:32.999+0000 7f57c6000640 1 -- 172.21.15.5:0/2583106558 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15267 (secure 0 0 0) 0x7f57d00b0530 con 0x7f57d01589a0 2024-08-17T02:24:32.999 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:33.000 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":33,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:24:31.652134+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:29.724167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:30.637206+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:33.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.001+0000 7f57d5800640 1 -- 172.21.15.5:0/2583106558 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f57b0065150 msgr2=0x7f57b0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.001+0000 7f57d5800640 1 --2- 172.21.15.5:0/2583106558 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f57b0065150 0x7f57b0067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f57c0009d20 tx=0x7f57c00090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.001+0000 7f57d5800640 1 -- 172.21.15.5:0/2583106558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d01589a0 msgr2=0x7f57d014a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.001+0000 7f57d5800640 1 --2- 172.21.15.5:0/2583106558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d01589a0 0x7f57d014a4e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f57c800cc10 tx=0x7f57c8001970 comp rx=0 tx=0).stop 2024-08-17T02:24:33.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.001+0000 7f57d5800640 1 -- 172.21.15.5:0/2583106558 shutdown_connections 2024-08-17T02:24:33.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.001+0000 7f57d5800640 1 --2- 172.21.15.5:0/2583106558 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f57b0065150 0x7f57b0067600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.001+0000 7f57d5800640 1 --2- 172.21.15.5:0/2583106558 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57d00afca0 0x7f57d0149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.001+0000 7f57d5800640 1 --2- 172.21.15.5:0/2583106558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d01589a0 0x7f57d014a4e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.001+0000 7f57d5800640 1 --2- 172.21.15.5:0/2583106558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d00acf10 0x7f57d0144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.001+0000 7f57d5800640 1 -- 172.21.15.5:0/2583106558 >> 172.21.15.5:0/2583106558 conn(0x7f57d0066e60 msgr2=0x7f57d014dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:33.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.001+0000 7f57d5800640 1 -- 172.21.15.5:0/2583106558 shutdown_connections 2024-08-17T02:24:33.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.001+0000 7f57d5800640 1 -- 172.21.15.5:0/2583106558 wait complete. 2024-08-17T02:24:33.018 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:24:33.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.171+0000 7fd642200640 1 Processor -- start 2024-08-17T02:24:33.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.171+0000 7fd642200640 1 -- start start 2024-08-17T02:24:33.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.172+0000 7fd642200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd63c0ca050 0x7fd63c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.172+0000 7fd642200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd63c0add30 0x7fd63c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.172+0000 7fd642200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63c15b5e0 con 0x7fd63c0ad960 2024-08-17T02:24:33.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.172+0000 7fd642200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63c0cb160 con 0x7fd63c0ca050 2024-08-17T02:24:33.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.172+0000 7fd642200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63c0b0d10 con 0x7fd63c0add30 2024-08-17T02:24:33.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.173+0000 7fd633e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd63c0ca050 0x7fd63c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.173+0000 7fd633e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd63c0ca050 0x7fd63c156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43918/0 (socket says 172.21.15.5:43918) 2024-08-17T02:24:33.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.173+0000 7fd633e00640 1 -- 172.21.15.5:0/1557776552 learned_addr learned my addr 172.21.15.5:0/1557776552 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:33.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.173+0000 7fd63be00640 1 --2- 172.21.15.5:0/1557776552 >> v2:172.21.15.87:3300/0 conn(0x7fd63c0add30 0x7fd63c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.173+0000 7fd633e00640 1 -- 172.21.15.5:0/1557776552 >> v2:172.21.15.87:3300/0 conn(0x7fd63c0add30 msgr2=0x7fd63c15b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:33.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.173+0000 7fd633e00640 1 --2- 172.21.15.5:0/1557776552 >> v2:172.21.15.87:3300/0 conn(0x7fd63c0add30 0x7fd63c15b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.173+0000 7fd633e00640 1 -- 172.21.15.5:0/1557776552 >> v1:172.21.15.87:6789/0 conn(0x7fd63c0ad960 legacy=0x7fd63c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.173+0000 7fd633e00640 1 -- 172.21.15.5:0/1557776552 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c0ca550 con 0x7fd63c0ca050 2024-08-17T02:24:33.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.174+0000 7fd633e00640 1 --2- 172.21.15.5:0/1557776552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c0ca050 0x7fd63c156b30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0cb0d0 tx=0x7fd6240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac717b3aeadf8e21 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.175+0000 7fd63aa00640 1 -- 172.21.15.5:0/1557776552 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624032440 con 0x7fd63c0ca050 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.175+0000 7fd63aa00640 1 -- 172.21.15.5:0/1557776552 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6240325a0 con 0x7fd63c0ca050 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.175+0000 7fd63aa00640 1 -- 172.21.15.5:0/1557776552 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624032980 con 0x7fd63c0ca050 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.175+0000 7fd642200640 1 -- 172.21.15.5:0/1557776552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c0ca050 msgr2=0x7fd63c156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.175+0000 7fd642200640 1 --2- 172.21.15.5:0/1557776552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c0ca050 0x7fd63c156b30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0cb0d0 tx=0x7fd6240091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.175+0000 7fd642200640 1 -- 172.21.15.5:0/1557776552 shutdown_connections 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.175+0000 7fd642200640 1 --2- 172.21.15.5:0/1557776552 >> v2:172.21.15.87:3300/0 conn(0x7fd63c0add30 0x7fd63c15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.175+0000 7fd642200640 1 --2- 172.21.15.5:0/1557776552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c0ca050 0x7fd63c156b30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.175+0000 7fd642200640 1 -- 172.21.15.5:0/1557776552 >> 172.21.15.5:0/1557776552 conn(0x7fd63c066e60 msgr2=0x7fd63c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.175+0000 7fd642200640 1 -- 172.21.15.5:0/1557776552 shutdown_connections 2024-08-17T02:24:33.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.175+0000 7fd642200640 1 -- 172.21.15.5:0/1557776552 wait complete. 2024-08-17T02:24:33.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.177+0000 7fd642200640 1 Processor -- start 2024-08-17T02:24:33.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.177+0000 7fd642200640 1 -- start start 2024-08-17T02:24:33.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.178+0000 7fd642200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd63c0ad960 0x7fd63c14b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.178+0000 7fd642200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd63c0add30 0x7fd63c0ac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.178+0000 7fd642200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c0ca050 0x7fd63c1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.178+0000 7fd642200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0ad110 con 0x7fd63c0ca050 2024-08-17T02:24:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.178+0000 7fd642200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0ac3b0 con 0x7fd63c0add30 2024-08-17T02:24:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.178+0000 7fd642200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0ab5f0 con 0x7fd63c0ad960 2024-08-17T02:24:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.178+0000 7fd63be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c0ca050 0x7fd63c1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.178+0000 7fd63be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c0ca050 0x7fd63c1531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43924/0 (socket says 172.21.15.5:43924) 2024-08-17T02:24:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.178+0000 7fd63be00640 1 -- 172.21.15.5:0/2036235405 learned_addr learned my addr 172.21.15.5:0/2036235405 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.178+0000 7fd633e00640 1 --2- 172.21.15.5:0/2036235405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd63c0add30 0x7fd63c0ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.178+0000 7fd63b400640 1 --2- 172.21.15.5:0/2036235405 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd63c0ad960 0x7fd63c14b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.178+0000 7fd63be00640 1 -- 172.21.15.5:0/2036235405 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd63c0ad960 msgr2=0x7fd63c14b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.178+0000 7fd63be00640 1 --2- 172.21.15.5:0/2036235405 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd63c0ad960 0x7fd63c14b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.179+0000 7fd63be00640 1 -- 172.21.15.5:0/2036235405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd63c0add30 msgr2=0x7fd63c0ac650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.179+0000 7fd63be00640 1 --2- 172.21.15.5:0/2036235405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd63c0add30 0x7fd63c0ac650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.179+0000 7fd63be00640 1 -- 172.21.15.5:0/2036235405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd624009450 con 0x7fd63c0ca050 2024-08-17T02:24:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.179+0000 7fd63be00640 1 --2- 172.21.15.5:0/2036235405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c0ca050 0x7fd63c1531b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd634009fa0 tx=0x7fd634009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.179+0000 7fd632a00640 1 -- 172.21.15.5:0/2036235405 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63400ee60 con 0x7fd63c0ca050 2024-08-17T02:24:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.179+0000 7fd632a00640 1 -- 172.21.15.5:0/2036235405 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd634014420 con 0x7fd63c0ca050 2024-08-17T02:24:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.179+0000 7fd632a00640 1 -- 172.21.15.5:0/2036235405 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6340147e0 con 0x7fd63c0ca050 2024-08-17T02:24:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.179+0000 7fd642200640 1 -- 172.21.15.5:0/2036235405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63c0ab8d0 con 0x7fd63c0ca050 2024-08-17T02:24:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.179+0000 7fd642200640 1 -- 172.21.15.5:0/2036235405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63c0abe90 con 0x7fd63c0ca050 2024-08-17T02:24:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.180+0000 7fd642200640 1 -- 172.21.15.5:0/2036235405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63c0ac080 con 0x7fd63c0ca050 2024-08-17T02:24:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.181+0000 7fd632a00640 1 -- 172.21.15.5:0/2036235405 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd634014b50 con 0x7fd63c0ca050 2024-08-17T02:24:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.182+0000 7fd632a00640 1 --2- 172.21.15.5:0/2036235405 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fd618065150 0x7fd618067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.182+0000 7fd632a00640 1 -- 172.21.15.5:0/2036235405 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd634082ab0 con 0x7fd63c0ca050 2024-08-17T02:24:33.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.182+0000 7fd63b400640 1 --2- 172.21.15.5:0/2036235405 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fd618065150 0x7fd618067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.183+0000 7fd63b400640 1 --2- 172.21.15.5:0/2036235405 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fd618065150 0x7fd618067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd62c007fd0 tx=0x7fd62c007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:33.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.186+0000 7fd632a00640 1 -- 172.21.15.5:0/2036235405 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd634050b80 con 0x7fd63c0ca050 2024-08-17T02:24:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:33.411+0000 7fd642200640 1 -- 172.21.15.5:0/2036235405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd63c063fb0 con 0x7fd63c0ca050 2024-08-17T02:24:34.120 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-08-17T02:24:34.120+0000 7f5f10600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:24:34.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.248+0000 7fd632a00640 1 -- 172.21.15.5:0/2036235405 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd6340541a0 con 0x7fd63c0ca050 2024-08-17T02:24:34.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.251+0000 7fd642200640 1 -- 172.21.15.5:0/2036235405 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fd618065150 msgr2=0x7fd618067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.251+0000 7fd642200640 1 --2- 172.21.15.5:0/2036235405 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fd618065150 0x7fd618067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd62c007fd0 tx=0x7fd62c007e30 comp rx=0 tx=0).stop 2024-08-17T02:24:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.251+0000 7fd642200640 1 -- 172.21.15.5:0/2036235405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c0ca050 msgr2=0x7fd63c1531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.251+0000 7fd642200640 1 --2- 172.21.15.5:0/2036235405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c0ca050 0x7fd63c1531b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd634009fa0 tx=0x7fd634009900 comp rx=0 tx=0).stop 2024-08-17T02:24:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.251+0000 7fd642200640 1 -- 172.21.15.5:0/2036235405 shutdown_connections 2024-08-17T02:24:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.251+0000 7fd642200640 1 --2- 172.21.15.5:0/2036235405 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fd618065150 0x7fd618067600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.251+0000 7fd642200640 1 --2- 172.21.15.5:0/2036235405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c0ca050 0x7fd63c1531b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.251+0000 7fd642200640 1 --2- 172.21.15.5:0/2036235405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd63c0add30 0x7fd63c0ac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.251+0000 7fd642200640 1 --2- 172.21.15.5:0/2036235405 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd63c0ad960 0x7fd63c14b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.251+0000 7fd642200640 1 -- 172.21.15.5:0/2036235405 >> 172.21.15.5:0/2036235405 conn(0x7fd63c066e60 msgr2=0x7fd63c0aac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.251+0000 7fd642200640 1 -- 172.21.15.5:0/2036235405 shutdown_connections 2024-08-17T02:24:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.251+0000 7fd642200640 1 -- 172.21.15.5:0/2036235405 wait complete. 2024-08-17T02:24:34.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:24:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.428+0000 7fb89a600640 1 Processor -- start 2024-08-17T02:24:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.429+0000 7fb89a600640 1 -- start start 2024-08-17T02:24:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.430+0000 7fb89a600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8940ab100 0x7fb8940b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.430+0000 7fb89a600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb8940b1f30 0x7fb8940b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.430+0000 7fb89a600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb894156fc0 con 0x7fb8940aa620 2024-08-17T02:24:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.430+0000 7fb89a600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb894158450 con 0x7fb8940ab100 2024-08-17T02:24:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.430+0000 7fb89a600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8941586f0 con 0x7fb8940b1f30 2024-08-17T02:24:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.430+0000 7fb893e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8940ab100 0x7fb8940b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.430+0000 7fb893e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8940ab100 0x7fb8940b19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43932/0 (socket says 172.21.15.5:43932) 2024-08-17T02:24:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.430+0000 7fb893e00640 1 -- 172.21.15.5:0/2297941028 learned_addr learned my addr 172.21.15.5:0/2297941028 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.430+0000 7fb899c00640 1 --2- 172.21.15.5:0/2297941028 >> v2:172.21.15.87:3300/0 conn(0x7fb8940b1f30 0x7fb8940b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.430+0000 7fb893e00640 1 -- 172.21.15.5:0/2297941028 >> v2:172.21.15.87:3300/0 conn(0x7fb8940b1f30 msgr2=0x7fb8940b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.430+0000 7fb893e00640 1 --2- 172.21.15.5:0/2297941028 >> v2:172.21.15.87:3300/0 conn(0x7fb8940b1f30 0x7fb8940b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.430+0000 7fb893e00640 1 -- 172.21.15.5:0/2297941028 >> v1:172.21.15.5:6789/0 conn(0x7fb8940aa620 legacy=0x7fb8940aa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.430+0000 7fb893e00640 1 -- 172.21.15.5:0/2297941028 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8940b2a20 con 0x7fb8940ab100 2024-08-17T02:24:34.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.430+0000 7fb899c00640 1 --2- 172.21.15.5:0/2297941028 >> v2:172.21.15.87:3300/0 conn(0x7fb8940b1f30 0x7fb8940b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.431+0000 7fb893e00640 1 --2- 172.21.15.5:0/2297941028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8940ab100 0x7fb8940b19f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb8940b35a0 tx=0x7fb8800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9334cde892a3e13f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.432+0000 7fb893400640 1 -- 172.21.15.5:0/2297941028 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88002ae80 con 0x7fb8940ab100 2024-08-17T02:24:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.432+0000 7fb893400640 1 -- 172.21.15.5:0/2297941028 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb880032440 con 0x7fb8940ab100 2024-08-17T02:24:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.432+0000 7fb893400640 1 -- 172.21.15.5:0/2297941028 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880032800 con 0x7fb8940ab100 2024-08-17T02:24:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.432+0000 7fb89a600640 1 -- 172.21.15.5:0/2297941028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8940ab100 msgr2=0x7fb8940b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.432+0000 7fb89a600640 1 --2- 172.21.15.5:0/2297941028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8940ab100 0x7fb8940b19f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb8940b35a0 tx=0x7fb8800091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.432+0000 7fb89a600640 1 -- 172.21.15.5:0/2297941028 shutdown_connections 2024-08-17T02:24:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.432+0000 7fb89a600640 1 --2- 172.21.15.5:0/2297941028 >> v2:172.21.15.87:3300/0 conn(0x7fb8940b1f30 0x7fb8940b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.432+0000 7fb89a600640 1 --2- 172.21.15.5:0/2297941028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8940ab100 0x7fb8940b19f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.432+0000 7fb89a600640 1 -- 172.21.15.5:0/2297941028 >> 172.21.15.5:0/2297941028 conn(0x7fb8940ce400 msgr2=0x7fb894095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:34.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.432+0000 7fb89a600640 1 -- 172.21.15.5:0/2297941028 shutdown_connections 2024-08-17T02:24:34.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.432+0000 7fb89a600640 1 -- 172.21.15.5:0/2297941028 wait complete. 2024-08-17T02:24:34.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.434+0000 7fb89a600640 1 Processor -- start 2024-08-17T02:24:34.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.434+0000 7fb89a600640 1 -- start start 2024-08-17T02:24:34.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.435+0000 7fb89a600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8940aa620 0x7fb8940980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.435+0000 7fb89a600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8940ab100 0x7fb894149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.435+0000 7fb89a600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8940b1f30 0x7fb8940ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.435+0000 7fb89a600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89409b430 con 0x7fb8940ab100 2024-08-17T02:24:34.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.435+0000 7fb89a600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89409a860 con 0x7fb8940b1f30 2024-08-17T02:24:34.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.435+0000 7fb89a600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89409ab00 con 0x7fb8940aa620 2024-08-17T02:24:34.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.435+0000 7fb893e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8940ab100 0x7fb894149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.435+0000 7fb893e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8940ab100 0x7fb894149330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43946/0 (socket says 172.21.15.5:43946) 2024-08-17T02:24:34.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.435+0000 7fb893e00640 1 -- 172.21.15.5:0/1101757987 learned_addr learned my addr 172.21.15.5:0/1101757987 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:34.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.435+0000 7fb899c00640 1 --2- 172.21.15.5:0/1101757987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8940b1f30 0x7fb8940ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.435+0000 7fb899200640 1 --2- 172.21.15.5:0/1101757987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8940aa620 0x7fb8940980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.435+0000 7fb893e00640 1 -- 172.21.15.5:0/1101757987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8940aa620 msgr2=0x7fb8940980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.435+0000 7fb893e00640 1 --2- 172.21.15.5:0/1101757987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8940aa620 0x7fb8940980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.435+0000 7fb893e00640 1 -- 172.21.15.5:0/1101757987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8940b1f30 msgr2=0x7fb8940ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.435+0000 7fb893e00640 1 --2- 172.21.15.5:0/1101757987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8940b1f30 0x7fb8940ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.435+0000 7fb893e00640 1 -- 172.21.15.5:0/1101757987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb880009450 con 0x7fb8940ab100 2024-08-17T02:24:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.435+0000 7fb899c00640 1 --2- 172.21.15.5:0/1101757987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8940b1f30 0x7fb8940ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.435+0000 7fb899200640 1 --2- 172.21.15.5:0/1101757987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8940aa620 0x7fb8940980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.436+0000 7fb893e00640 1 --2- 172.21.15.5:0/1101757987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8940ab100 0x7fb894149330 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb880009210 tx=0x7fb880032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.436+0000 7fb887e00640 1 -- 172.21.15.5:0/1101757987 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880031de0 con 0x7fb8940ab100 2024-08-17T02:24:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.436+0000 7fb887e00640 1 -- 172.21.15.5:0/1101757987 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88003d420 con 0x7fb8940ab100 2024-08-17T02:24:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.436+0000 7fb887e00640 1 -- 172.21.15.5:0/1101757987 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88003d820 con 0x7fb8940ab100 2024-08-17T02:24:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.436+0000 7fb89a600640 1 -- 172.21.15.5:0/1101757987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb89409ade0 con 0x7fb8940ab100 2024-08-17T02:24:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.436+0000 7fb89a600640 1 -- 172.21.15.5:0/1101757987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb894098600 con 0x7fb8940ab100 2024-08-17T02:24:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.437+0000 7fb89a600640 1 -- 172.21.15.5:0/1101757987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb894070720 con 0x7fb8940ab100 2024-08-17T02:24:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.438+0000 7fb887e00640 1 -- 172.21.15.5:0/1101757987 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb880039040 con 0x7fb8940ab100 2024-08-17T02:24:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.439+0000 7fb887e00640 1 --2- 172.21.15.5:0/1101757987 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb874065180 0x7fb874067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.439+0000 7fb887e00640 1 -- 172.21.15.5:0/1101757987 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb8800a2870 con 0x7fb8940ab100 2024-08-17T02:24:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.440+0000 7fb899200640 1 --2- 172.21.15.5:0/1101757987 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb874065180 0x7fb874067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.440+0000 7fb899200640 1 --2- 172.21.15.5:0/1101757987 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb874065180 0x7fb874067630 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb888001700 tx=0x7fb888009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:34.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.443+0000 7fb887e00640 1 -- 172.21.15.5:0/1101757987 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb880070950 con 0x7fb8940ab100 2024-08-17T02:24:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:34.662+0000 7fb89a600640 1 -- 172.21.15.5:0/1101757987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb89409b570 con 0x7fb8940ab100 2024-08-17T02:24:35.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.254+0000 7fb887e00640 1 -- 172.21.15.5:0/1101757987 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb89409b570 con 0x7fb8940ab100 2024-08-17T02:24:35.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.257+0000 7fb89a600640 1 -- 172.21.15.5:0/1101757987 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb874065180 msgr2=0x7fb874067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.257+0000 7fb89a600640 1 --2- 172.21.15.5:0/1101757987 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb874065180 0x7fb874067630 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb888001700 tx=0x7fb888009040 comp rx=0 tx=0).stop 2024-08-17T02:24:35.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.257+0000 7fb89a600640 1 -- 172.21.15.5:0/1101757987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8940ab100 msgr2=0x7fb894149330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.257+0000 7fb89a600640 1 --2- 172.21.15.5:0/1101757987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8940ab100 0x7fb894149330 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb880009210 tx=0x7fb880032000 comp rx=0 tx=0).stop 2024-08-17T02:24:35.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.257+0000 7fb89a600640 1 -- 172.21.15.5:0/1101757987 shutdown_connections 2024-08-17T02:24:35.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.257+0000 7fb89a600640 1 --2- 172.21.15.5:0/1101757987 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb874065180 0x7fb874067630 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.257+0000 7fb89a600640 1 --2- 172.21.15.5:0/1101757987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8940b1f30 0x7fb8940ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.257+0000 7fb89a600640 1 --2- 172.21.15.5:0/1101757987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8940ab100 0x7fb894149330 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.257+0000 7fb89a600640 1 --2- 172.21.15.5:0/1101757987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8940aa620 0x7fb8940980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.257+0000 7fb89a600640 1 -- 172.21.15.5:0/1101757987 >> 172.21.15.5:0/1101757987 conn(0x7fb8940ce400 msgr2=0x7fb894156300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.257+0000 7fb89a600640 1 -- 172.21.15.5:0/1101757987 shutdown_connections 2024-08-17T02:24:35.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.257+0000 7fb89a600640 1 -- 172.21.15.5:0/1101757987 wait complete. 2024-08-17T02:24:35.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:35.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.429+0000 7f6f62e00640 1 Processor -- start 2024-08-17T02:24:35.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.429+0000 7f6f62e00640 1 -- start start 2024-08-17T02:24:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.430+0000 7f6f62e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f5c15a950 0x7f6f5c0a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.430+0000 7f6f62e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f5c0a9630 0x7f6f5c1592f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.430+0000 7f6f62e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c067510 con 0x7f6f5c158f20 2024-08-17T02:24:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.430+0000 7f6f62e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c063650 con 0x7f6f5c15a950 2024-08-17T02:24:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.430+0000 7f6f62e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0a9ab0 con 0x7f6f5c0a9630 2024-08-17T02:24:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.430+0000 7f6f5be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6f5c158f20 0x7f6f5c062f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55710/0 (socket says 172.21.15.5:55710) 2024-08-17T02:24:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.430+0000 7f6f5be00640 1 -- 172.21.15.5:0/2140833256 learned_addr learned my addr 172.21.15.5:0/2140833256 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.430+0000 7f6f5b400640 1 --2- 172.21.15.5:0/2140833256 >> v2:172.21.15.5:3300/0 conn(0x7f6f5c15a950 0x7f6f5c0a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.431+0000 7f6f60e00640 1 --2- 172.21.15.5:0/2140833256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f5c0a9630 0x7f6f5c1592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.431+0000 7f6f5b400640 1 -- 172.21.15.5:0/2140833256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f5c0a9630 msgr2=0x7f6f5c1592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.431+0000 7f6f5b400640 1 --2- 172.21.15.5:0/2140833256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f5c0a9630 0x7f6f5c1592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.431+0000 7f6f5b400640 1 -- 172.21.15.5:0/2140833256 >> v1:172.21.15.5:6789/0 conn(0x7f6f5c158f20 legacy=0x7f6f5c062f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.431+0000 7f6f5b400640 1 -- 172.21.15.5:0/2140833256 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c066f00 con 0x7f6f5c15a950 2024-08-17T02:24:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.432+0000 7f6f5b400640 1 --2- 172.21.15.5:0/2140833256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f5c15a950 0x7f6f5c0a90f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009880 tx=0x7f6f480090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d307090399a8ce76 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.432+0000 7f6f5aa00640 1 -- 172.21.15.5:0/2140833256 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4802ad90 con 0x7f6f5c15a950 2024-08-17T02:24:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.432+0000 7f6f5aa00640 1 -- 172.21.15.5:0/2140833256 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f48032440 con 0x7f6f5c15a950 2024-08-17T02:24:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.432+0000 7f6f5aa00640 1 -- 172.21.15.5:0/2140833256 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f48032820 con 0x7f6f5c15a950 2024-08-17T02:24:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.433+0000 7f6f62e00640 1 -- 172.21.15.5:0/2140833256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f5c15a950 msgr2=0x7f6f5c0a90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.433+0000 7f6f62e00640 1 --2- 172.21.15.5:0/2140833256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f5c15a950 0x7f6f5c0a90f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009880 tx=0x7f6f480090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.433+0000 7f6f62e00640 1 -- 172.21.15.5:0/2140833256 shutdown_connections 2024-08-17T02:24:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.433+0000 7f6f62e00640 1 --2- 172.21.15.5:0/2140833256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f5c0a9630 0x7f6f5c1592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.433+0000 7f6f62e00640 1 --2- 172.21.15.5:0/2140833256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f5c15a950 0x7f6f5c0a90f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.433+0000 7f6f62e00640 1 -- 172.21.15.5:0/2140833256 >> 172.21.15.5:0/2140833256 conn(0x7f6f5c06e5b0 msgr2=0x7f6f5c0b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.433+0000 7f6f62e00640 1 -- 172.21.15.5:0/2140833256 shutdown_connections 2024-08-17T02:24:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.433+0000 7f6f62e00640 1 -- 172.21.15.5:0/2140833256 wait complete. 2024-08-17T02:24:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.434+0000 7f6f62e00640 1 Processor -- start 2024-08-17T02:24:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.434+0000 7f6f62e00640 1 -- start start 2024-08-17T02:24:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.435+0000 7f6f62e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f5c0a9630 0x7f6f5c15e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.435+0000 7f6f62e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f5c158f20 0x7f6f5c150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.435+0000 7f6f62e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f5c15a950 0x7f6f5c1599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.435+0000 7f6f62e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c151010 con 0x7f6f5c0a9630 2024-08-17T02:24:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.435+0000 7f6f62e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c1512f0 con 0x7f6f5c158f20 2024-08-17T02:24:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.435+0000 7f6f62e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c1515d0 con 0x7f6f5c15a950 2024-08-17T02:24:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.436+0000 7f6f5be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f5c0a9630 0x7f6f5c15e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.436+0000 7f6f5be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f5c0a9630 0x7f6f5c15e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43968/0 (socket says 172.21.15.5:43968) 2024-08-17T02:24:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.436+0000 7f6f5be00640 1 -- 172.21.15.5:0/3933421721 learned_addr learned my addr 172.21.15.5:0/3933421721 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.436+0000 7f6f60e00640 1 --2- 172.21.15.5:0/3933421721 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f5c15a950 0x7f6f5c1599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.436+0000 7f6f5b400640 1 --2- 172.21.15.5:0/3933421721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f5c158f20 0x7f6f5c150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.436+0000 7f6f5be00640 1 -- 172.21.15.5:0/3933421721 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f5c15a950 msgr2=0x7f6f5c1599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.436+0000 7f6f5be00640 1 --2- 172.21.15.5:0/3933421721 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f5c15a950 0x7f6f5c1599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.436+0000 7f6f5be00640 1 -- 172.21.15.5:0/3933421721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f5c158f20 msgr2=0x7f6f5c150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.436+0000 7f6f5be00640 1 --2- 172.21.15.5:0/3933421721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f5c158f20 0x7f6f5c150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.436+0000 7f6f5be00640 1 -- 172.21.15.5:0/3933421721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f48009390 con 0x7f6f5c0a9630 2024-08-17T02:24:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.436+0000 7f6f5be00640 1 --2- 172.21.15.5:0/3933421721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f5c0a9630 0x7f6f5c15e030 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00c590 tx=0x7f6f4c007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.437+0000 7f6f53400640 1 -- 172.21.15.5:0/3933421721 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c005aa0 con 0x7f6f5c0a9630 2024-08-17T02:24:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.437+0000 7f6f53400640 1 -- 172.21.15.5:0/3933421721 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c005c20 con 0x7f6f5c0a9630 2024-08-17T02:24:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.437+0000 7f6f53400640 1 -- 172.21.15.5:0/3933421721 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0070f0 con 0x7f6f5c0a9630 2024-08-17T02:24:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.437+0000 7f6f62e00640 1 -- 172.21.15.5:0/3933421721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5c1518b0 con 0x7f6f5c0a9630 2024-08-17T02:24:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.437+0000 7f6f62e00640 1 -- 172.21.15.5:0/3933421721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5c159ef0 con 0x7f6f5c0a9630 2024-08-17T02:24:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.438+0000 7f6f62e00640 1 -- 172.21.15.5:0/3933421721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5c151a40 con 0x7f6f5c0a9630 2024-08-17T02:24:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.438+0000 7f6f53400640 1 -- 172.21.15.5:0/3933421721 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6f4c007540 con 0x7f6f5c0a9630 2024-08-17T02:24:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.439+0000 7f6f53400640 1 --2- 172.21.15.5:0/3933421721 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6f3c065150 0x7f6f3c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.439+0000 7f6f53400640 1 -- 172.21.15.5:0/3933421721 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f4c0814e0 con 0x7f6f5c0a9630 2024-08-17T02:24:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.440+0000 7f6f5b400640 1 --2- 172.21.15.5:0/3933421721 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6f3c065150 0x7f6f3c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.440+0000 7f6f5b400640 1 --2- 172.21.15.5:0/3933421721 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6f3c065150 0x7f6f3c067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6f48034000 tx=0x7f6f48032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.443+0000 7f6f53400640 1 -- 172.21.15.5:0/3933421721 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6f4c04f630 con 0x7f6f5c0a9630 2024-08-17T02:24:35.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.663+0000 7f6f62e00640 1 -- 172.21.15.5:0/3933421721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f5c063fb0 con 0x7f6f5c0a9630 2024-08-17T02:24:35.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.663+0000 7f6f53400640 1 -- 172.21.15.5:0/3933421721 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7f6f4c052c50 con 0x7f6f5c0a9630 2024-08-17T02:24:35.664 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:35.664 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1398504310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1398504310},{"type":"v1","addr":"172.21.15.5:6837","nonce":1398504310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/1045077639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1045077639},{"type":"v1","addr":"172.21.15.87:6833","nonce":1045077639}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4858,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1739323622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1739323622},{"type":"v1","addr":"172.21.15.87:6835","nonce":1739323622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:31.652483+0000","modified":"2024-08-17T02:24:35.247786+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6836/1918940200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1918940200},{"type":"v1","addr":"172.21.15.5:6836","nonce":1918940200}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:24:35.664 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 17 2024-08-17T02:24:35.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.665+0000 7f6f62e00640 1 -- 172.21.15.5:0/3933421721 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6f3c065150 msgr2=0x7f6f3c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.665+0000 7f6f62e00640 1 --2- 172.21.15.5:0/3933421721 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6f3c065150 0x7f6f3c067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6f48034000 tx=0x7f6f48032000 comp rx=0 tx=0).stop 2024-08-17T02:24:35.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.665+0000 7f6f62e00640 1 -- 172.21.15.5:0/3933421721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f5c0a9630 msgr2=0x7f6f5c15e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.665+0000 7f6f62e00640 1 --2- 172.21.15.5:0/3933421721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f5c0a9630 0x7f6f5c15e030 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00c590 tx=0x7f6f4c007ee0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.665+0000 7f6f62e00640 1 -- 172.21.15.5:0/3933421721 shutdown_connections 2024-08-17T02:24:35.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.665+0000 7f6f62e00640 1 --2- 172.21.15.5:0/3933421721 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6f3c065150 0x7f6f3c067600 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.665+0000 7f6f62e00640 1 --2- 172.21.15.5:0/3933421721 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f5c15a950 0x7f6f5c1599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.665+0000 7f6f62e00640 1 --2- 172.21.15.5:0/3933421721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f5c158f20 0x7f6f5c150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.665+0000 7f6f62e00640 1 --2- 172.21.15.5:0/3933421721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f5c0a9630 0x7f6f5c15e030 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.665+0000 7f6f62e00640 1 -- 172.21.15.5:0/3933421721 >> 172.21.15.5:0/3933421721 conn(0x7f6f5c06e5b0 msgr2=0x7f6f5c06aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.666+0000 7f6f62e00640 1 -- 172.21.15.5:0/3933421721 shutdown_connections 2024-08-17T02:24:35.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.666+0000 7f6f62e00640 1 -- 172.21.15.5:0/3933421721 wait complete. 2024-08-17T02:24:35.681 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:35.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.831+0000 7f71a0a00640 1 Processor -- start 2024-08-17T02:24:35.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.831+0000 7f71a0a00640 1 -- start start 2024-08-17T02:24:35.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.832+0000 7f71a0a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f719c15a490 0x7f719c0ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.832+0000 7f71a0a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c15a880 con 0x7f719c0b1920 2024-08-17T02:24:35.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.833+0000 7f71a0a00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c15b6b0 con 0x7f719c158c60 2024-08-17T02:24:35.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.833+0000 7f71a0a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0b0540 con 0x7f719c15a490 2024-08-17T02:24:35.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.833+0000 7f719b200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f719c0b1920 0x7f719c0b1d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55722/0 (socket says 172.21.15.5:55722) 2024-08-17T02:24:35.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.833+0000 7f719b200640 1 -- 172.21.15.5:0/2659649351 learned_addr learned my addr 172.21.15.5:0/2659649351 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:35.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.833+0000 7f7193e00640 1 --2- 172.21.15.5:0/2659649351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f719c15a490 0x7f719c0ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.833+0000 7f7199e00640 1 -- 172.21.15.5:0/2659649351 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694033255 0 0) 0x7f7194001490 con 0x7f719c0b1920 2024-08-17T02:24:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.833+0000 7f7199e00640 1 -- 172.21.15.5:0/2659649351 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71800034e0 con 0x7f719c0b1920 2024-08-17T02:24:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f7199e00640 1 -- 172.21.15.5:0/2659649351 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3050934327 0 0) 0x7f71800034e0 con 0x7f719c0b1920 2024-08-17T02:24:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f7199e00640 1 -- 172.21.15.5:0/2659649351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f719c15a490 msgr2=0x7f719c0ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f7199e00640 1 --2- 172.21.15.5:0/2659649351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f719c15a490 0x7f719c0ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f7199e00640 1 -- 172.21.15.5:0/2659649351 >> v1:172.21.15.87:6789/0 conn(0x7f719c158c60 legacy=0x7f719c159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f7199e00640 1 -- 172.21.15.5:0/2659649351 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c15aac0 con 0x7f719c0b1920 2024-08-17T02:24:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f7199e00640 1 -- 172.21.15.5:0/2659649351 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2658686246 0 0) 0x7f7194001980 con 0x7f719c0b1920 2024-08-17T02:24:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f7199e00640 1 -- 172.21.15.5:0/2659649351 >> v1:172.21.15.5:6789/0 conn(0x7f719c0b1920 legacy=0x7f719c0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f7199e00640 1 --2- 172.21.15.5:0/2659649351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7180003a70 0x7f7180003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f7199e00640 1 --2- 172.21.15.5:0/2659649351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f719c15a490 0x7f7180004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f7199e00640 1 --2- 172.21.15.5:0/2659649351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7180004cc0 0x7f7180005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f7199e00640 1 -- 172.21.15.5:0/2659649351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0b0540 con 0x7f7180003a70 2024-08-17T02:24:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f7199e00640 1 -- 172.21.15.5:0/2659649351 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718000bae0 con 0x7f7180004cc0 2024-08-17T02:24:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f7199e00640 1 -- 172.21.15.5:0/2659649351 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718000bca0 con 0x7f719c15a490 2024-08-17T02:24:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f719a800640 1 --2- 172.21.15.5:0/2659649351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7180003a70 0x7f7180003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f7193e00640 1 --2- 172.21.15.5:0/2659649351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f719c15a490 0x7f7180004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f719b200640 1 --2- 172.21.15.5:0/2659649351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7180004cc0 0x7f7180005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f719a800640 1 -- 172.21.15.5:0/2659649351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f719c15a490 msgr2=0x7f7180004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f719a800640 1 --2- 172.21.15.5:0/2659649351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f719c15a490 0x7f7180004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f719a800640 1 -- 172.21.15.5:0/2659649351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7180004cc0 msgr2=0x7f7180005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.834+0000 7f719a800640 1 --2- 172.21.15.5:0/2659649351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7180004cc0 0x7f7180005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.835+0000 7f719a800640 1 -- 172.21.15.5:0/2659649351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71800034e0 con 0x7f7180003a70 2024-08-17T02:24:35.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.835+0000 7f719a800640 1 --2- 172.21.15.5:0/2659649351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7180003a70 0x7f7180003e40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f718c001920 tx=0x7f718c007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49344746e9c1d2e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.836+0000 7f7199e00640 1 -- 172.21.15.5:0/2659649351 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c02ab00 con 0x7f7180003a70 2024-08-17T02:24:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.836+0000 7f7199e00640 1 -- 172.21.15.5:0/2659649351 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c02ac80 con 0x7f7180003a70 2024-08-17T02:24:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.836+0000 7f7199e00640 1 -- 172.21.15.5:0/2659649351 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c0323f0 con 0x7f7180003a70 2024-08-17T02:24:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.836+0000 7f71a0a00640 1 -- 172.21.15.5:0/2659649351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7180003a70 msgr2=0x7f7180003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.836+0000 7f71a0a00640 1 --2- 172.21.15.5:0/2659649351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7180003a70 0x7f7180003e40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f718c001920 tx=0x7f718c007c80 comp rx=0 tx=0).stop 2024-08-17T02:24:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.836+0000 7f719b200640 1 -- 172.21.15.5:0/2659649351 reap_dead start 2024-08-17T02:24:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.836+0000 7f71a0a00640 1 -- 172.21.15.5:0/2659649351 shutdown_connections 2024-08-17T02:24:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.836+0000 7f71a0a00640 1 -- 172.21.15.5:0/2659649351 >> 172.21.15.5:0/2659649351 conn(0x7f719c06e590 msgr2=0x7f719c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.836+0000 7f71a0a00640 1 -- 172.21.15.5:0/2659649351 shutdown_connections 2024-08-17T02:24:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.836+0000 7f71a0a00640 1 -- 172.21.15.5:0/2659649351 wait complete. 2024-08-17T02:24:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.838+0000 7f71a0a00640 1 Processor -- start 2024-08-17T02:24:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.838+0000 7f71a0a00640 1 -- start start 2024-08-17T02:24:35.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.839+0000 7f71a0a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7180003a70 0x7f719c14a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.839+0000 7f71a0a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f719c0c9250 0x7f719c0c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.839+0000 7f71a0a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f719c0c3fc0 0x7f719c0c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.839+0000 7f71a0a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0c71f0 con 0x7f719c0c9250 2024-08-17T02:24:35.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.839+0000 7f71a0a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c1477f0 con 0x7f7180003a70 2024-08-17T02:24:35.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.839+0000 7f71a0a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c14a7a0 con 0x7f719c0c3fc0 2024-08-17T02:24:35.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.839+0000 7f7193e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f719c0c9250 0x7f719c0c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.839+0000 7f7193e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f719c0c9250 0x7f719c0c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43990/0 (socket says 172.21.15.5:43990) 2024-08-17T02:24:35.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.839+0000 7f7193e00640 1 -- 172.21.15.5:0/1908711112 learned_addr learned my addr 172.21.15.5:0/1908711112 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:35.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.839+0000 7f719b200640 1 --2- 172.21.15.5:0/1908711112 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f719c0c3fc0 0x7f719c0c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.839+0000 7f719a800640 1 --2- 172.21.15.5:0/1908711112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7180003a70 0x7f719c14a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.839+0000 7f7193e00640 1 -- 172.21.15.5:0/1908711112 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f719c0c3fc0 msgr2=0x7f719c0c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.839+0000 7f7193e00640 1 --2- 172.21.15.5:0/1908711112 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f719c0c3fc0 0x7f719c0c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.839+0000 7f7193e00640 1 -- 172.21.15.5:0/1908711112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7180003a70 msgr2=0x7f719c14a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.839+0000 7f7193e00640 1 --2- 172.21.15.5:0/1908711112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7180003a70 0x7f719c14a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.839+0000 7f7193e00640 1 -- 172.21.15.5:0/1908711112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c0c7a20 con 0x7f719c0c9250 2024-08-17T02:24:35.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.840+0000 7f7193e00640 1 --2- 172.21.15.5:0/1908711112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f719c0c9250 0x7f719c0c96c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7184011b40 tx=0x7f71840090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.840+0000 7f7192000640 1 -- 172.21.15.5:0/1908711112 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718400faa0 con 0x7f719c0c9250 2024-08-17T02:24:35.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.840+0000 7f7192000640 1 -- 172.21.15.5:0/1908711112 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718400fc00 con 0x7f719c0c9250 2024-08-17T02:24:35.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.840+0000 7f7192000640 1 -- 172.21.15.5:0/1908711112 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7184014440 con 0x7f719c0c9250 2024-08-17T02:24:35.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.840+0000 7f71a0a00640 1 -- 172.21.15.5:0/1908711112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c0c9c00 con 0x7f719c0c9250 2024-08-17T02:24:35.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.840+0000 7f71a0a00640 1 -- 172.21.15.5:0/1908711112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c0c73d0 con 0x7f719c0c9250 2024-08-17T02:24:35.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.841+0000 7f71a0a00640 1 -- 172.21.15.5:0/1908711112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c0c7bb0 con 0x7f719c0c9250 2024-08-17T02:24:35.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.842+0000 7f7192000640 1 -- 172.21.15.5:0/1908711112 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f71840147b0 con 0x7f719c0c9250 2024-08-17T02:24:35.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.843+0000 7f7192000640 1 --2- 172.21.15.5:0/1908711112 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7178065150 0x7f7178067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.843+0000 7f7192000640 1 -- 172.21.15.5:0/1908711112 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7184018030 con 0x7f719c0c9250 2024-08-17T02:24:35.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.843+0000 7f719a800640 1 --2- 172.21.15.5:0/1908711112 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7178065150 0x7f7178067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.844+0000 7f719a800640 1 --2- 172.21.15.5:0/1908711112 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7178065150 0x7f7178067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f718c0018f0 tx=0x7f718c003000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:35.847+0000 7f7192000640 1 -- 172.21.15.5:0/1908711112 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7184050eb0 con 0x7f719c0c9250 2024-08-17T02:24:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.032+0000 7f71a0a00640 1 -- 172.21.15.5:0/1908711112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f719c070720 con 0x7f719c0c9250 2024-08-17T02:24:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.032+0000 7f7192000640 1 -- 172.21.15.5:0/1908711112 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f7184022020 con 0x7f719c0c9250 2024-08-17T02:24:36.033 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:36.033 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:24:33.233712+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:29.724167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:30.637206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.034+0000 7f71a0a00640 1 -- 172.21.15.5:0/1908711112 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7178065150 msgr2=0x7f7178067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.034+0000 7f71a0a00640 1 --2- 172.21.15.5:0/1908711112 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7178065150 0x7f7178067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f718c0018f0 tx=0x7f718c003000 comp rx=0 tx=0).stop 2024-08-17T02:24:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.034+0000 7f71a0a00640 1 -- 172.21.15.5:0/1908711112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f719c0c9250 msgr2=0x7f719c0c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.034+0000 7f71a0a00640 1 --2- 172.21.15.5:0/1908711112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f719c0c9250 0x7f719c0c96c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7184011b40 tx=0x7f71840090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.035+0000 7f71a0a00640 1 -- 172.21.15.5:0/1908711112 shutdown_connections 2024-08-17T02:24:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.035+0000 7f71a0a00640 1 --2- 172.21.15.5:0/1908711112 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7178065150 0x7f7178067600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.035+0000 7f71a0a00640 1 --2- 172.21.15.5:0/1908711112 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f719c0c3fc0 0x7f719c0c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.035+0000 7f71a0a00640 1 --2- 172.21.15.5:0/1908711112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f719c0c9250 0x7f719c0c96c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.035+0000 7f71a0a00640 1 --2- 172.21.15.5:0/1908711112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7180003a70 0x7f719c14a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.035+0000 7f71a0a00640 1 -- 172.21.15.5:0/1908711112 >> 172.21.15.5:0/1908711112 conn(0x7f719c06e590 msgr2=0x7f719c159030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.035+0000 7f71a0a00640 1 -- 172.21.15.5:0/1908711112 shutdown_connections 2024-08-17T02:24:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.035+0000 7f71a0a00640 1 -- 172.21.15.5:0/1908711112 wait complete. 2024-08-17T02:24:36.051 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:24:36.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:24:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.203+0000 7eff0ae00640 1 Processor -- start 2024-08-17T02:24:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.203+0000 7eff0ae00640 1 -- start start 2024-08-17T02:24:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.204+0000 7eff0ae00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff041590b0 0x7eff040b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.204+0000 7eff0ae00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff040c92b0 con 0x7eff040afca0 2024-08-17T02:24:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.204+0000 7eff0ae00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff040ad480 con 0x7eff040acf10 2024-08-17T02:24:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.204+0000 7eff0ae00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff040b0980 con 0x7eff041590b0 2024-08-17T02:24:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.204+0000 7eff03e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7eff040afca0 0x7eff041589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55726/0 (socket says 172.21.15.5:55726) 2024-08-17T02:24:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.204+0000 7eff03e00640 1 -- 172.21.15.5:0/2382416655 learned_addr learned my addr 172.21.15.5:0/2382416655 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.205+0000 7eff03400640 1 --2- 172.21.15.5:0/2382416655 >> v2:172.21.15.5:3300/0 conn(0x7eff041590b0 0x7eff040b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.205+0000 7eff03400640 1 -- 172.21.15.5:0/2382416655 >> v1:172.21.15.87:6789/0 conn(0x7eff040acf10 legacy=0x7eff040c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.205+0000 7eff03400640 1 -- 172.21.15.5:0/2382416655 >> v1:172.21.15.5:6789/0 conn(0x7eff040afca0 legacy=0x7eff041589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.205+0000 7eff03400640 1 -- 172.21.15.5:0/2382416655 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff040ad760 con 0x7eff041590b0 2024-08-17T02:24:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.206+0000 7eff03400640 1 --2- 172.21.15.5:0/2382416655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff041590b0 0x7eff040b0070 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efef0009850 tx=0x7efef00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37672c3c4f767b1e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.206+0000 7eff02a00640 1 -- 172.21.15.5:0/2382416655 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef002ae20 con 0x7eff041590b0 2024-08-17T02:24:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.206+0000 7eff02a00640 1 -- 172.21.15.5:0/2382416655 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef0032440 con 0x7eff041590b0 2024-08-17T02:24:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.206+0000 7eff02a00640 1 -- 172.21.15.5:0/2382416655 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef0032820 con 0x7eff041590b0 2024-08-17T02:24:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.207+0000 7eff0ae00640 1 -- 172.21.15.5:0/2382416655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff041590b0 msgr2=0x7eff040b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.207+0000 7eff0ae00640 1 --2- 172.21.15.5:0/2382416655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff041590b0 0x7eff040b0070 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efef0009850 tx=0x7efef00090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.207+0000 7eff0ae00640 1 -- 172.21.15.5:0/2382416655 shutdown_connections 2024-08-17T02:24:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.207+0000 7eff0ae00640 1 --2- 172.21.15.5:0/2382416655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff041590b0 0x7eff040b0070 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.207+0000 7eff0ae00640 1 -- 172.21.15.5:0/2382416655 >> 172.21.15.5:0/2382416655 conn(0x7eff04066e60 msgr2=0x7eff04067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.207+0000 7eff0ae00640 1 -- 172.21.15.5:0/2382416655 shutdown_connections 2024-08-17T02:24:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.207+0000 7eff0ae00640 1 -- 172.21.15.5:0/2382416655 wait complete. 2024-08-17T02:24:36.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.208+0000 7eff0ae00640 1 Processor -- start 2024-08-17T02:24:36.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.209+0000 7eff0ae00640 1 -- start start 2024-08-17T02:24:36.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.209+0000 7eff0ae00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff040acf10 0x7eff0414c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:36.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.209+0000 7eff0ae00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff040afca0 0x7eff0414e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:36.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.209+0000 7eff0ae00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff041590b0 0x7eff0414b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:36.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.209+0000 7eff0ae00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0414cbc0 con 0x7eff040afca0 2024-08-17T02:24:36.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.209+0000 7eff0ae00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff04149c60 con 0x7eff040acf10 2024-08-17T02:24:36.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.209+0000 7eff0ae00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0414f200 con 0x7eff041590b0 2024-08-17T02:24:36.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.210+0000 7eff03400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff040afca0 0x7eff0414e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:36.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.210+0000 7eff03400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff040afca0 0x7eff0414e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44010/0 (socket says 172.21.15.5:44010) 2024-08-17T02:24:36.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.210+0000 7eff03400640 1 -- 172.21.15.5:0/1964627713 learned_addr learned my addr 172.21.15.5:0/1964627713 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:36.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.210+0000 7eff08e00640 1 --2- 172.21.15.5:0/1964627713 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff041590b0 0x7eff0414b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:36.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.210+0000 7eff03e00640 1 --2- 172.21.15.5:0/1964627713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff040acf10 0x7eff0414c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.210+0000 7eff03400640 1 -- 172.21.15.5:0/1964627713 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff041590b0 msgr2=0x7eff0414b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.210+0000 7eff03400640 1 --2- 172.21.15.5:0/1964627713 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff041590b0 0x7eff0414b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.210+0000 7eff03400640 1 -- 172.21.15.5:0/1964627713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff040acf10 msgr2=0x7eff0414c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.210+0000 7eff03400640 1 --2- 172.21.15.5:0/1964627713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff040acf10 0x7eff0414c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.210+0000 7eff03400640 1 -- 172.21.15.5:0/1964627713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef0009390 con 0x7eff040afca0 2024-08-17T02:24:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.211+0000 7eff03400640 1 --2- 172.21.15.5:0/1964627713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff040afca0 0x7eff0414e960 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efef0035040 tx=0x7efef0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.211+0000 7efefb400640 1 -- 172.21.15.5:0/1964627713 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef0031e00 con 0x7eff040afca0 2024-08-17T02:24:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.211+0000 7efefb400640 1 -- 172.21.15.5:0/1964627713 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef003e450 con 0x7eff040afca0 2024-08-17T02:24:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.211+0000 7efefb400640 1 -- 172.21.15.5:0/1964627713 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef003e810 con 0x7eff040afca0 2024-08-17T02:24:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.211+0000 7eff0ae00640 1 -- 172.21.15.5:0/1964627713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0414f4e0 con 0x7eff040afca0 2024-08-17T02:24:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.211+0000 7eff0ae00640 1 -- 172.21.15.5:0/1964627713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff04149970 con 0x7eff040afca0 2024-08-17T02:24:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.212+0000 7eff0ae00640 1 -- 172.21.15.5:0/1964627713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0414ef50 con 0x7eff040afca0 2024-08-17T02:24:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.213+0000 7efefb400640 1 -- 172.21.15.5:0/1964627713 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efef003c400 con 0x7eff040afca0 2024-08-17T02:24:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.213+0000 7efefb400640 1 --2- 172.21.15.5:0/1964627713 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7efee4065150 0x7efee4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.214+0000 7efefb400640 1 -- 172.21.15.5:0/1964627713 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efef00a2ae0 con 0x7eff040afca0 2024-08-17T02:24:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.214+0000 7eff03e00640 1 --2- 172.21.15.5:0/1964627713 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7efee4065150 0x7efee4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.214+0000 7eff03e00640 1 --2- 172.21.15.5:0/1964627713 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7efee4065150 0x7efee4067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efef4007880 tx=0x7efef4007e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.218+0000 7efefb400640 1 -- 172.21.15.5:0/1964627713 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efef0070bb0 con 0x7eff040afca0 2024-08-17T02:24:36.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.398+0000 7eff0ae00640 1 -- 172.21.15.5:0/1964627713 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff04063fb0 con 0x7efee4065150 2024-08-17T02:24:36.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.407+0000 7efefb400640 1 -- 172.21.15.5:0/1964627713 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289073 (secure 0 0 0) 0x7eff04063fb0 con 0x7efee4065150 2024-08-17T02:24:36.411 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:36.412 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:24:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.411+0000 7eff0ae00640 1 -- 172.21.15.5:0/1964627713 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7efee4065150 msgr2=0x7efee4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.411+0000 7eff0ae00640 1 --2- 172.21.15.5:0/1964627713 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7efee4065150 0x7efee4067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efef4007880 tx=0x7efef4007e20 comp rx=0 tx=0).stop 2024-08-17T02:24:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.411+0000 7eff0ae00640 1 -- 172.21.15.5:0/1964627713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff040afca0 msgr2=0x7eff0414e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.411+0000 7eff0ae00640 1 --2- 172.21.15.5:0/1964627713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff040afca0 0x7eff0414e960 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efef0035040 tx=0x7efef0032000 comp rx=0 tx=0).stop 2024-08-17T02:24:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.411+0000 7eff0ae00640 1 -- 172.21.15.5:0/1964627713 shutdown_connections 2024-08-17T02:24:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.411+0000 7eff0ae00640 1 --2- 172.21.15.5:0/1964627713 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7efee4065150 0x7efee4067600 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.411+0000 7eff0ae00640 1 --2- 172.21.15.5:0/1964627713 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff041590b0 0x7eff0414b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.411+0000 7eff0ae00640 1 --2- 172.21.15.5:0/1964627713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff040afca0 0x7eff0414e960 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.411+0000 7eff0ae00640 1 --2- 172.21.15.5:0/1964627713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff040acf10 0x7eff0414c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.411+0000 7eff0ae00640 1 -- 172.21.15.5:0/1964627713 >> 172.21.15.5:0/1964627713 conn(0x7eff04066e60 msgr2=0x7eff041482a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:36.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.411+0000 7eff0ae00640 1 -- 172.21.15.5:0/1964627713 shutdown_connections 2024-08-17T02:24:36.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.411+0000 7eff0ae00640 1 -- 172.21.15.5:0/1964627713 wait complete. 2024-08-17T02:24:36.427 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-08-17T02:24:34.732015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":117,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399552,"kb_used_data":4040,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575168,"statfs":{"total":773094113280,"available":770636972032,"internally_reserved":0,"allocated":4136960,"data_stored":2282908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.520132"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.233066+0000","last_change":"2024-08-17T02:24:32.233066+0000","last_active":"2024-08-17T02:24:32.233066+0000","last_peered":"2024-08-17T02:24:32.233066+0000","last_clean":"2024-08-17T02:24:32.233066+0000","last_became_active":"2024-08-17T02:24:32.232743+0000","last_became_peered":"2024-08-17T02:24:32.232743+0000","last_unstale":"2024-08-17T02:24:32.233066+0000","last_undegraded":"2024-08-17T02:24:32.233066+0000","last_fullsized":"2024-08-17T02:24:32.233066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:51.592237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.261174+0000","last_change":"2024-08-17T02:24:32.261174+0000","last_active":"2024-08-17T02:24:32.261174+0000","last_peered":"2024-08-17T02:24:32.261174+0000","last_clean":"2024-08-17T02:24:32.261174+0000","last_became_active":"2024-08-17T02:24:32.260923+0000","last_became_peered":"2024-08-17T02:24:32.260923+0000","last_unstale":"2024-08-17T02:24:32.261174+0000","last_undegraded":"2024-08-17T02:24:32.261174+0000","last_fullsized":"2024-08-17T02:24:32.261174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:21:09.790130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.240468+0000","last_change":"2024-08-17T02:24:32.240468+0000","last_active":"2024-08-17T02:24:32.240468+0000","last_peered":"2024-08-17T02:24:32.240468+0000","last_clean":"2024-08-17T02:24:32.240468+0000","last_became_active":"2024-08-17T02:24:32.236701+0000","last_became_peered":"2024-08-17T02:24:32.236701+0000","last_unstale":"2024-08-17T02:24:32.240468+0000","last_undegraded":"2024-08-17T02:24:32.240468+0000","last_fullsized":"2024-08-17T02:24:32.240468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:04.893220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.245985+0000","last_change":"2024-08-17T02:24:32.245985+0000","last_active":"2024-08-17T02:24:32.245985+0000","last_peered":"2024-08-17T02:24:32.245985+0000","last_clean":"2024-08-17T02:24:32.245985+0000","last_became_active":"2024-08-17T02:24:32.245733+0000","last_became_peered":"2024-08-17T02:24:32.245733+0000","last_unstale":"2024-08-17T02:24:32.245985+0000","last_undegraded":"2024-08-17T02:24:32.245985+0000","last_fullsized":"2024-08-17T02:24:32.245985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:42:51.903381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.252470+0000","last_change":"2024-08-17T02:24:32.252470+0000","last_active":"2024-08-17T02:24:32.252470+0000","last_peered":"2024-08-17T02:24:32.252470+0000","last_clean":"2024-08-17T02:24:32.252470+0000","last_became_active":"2024-08-17T02:24:32.252220+0000","last_became_peered":"2024-08-17T02:24:32.252220+0000","last_unstale":"2024-08-17T02:24:32.252470+0000","last_undegraded":"2024-08-17T02:24:32.252470+0000","last_fullsized":"2024-08-17T02:24:32.252470+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:52.447899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.243089+0000","last_change":"2024-08-17T02:24:32.243089+0000","last_active":"2024-08-17T02:24:32.243089+0000","last_peered":"2024-08-17T02:24:32.243089+0000","last_clean":"2024-08-17T02:24:32.243089+0000","last_became_active":"2024-08-17T02:24:32.234262+0000","last_became_peered":"2024-08-17T02:24:32.234262+0000","last_unstale":"2024-08-17T02:24:32.243089+0000","last_undegraded":"2024-08-17T02:24:32.243089+0000","last_fullsized":"2024-08-17T02:24:32.243089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:55.268800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.240817+0000","last_change":"2024-08-17T02:24:32.240817+0000","last_active":"2024-08-17T02:24:32.240817+0000","last_peered":"2024-08-17T02:24:32.240817+0000","last_clean":"2024-08-17T02:24:32.240817+0000","last_became_active":"2024-08-17T02:24:32.240140+0000","last_became_peered":"2024-08-17T02:24:32.240140+0000","last_unstale":"2024-08-17T02:24:32.240817+0000","last_undegraded":"2024-08-17T02:24:32.240817+0000","last_fullsized":"2024-08-17T02:24:32.240817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:43:05.687647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.248790+0000","last_change":"2024-08-17T02:24:32.248790+0000","last_active":"2024-08-17T02:24:32.248790+0000","last_peered":"2024-08-17T02:24:32.248790+0000","last_clean":"2024-08-17T02:24:32.248790+0000","last_became_active":"2024-08-17T02:24:32.247478+0000","last_became_peered":"2024-08-17T02:24:32.247478+0000","last_unstale":"2024-08-17T02:24:32.248790+0000","last_undegraded":"2024-08-17T02:24:32.248790+0000","last_fullsized":"2024-08-17T02:24:32.248790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:42:51.903381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.246404+0000","last_change":"2024-08-17T02:24:32.246404+0000","last_active":"2024-08-17T02:24:32.246404+0000","last_peered":"2024-08-17T02:24:32.246404+0000","last_clean":"2024-08-17T02:24:32.246404+0000","last_became_active":"2024-08-17T02:24:32.246166+0000","last_became_peered":"2024-08-17T02:24:32.246166+0000","last_unstale":"2024-08-17T02:24:32.246404+0000","last_undegraded":"2024-08-17T02:24:32.246404+0000","last_fullsized":"2024-08-17T02:24:32.246404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:32:33.155892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.249855+0000","last_change":"2024-08-17T02:24:32.249855+0000","last_active":"2024-08-17T02:24:32.249855+0000","last_peered":"2024-08-17T02:24:32.249855+0000","last_clean":"2024-08-17T02:24:32.249855+0000","last_became_active":"2024-08-17T02:24:32.249556+0000","last_became_peered":"2024-08-17T02:24:32.249556+0000","last_unstale":"2024-08-17T02:24:32.249855+0000","last_undegraded":"2024-08-17T02:24:32.249855+0000","last_fullsized":"2024-08-17T02:24:32.249855+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:21:09.499050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.243713+0000","last_change":"2024-08-17T02:24:32.243713+0000","last_active":"2024-08-17T02:24:32.243713+0000","last_peered":"2024-08-17T02:24:32.243713+0000","last_clean":"2024-08-17T02:24:32.243713+0000","last_became_active":"2024-08-17T02:24:32.243451+0000","last_became_peered":"2024-08-17T02:24:32.243451+0000","last_unstale":"2024-08-17T02:24:32.243713+0000","last_undegraded":"2024-08-17T02:24:32.243713+0000","last_fullsized":"2024-08-17T02:24:32.243713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:05.460543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.249334+0000","last_change":"2024-08-17T02:24:32.249334+0000","last_active":"2024-08-17T02:24:32.249334+0000","last_peered":"2024-08-17T02:24:32.249334+0000","last_clean":"2024-08-17T02:24:32.249334+0000","last_became_active":"2024-08-17T02:24:32.249100+0000","last_became_peered":"2024-08-17T02:24:32.249100+0000","last_unstale":"2024-08-17T02:24:32.249334+0000","last_undegraded":"2024-08-17T02:24:32.249334+0000","last_fullsized":"2024-08-17T02:24:32.249334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:43:05.687647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.250261+0000","last_change":"2024-08-17T02:24:32.250261+0000","last_active":"2024-08-17T02:24:32.250261+0000","last_peered":"2024-08-17T02:24:32.250261+0000","last_clean":"2024-08-17T02:24:32.250261+0000","last_became_active":"2024-08-17T02:24:32.249492+0000","last_became_peered":"2024-08-17T02:24:32.249492+0000","last_unstale":"2024-08-17T02:24:32.250261+0000","last_undegraded":"2024-08-17T02:24:32.250261+0000","last_fullsized":"2024-08-17T02:24:32.250261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:11.048875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.249137+0000","last_change":"2024-08-17T02:24:32.249137+0000","last_active":"2024-08-17T02:24:32.249137+0000","last_peered":"2024-08-17T02:24:32.249137+0000","last_clean":"2024-08-17T02:24:32.249137+0000","last_became_active":"2024-08-17T02:24:32.248767+0000","last_became_peered":"2024-08-17T02:24:32.248767+0000","last_unstale":"2024-08-17T02:24:32.249137+0000","last_undegraded":"2024-08-17T02:24:32.249137+0000","last_fullsized":"2024-08-17T02:24:32.249137+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:24:11.697410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.233423+0000","last_change":"2024-08-17T02:24:32.233423+0000","last_active":"2024-08-17T02:24:32.233423+0000","last_peered":"2024-08-17T02:24:32.233423+0000","last_clean":"2024-08-17T02:24:32.233423+0000","last_became_active":"2024-08-17T02:24:32.233152+0000","last_became_peered":"2024-08-17T02:24:32.233152+0000","last_unstale":"2024-08-17T02:24:32.233423+0000","last_undegraded":"2024-08-17T02:24:32.233423+0000","last_fullsized":"2024-08-17T02:24:32.233423+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:41.748027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.247753+0000","last_change":"2024-08-17T02:24:32.247753+0000","last_active":"2024-08-17T02:24:32.247753+0000","last_peered":"2024-08-17T02:24:32.247753+0000","last_clean":"2024-08-17T02:24:32.247753+0000","last_became_active":"2024-08-17T02:24:32.247373+0000","last_became_peered":"2024-08-17T02:24:32.247373+0000","last_unstale":"2024-08-17T02:24:32.247753+0000","last_undegraded":"2024-08-17T02:24:32.247753+0000","last_fullsized":"2024-08-17T02:24:32.247753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:21:09.499050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.239654+0000","last_change":"2024-08-17T02:24:32.239654+0000","last_active":"2024-08-17T02:24:32.239654+0000","last_peered":"2024-08-17T02:24:32.239654+0000","last_clean":"2024-08-17T02:24:32.239654+0000","last_became_active":"2024-08-17T02:24:32.239410+0000","last_became_peered":"2024-08-17T02:24:32.239410+0000","last_unstale":"2024-08-17T02:24:32.239654+0000","last_undegraded":"2024-08-17T02:24:32.239654+0000","last_fullsized":"2024-08-17T02:24:32.239654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:04.893220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.252941+0000","last_change":"2024-08-17T02:24:32.252941+0000","last_active":"2024-08-17T02:24:32.252941+0000","last_peered":"2024-08-17T02:24:32.252941+0000","last_clean":"2024-08-17T02:24:32.252941+0000","last_became_active":"2024-08-17T02:24:32.251937+0000","last_became_peered":"2024-08-17T02:24:32.251937+0000","last_unstale":"2024-08-17T02:24:32.252941+0000","last_undegraded":"2024-08-17T02:24:32.252941+0000","last_fullsized":"2024-08-17T02:24:32.252941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:48:23.931561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.255045+0000","last_change":"2024-08-17T02:24:32.255045+0000","last_active":"2024-08-17T02:24:32.255045+0000","last_peered":"2024-08-17T02:24:32.255045+0000","last_clean":"2024-08-17T02:24:32.255045+0000","last_became_active":"2024-08-17T02:24:32.254813+0000","last_became_peered":"2024-08-17T02:24:32.254813+0000","last_unstale":"2024-08-17T02:24:32.255045+0000","last_undegraded":"2024-08-17T02:24:32.255045+0000","last_fullsized":"2024-08-17T02:24:32.255045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:47:33.583547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.254182+0000","last_change":"2024-08-17T02:24:32.254182+0000","last_active":"2024-08-17T02:24:32.254182+0000","last_peered":"2024-08-17T02:24:32.254182+0000","last_clean":"2024-08-17T02:24:32.254182+0000","last_became_active":"2024-08-17T02:24:32.252282+0000","last_became_peered":"2024-08-17T02:24:32.252282+0000","last_unstale":"2024-08-17T02:24:32.254182+0000","last_undegraded":"2024-08-17T02:24:32.254182+0000","last_fullsized":"2024-08-17T02:24:32.254182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:39.331953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.245846+0000","last_change":"2024-08-17T02:24:32.245846+0000","last_active":"2024-08-17T02:24:32.245846+0000","last_peered":"2024-08-17T02:24:32.245846+0000","last_clean":"2024-08-17T02:24:32.245846+0000","last_became_active":"2024-08-17T02:24:32.245572+0000","last_became_peered":"2024-08-17T02:24:32.245572+0000","last_unstale":"2024-08-17T02:24:32.245846+0000","last_undegraded":"2024-08-17T02:24:32.245846+0000","last_fullsized":"2024-08-17T02:24:32.245846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:32.960871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.255816+0000","last_change":"2024-08-17T02:24:32.255816+0000","last_active":"2024-08-17T02:24:32.255816+0000","last_peered":"2024-08-17T02:24:32.255816+0000","last_clean":"2024-08-17T02:24:32.255816+0000","last_became_active":"2024-08-17T02:24:32.255420+0000","last_became_peered":"2024-08-17T02:24:32.255420+0000","last_unstale":"2024-08-17T02:24:32.255816+0000","last_undegraded":"2024-08-17T02:24:32.255816+0000","last_fullsized":"2024-08-17T02:24:32.255816+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:51:13.077603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.235529+0000","last_change":"2024-08-17T02:24:32.235529+0000","last_active":"2024-08-17T02:24:32.235529+0000","last_peered":"2024-08-17T02:24:32.235529+0000","last_clean":"2024-08-17T02:24:32.235529+0000","last_became_active":"2024-08-17T02:24:32.235211+0000","last_became_peered":"2024-08-17T02:24:32.235211+0000","last_unstale":"2024-08-17T02:24:32.235529+0000","last_undegraded":"2024-08-17T02:24:32.235529+0000","last_fullsized":"2024-08-17T02:24:32.235529+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:40:46.752474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.241584+0000","last_change":"2024-08-17T02:24:32.241584+0000","last_active":"2024-08-17T02:24:32.241584+0000","last_peered":"2024-08-17T02:24:32.241584+0000","last_clean":"2024-08-17T02:24:32.241584+0000","last_became_active":"2024-08-17T02:24:32.241255+0000","last_became_peered":"2024-08-17T02:24:32.241255+0000","last_unstale":"2024-08-17T02:24:32.241584+0000","last_undegraded":"2024-08-17T02:24:32.241584+0000","last_fullsized":"2024-08-17T02:24:32.241584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:30.519447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.256219+0000","last_change":"2024-08-17T02:24:32.256219+0000","last_active":"2024-08-17T02:24:32.256219+0000","last_peered":"2024-08-17T02:24:32.256219+0000","last_clean":"2024-08-17T02:24:32.256219+0000","last_became_active":"2024-08-17T02:24:32.255540+0000","last_became_peered":"2024-08-17T02:24:32.255540+0000","last_unstale":"2024-08-17T02:24:32.256219+0000","last_undegraded":"2024-08-17T02:24:32.256219+0000","last_fullsized":"2024-08-17T02:24:32.256219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:28.193997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.233582+0000","last_change":"2024-08-17T02:24:32.233582+0000","last_active":"2024-08-17T02:24:32.233582+0000","last_peered":"2024-08-17T02:24:32.233582+0000","last_clean":"2024-08-17T02:24:32.233582+0000","last_became_active":"2024-08-17T02:24:32.233383+0000","last_became_peered":"2024-08-17T02:24:32.233383+0000","last_unstale":"2024-08-17T02:24:32.233582+0000","last_undegraded":"2024-08-17T02:24:32.233582+0000","last_fullsized":"2024-08-17T02:24:32.233582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:44:16.869639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.245310+0000","last_change":"2024-08-17T02:24:32.245310+0000","last_active":"2024-08-17T02:24:32.245310+0000","last_peered":"2024-08-17T02:24:32.245310+0000","last_clean":"2024-08-17T02:24:32.245310+0000","last_became_active":"2024-08-17T02:24:32.244313+0000","last_became_peered":"2024-08-17T02:24:32.244313+0000","last_unstale":"2024-08-17T02:24:32.245310+0000","last_undegraded":"2024-08-17T02:24:32.245310+0000","last_fullsized":"2024-08-17T02:24:32.245310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:35:47.059157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.241240+0000","last_change":"2024-08-17T02:24:32.241240+0000","last_active":"2024-08-17T02:24:32.241240+0000","last_peered":"2024-08-17T02:24:32.241240+0000","last_clean":"2024-08-17T02:24:32.241240+0000","last_became_active":"2024-08-17T02:24:32.240924+0000","last_became_peered":"2024-08-17T02:24:32.240924+0000","last_unstale":"2024-08-17T02:24:32.241240+0000","last_undegraded":"2024-08-17T02:24:32.241240+0000","last_fullsized":"2024-08-17T02:24:32.241240+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:05.460543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.258658+0000","last_change":"2024-08-17T02:24:32.258658+0000","last_active":"2024-08-17T02:24:32.258658+0000","last_peered":"2024-08-17T02:24:32.258658+0000","last_clean":"2024-08-17T02:24:32.258658+0000","last_became_active":"2024-08-17T02:24:32.258360+0000","last_became_peered":"2024-08-17T02:24:32.258360+0000","last_unstale":"2024-08-17T02:24:32.258658+0000","last_undegraded":"2024-08-17T02:24:32.258658+0000","last_fullsized":"2024-08-17T02:24:32.258658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:24:01.846334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.237375+0000","last_change":"2024-08-17T02:24:32.237375+0000","last_active":"2024-08-17T02:24:32.237375+0000","last_peered":"2024-08-17T02:24:32.237375+0000","last_clean":"2024-08-17T02:24:32.237375+0000","last_became_active":"2024-08-17T02:24:32.237118+0000","last_became_peered":"2024-08-17T02:24:32.237118+0000","last_unstale":"2024-08-17T02:24:32.237375+0000","last_undegraded":"2024-08-17T02:24:32.237375+0000","last_fullsized":"2024-08-17T02:24:32.237375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:35:47.059157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.246635+0000","last_change":"2024-08-17T02:24:32.246635+0000","last_active":"2024-08-17T02:24:32.246635+0000","last_peered":"2024-08-17T02:24:32.246635+0000","last_clean":"2024-08-17T02:24:32.246635+0000","last_became_active":"2024-08-17T02:24:32.246389+0000","last_became_peered":"2024-08-17T02:24:32.246389+0000","last_unstale":"2024-08-17T02:24:32.246635+0000","last_undegraded":"2024-08-17T02:24:32.246635+0000","last_fullsized":"2024-08-17T02:24:32.246635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:12:26.547049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.242444+0000","last_change":"2024-08-17T02:24:32.242444+0000","last_active":"2024-08-17T02:24:32.242444+0000","last_peered":"2024-08-17T02:24:32.242444+0000","last_clean":"2024-08-17T02:24:32.242444+0000","last_became_active":"2024-08-17T02:24:32.242176+0000","last_became_peered":"2024-08-17T02:24:32.242176+0000","last_unstale":"2024-08-17T02:24:32.242444+0000","last_undegraded":"2024-08-17T02:24:32.242444+0000","last_fullsized":"2024-08-17T02:24:32.242444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:04.838752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.236982+0000","last_change":"2024-08-17T02:24:32.236982+0000","last_active":"2024-08-17T02:24:32.236982+0000","last_peered":"2024-08-17T02:24:32.236982+0000","last_clean":"2024-08-17T02:24:32.236982+0000","last_became_active":"2024-08-17T02:24:32.236586+0000","last_became_peered":"2024-08-17T02:24:32.236586+0000","last_unstale":"2024-08-17T02:24:32.236982+0000","last_undegraded":"2024-08-17T02:24:32.236982+0000","last_fullsized":"2024-08-17T02:24:32.236982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:20.236381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.256628+0000","last_change":"2024-08-17T02:24:31.244994+0000","last_active":"2024-08-17T02:24:32.256628+0000","last_peered":"2024-08-17T02:24:32.256628+0000","last_clean":"2024-08-17T02:24:32.256628+0000","last_became_active":"2024-08-17T02:24:31.244722+0000","last_became_peered":"2024-08-17T02:24:31.244722+0000","last_unstale":"2024-08-17T02:24:32.256628+0000","last_undegraded":"2024-08-17T02:24:32.256628+0000","last_fullsized":"2024-08-17T02:24:32.256628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:51.445216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.248839+0000","last_change":"2024-08-17T02:24:32.248839+0000","last_active":"2024-08-17T02:24:32.248839+0000","last_peered":"2024-08-17T02:24:32.248839+0000","last_clean":"2024-08-17T02:24:32.248839+0000","last_became_active":"2024-08-17T02:24:32.248592+0000","last_became_peered":"2024-08-17T02:24:32.248592+0000","last_unstale":"2024-08-17T02:24:32.248839+0000","last_undegraded":"2024-08-17T02:24:32.248839+0000","last_fullsized":"2024-08-17T02:24:32.248839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:20.532399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.231815+0000","last_change":"2024-08-17T02:24:31.238324+0000","last_active":"2024-08-17T02:24:32.231815+0000","last_peered":"2024-08-17T02:24:32.231815+0000","last_clean":"2024-08-17T02:24:32.231815+0000","last_became_active":"2024-08-17T02:24:31.237730+0000","last_became_peered":"2024-08-17T02:24:31.237730+0000","last_unstale":"2024-08-17T02:24:32.231815+0000","last_undegraded":"2024-08-17T02:24:32.231815+0000","last_fullsized":"2024-08-17T02:24:32.231815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:23:16.147066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.255676+0000","last_change":"2024-08-17T02:24:32.255676+0000","last_active":"2024-08-17T02:24:32.255676+0000","last_peered":"2024-08-17T02:24:32.255676+0000","last_clean":"2024-08-17T02:24:32.255676+0000","last_became_active":"2024-08-17T02:24:32.255351+0000","last_became_peered":"2024-08-17T02:24:32.255351+0000","last_unstale":"2024-08-17T02:24:32.255676+0000","last_undegraded":"2024-08-17T02:24:32.255676+0000","last_fullsized":"2024-08-17T02:24:32.255676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:30.557449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.265078+0000","last_change":"2024-08-17T02:24:31.241177+0000","last_active":"2024-08-17T02:24:32.265078+0000","last_peered":"2024-08-17T02:24:32.265078+0000","last_clean":"2024-08-17T02:24:32.265078+0000","last_became_active":"2024-08-17T02:24:31.240876+0000","last_became_peered":"2024-08-17T02:24:31.240876+0000","last_unstale":"2024-08-17T02:24:32.265078+0000","last_undegraded":"2024-08-17T02:24:32.265078+0000","last_fullsized":"2024-08-17T02:24:32.265078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:02:31.666089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.244594+0000","last_change":"2024-08-17T02:24:32.244594+0000","last_active":"2024-08-17T02:24:32.244594+0000","last_peered":"2024-08-17T02:24:32.244594+0000","last_clean":"2024-08-17T02:24:32.244594+0000","last_became_active":"2024-08-17T02:24:32.243911+0000","last_became_peered":"2024-08-17T02:24:32.243911+0000","last_unstale":"2024-08-17T02:24:32.244594+0000","last_undegraded":"2024-08-17T02:24:32.244594+0000","last_fullsized":"2024-08-17T02:24:32.244594+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:05.460543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.261938+0000","last_change":"2024-08-17T02:24:31.241035+0000","last_active":"2024-08-17T02:24:32.261938+0000","last_peered":"2024-08-17T02:24:32.261938+0000","last_clean":"2024-08-17T02:24:32.261938+0000","last_became_active":"2024-08-17T02:24:31.240771+0000","last_became_peered":"2024-08-17T02:24:31.240771+0000","last_unstale":"2024-08-17T02:24:32.261938+0000","last_undegraded":"2024-08-17T02:24:32.261938+0000","last_fullsized":"2024-08-17T02:24:32.261938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:16.655268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.249779+0000","last_change":"2024-08-17T02:24:32.249779+0000","last_active":"2024-08-17T02:24:32.249779+0000","last_peered":"2024-08-17T02:24:32.249779+0000","last_clean":"2024-08-17T02:24:32.249779+0000","last_became_active":"2024-08-17T02:24:32.249450+0000","last_became_peered":"2024-08-17T02:24:32.249450+0000","last_unstale":"2024-08-17T02:24:32.249779+0000","last_undegraded":"2024-08-17T02:24:32.249779+0000","last_fullsized":"2024-08-17T02:24:32.249779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:41.748027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.236402+0000","last_change":"2024-08-17T02:24:31.234841+0000","last_active":"2024-08-17T02:24:32.236402+0000","last_peered":"2024-08-17T02:24:32.236402+0000","last_clean":"2024-08-17T02:24:32.236402+0000","last_became_active":"2024-08-17T02:24:31.234531+0000","last_became_peered":"2024-08-17T02:24:31.234531+0000","last_unstale":"2024-08-17T02:24:32.236402+0000","last_undegraded":"2024-08-17T02:24:32.236402+0000","last_fullsized":"2024-08-17T02:24:32.236402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:05.952497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.242496+0000","last_change":"2024-08-17T02:24:32.242496+0000","last_active":"2024-08-17T02:24:32.242496+0000","last_peered":"2024-08-17T02:24:32.242496+0000","last_clean":"2024-08-17T02:24:32.242496+0000","last_became_active":"2024-08-17T02:24:32.242216+0000","last_became_peered":"2024-08-17T02:24:32.242216+0000","last_unstale":"2024-08-17T02:24:32.242496+0000","last_undegraded":"2024-08-17T02:24:32.242496+0000","last_fullsized":"2024-08-17T02:24:32.242496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:42:51.903381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.236556+0000","last_change":"2024-08-17T02:24:31.241449+0000","last_active":"2024-08-17T02:24:32.236556+0000","last_peered":"2024-08-17T02:24:32.236556+0000","last_clean":"2024-08-17T02:24:32.236556+0000","last_became_active":"2024-08-17T02:24:31.241171+0000","last_became_peered":"2024-08-17T02:24:31.241171+0000","last_unstale":"2024-08-17T02:24:32.236556+0000","last_undegraded":"2024-08-17T02:24:32.236556+0000","last_fullsized":"2024-08-17T02:24:32.236556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:10.440694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.239495+0000","last_change":"2024-08-17T02:24:32.239495+0000","last_active":"2024-08-17T02:24:32.239495+0000","last_peered":"2024-08-17T02:24:32.239495+0000","last_clean":"2024-08-17T02:24:32.239495+0000","last_became_active":"2024-08-17T02:24:32.239199+0000","last_became_peered":"2024-08-17T02:24:32.239199+0000","last_unstale":"2024-08-17T02:24:32.239495+0000","last_undegraded":"2024-08-17T02:24:32.239495+0000","last_fullsized":"2024-08-17T02:24:32.239495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:35:13.818442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.241921+0000","last_change":"2024-08-17T02:24:31.237585+0000","last_active":"2024-08-17T02:24:31.241921+0000","last_peered":"2024-08-17T02:24:31.241921+0000","last_clean":"2024-08-17T02:24:31.241921+0000","last_became_active":"2024-08-17T02:24:31.237418+0000","last_became_peered":"2024-08-17T02:24:31.237418+0000","last_unstale":"2024-08-17T02:24:31.241921+0000","last_undegraded":"2024-08-17T02:24:31.241921+0000","last_fullsized":"2024-08-17T02:24:31.241921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:37.365650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.241252+0000","last_change":"2024-08-17T02:24:32.241252+0000","last_active":"2024-08-17T02:24:32.241252+0000","last_peered":"2024-08-17T02:24:32.241252+0000","last_clean":"2024-08-17T02:24:32.241252+0000","last_became_active":"2024-08-17T02:24:32.239626+0000","last_became_peered":"2024-08-17T02:24:32.239626+0000","last_unstale":"2024-08-17T02:24:32.241252+0000","last_undegraded":"2024-08-17T02:24:32.241252+0000","last_fullsized":"2024-08-17T02:24:32.241252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:20:45.784759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.241641+0000","last_change":"2024-08-17T02:24:31.237462+0000","last_active":"2024-08-17T02:24:31.241641+0000","last_peered":"2024-08-17T02:24:31.241641+0000","last_clean":"2024-08-17T02:24:31.241641+0000","last_became_active":"2024-08-17T02:24:31.236812+0000","last_became_peered":"2024-08-17T02:24:31.236812+0000","last_unstale":"2024-08-17T02:24:31.241641+0000","last_undegraded":"2024-08-17T02:24:31.241641+0000","last_fullsized":"2024-08-17T02:24:31.241641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:13:49.172910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.240430+0000","last_change":"2024-08-17T02:24:32.240430+0000","last_active":"2024-08-17T02:24:32.240430+0000","last_peered":"2024-08-17T02:24:32.240430+0000","last_clean":"2024-08-17T02:24:32.240430+0000","last_became_active":"2024-08-17T02:24:32.239962+0000","last_became_peered":"2024-08-17T02:24:32.239962+0000","last_unstale":"2024-08-17T02:24:32.240430+0000","last_undegraded":"2024-08-17T02:24:32.240430+0000","last_fullsized":"2024-08-17T02:24:32.240430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:21:09.790130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.245396+0000","last_change":"2024-08-17T02:24:31.244224+0000","last_active":"2024-08-17T02:24:31.245396+0000","last_peered":"2024-08-17T02:24:31.245396+0000","last_clean":"2024-08-17T02:24:31.245396+0000","last_became_active":"2024-08-17T02:24:31.243913+0000","last_became_peered":"2024-08-17T02:24:31.243913+0000","last_unstale":"2024-08-17T02:24:31.245396+0000","last_undegraded":"2024-08-17T02:24:31.245396+0000","last_fullsized":"2024-08-17T02:24:31.245396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:40:45.749791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.256566+0000","last_change":"2024-08-17T02:24:32.256566+0000","last_active":"2024-08-17T02:24:32.256566+0000","last_peered":"2024-08-17T02:24:32.256566+0000","last_clean":"2024-08-17T02:24:32.256566+0000","last_became_active":"2024-08-17T02:24:32.253751+0000","last_became_peered":"2024-08-17T02:24:32.253751+0000","last_unstale":"2024-08-17T02:24:32.256566+0000","last_undegraded":"2024-08-17T02:24:32.256566+0000","last_fullsized":"2024-08-17T02:24:32.256566+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:26:31.026068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.242894+0000","last_change":"2024-08-17T02:24:31.235129+0000","last_active":"2024-08-17T02:24:31.242894+0000","last_peered":"2024-08-17T02:24:31.242894+0000","last_clean":"2024-08-17T02:24:31.242894+0000","last_became_active":"2024-08-17T02:24:31.234617+0000","last_became_peered":"2024-08-17T02:24:31.234617+0000","last_unstale":"2024-08-17T02:24:31.242894+0000","last_undegraded":"2024-08-17T02:24:31.242894+0000","last_fullsized":"2024-08-17T02:24:31.242894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:51.445216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.239857+0000","last_change":"2024-08-17T02:24:32.239857+0000","last_active":"2024-08-17T02:24:32.239857+0000","last_peered":"2024-08-17T02:24:32.239857+0000","last_clean":"2024-08-17T02:24:32.239857+0000","last_became_active":"2024-08-17T02:24:32.239566+0000","last_became_peered":"2024-08-17T02:24:32.239566+0000","last_unstale":"2024-08-17T02:24:32.239857+0000","last_undegraded":"2024-08-17T02:24:32.239857+0000","last_fullsized":"2024-08-17T02:24:32.239857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:03.768455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.254316+0000","last_change":"2024-08-17T02:24:31.243434+0000","last_active":"2024-08-17T02:24:32.254316+0000","last_peered":"2024-08-17T02:24:32.254316+0000","last_clean":"2024-08-17T02:24:32.254316+0000","last_became_active":"2024-08-17T02:24:31.243157+0000","last_became_peered":"2024-08-17T02:24:31.243157+0000","last_unstale":"2024-08-17T02:24:32.254316+0000","last_undegraded":"2024-08-17T02:24:32.254316+0000","last_fullsized":"2024-08-17T02:24:32.254316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:41.587594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.237557+0000","last_change":"2024-08-17T02:24:32.237557+0000","last_active":"2024-08-17T02:24:32.237557+0000","last_peered":"2024-08-17T02:24:32.237557+0000","last_clean":"2024-08-17T02:24:32.237557+0000","last_became_active":"2024-08-17T02:24:32.237275+0000","last_became_peered":"2024-08-17T02:24:32.237275+0000","last_unstale":"2024-08-17T02:24:32.237557+0000","last_undegraded":"2024-08-17T02:24:32.237557+0000","last_fullsized":"2024-08-17T02:24:32.237557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:47:33.583547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.266746+0000","last_change":"2024-08-17T02:24:31.247491+0000","last_active":"2024-08-17T02:24:32.266746+0000","last_peered":"2024-08-17T02:24:32.266746+0000","last_clean":"2024-08-17T02:24:32.266746+0000","last_became_active":"2024-08-17T02:24:31.247204+0000","last_became_peered":"2024-08-17T02:24:31.247204+0000","last_unstale":"2024-08-17T02:24:32.266746+0000","last_undegraded":"2024-08-17T02:24:32.266746+0000","last_fullsized":"2024-08-17T02:24:32.266746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:41.587594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.254306+0000","last_change":"2024-08-17T02:24:32.254306+0000","last_active":"2024-08-17T02:24:32.254306+0000","last_peered":"2024-08-17T02:24:32.254306+0000","last_clean":"2024-08-17T02:24:32.254306+0000","last_became_active":"2024-08-17T02:24:32.254116+0000","last_became_peered":"2024-08-17T02:24:32.254116+0000","last_unstale":"2024-08-17T02:24:32.254306+0000","last_undegraded":"2024-08-17T02:24:32.254306+0000","last_fullsized":"2024-08-17T02:24:32.254306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:04.838752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.257439+0000","last_change":"2024-08-17T02:24:31.232182+0000","last_active":"2024-08-17T02:24:32.257439+0000","last_peered":"2024-08-17T02:24:32.257439+0000","last_clean":"2024-08-17T02:24:32.257439+0000","last_became_active":"2024-08-17T02:24:31.228987+0000","last_became_peered":"2024-08-17T02:24:31.228987+0000","last_unstale":"2024-08-17T02:24:32.257439+0000","last_undegraded":"2024-08-17T02:24:32.257439+0000","last_fullsized":"2024-08-17T02:24:32.257439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:53:30.547970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.257017+0000","last_change":"2024-08-17T02:24:32.257017+0000","last_active":"2024-08-17T02:24:32.257017+0000","last_peered":"2024-08-17T02:24:32.257017+0000","last_clean":"2024-08-17T02:24:32.257017+0000","last_became_active":"2024-08-17T02:24:32.256752+0000","last_became_peered":"2024-08-17T02:24:32.256752+0000","last_unstale":"2024-08-17T02:24:32.257017+0000","last_undegraded":"2024-08-17T02:24:32.257017+0000","last_fullsized":"2024-08-17T02:24:32.257017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:08.749667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.245987+0000","last_change":"2024-08-17T02:24:31.243658+0000","last_active":"2024-08-17T02:24:31.245987+0000","last_peered":"2024-08-17T02:24:31.245987+0000","last_clean":"2024-08-17T02:24:31.245987+0000","last_became_active":"2024-08-17T02:24:31.243335+0000","last_became_peered":"2024-08-17T02:24:31.243335+0000","last_unstale":"2024-08-17T02:24:31.245987+0000","last_undegraded":"2024-08-17T02:24:31.245987+0000","last_fullsized":"2024-08-17T02:24:31.245987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:54.452030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.247981+0000","last_change":"2024-08-17T02:24:32.247981+0000","last_active":"2024-08-17T02:24:32.247981+0000","last_peered":"2024-08-17T02:24:32.247981+0000","last_clean":"2024-08-17T02:24:32.247981+0000","last_became_active":"2024-08-17T02:24:32.247732+0000","last_became_peered":"2024-08-17T02:24:32.247732+0000","last_unstale":"2024-08-17T02:24:32.247981+0000","last_undegraded":"2024-08-17T02:24:32.247981+0000","last_fullsized":"2024-08-17T02:24:32.247981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:20.236381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.244749+0000","last_change":"2024-08-17T02:24:31.242946+0000","last_active":"2024-08-17T02:24:31.244749+0000","last_peered":"2024-08-17T02:24:31.244749+0000","last_clean":"2024-08-17T02:24:31.244749+0000","last_became_active":"2024-08-17T02:24:31.242666+0000","last_became_peered":"2024-08-17T02:24:31.242666+0000","last_unstale":"2024-08-17T02:24:31.244749+0000","last_undegraded":"2024-08-17T02:24:31.244749+0000","last_fullsized":"2024-08-17T02:24:31.244749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:12:25.544365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.241750+0000","last_change":"2024-08-17T02:24:32.241750+0000","last_active":"2024-08-17T02:24:32.241750+0000","last_peered":"2024-08-17T02:24:32.241750+0000","last_clean":"2024-08-17T02:24:32.241750+0000","last_became_active":"2024-08-17T02:24:32.241419+0000","last_became_peered":"2024-08-17T02:24:32.241419+0000","last_unstale":"2024-08-17T02:24:32.241750+0000","last_undegraded":"2024-08-17T02:24:32.241750+0000","last_fullsized":"2024-08-17T02:24:32.241750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:02:32.668772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.266506+0000","last_change":"2024-08-17T02:24:31.239730+0000","last_active":"2024-08-17T02:24:32.266506+0000","last_peered":"2024-08-17T02:24:32.266506+0000","last_clean":"2024-08-17T02:24:32.266506+0000","last_became_active":"2024-08-17T02:24:31.239296+0000","last_became_peered":"2024-08-17T02:24:31.239296+0000","last_unstale":"2024-08-17T02:24:32.266506+0000","last_undegraded":"2024-08-17T02:24:32.266506+0000","last_fullsized":"2024-08-17T02:24:32.266506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:19.529716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.244489+0000","last_change":"2024-08-17T02:24:32.244489+0000","last_active":"2024-08-17T02:24:32.244489+0000","last_peered":"2024-08-17T02:24:32.244489+0000","last_clean":"2024-08-17T02:24:32.244489+0000","last_became_active":"2024-08-17T02:24:32.243583+0000","last_became_peered":"2024-08-17T02:24:32.243583+0000","last_unstale":"2024-08-17T02:24:32.244489+0000","last_undegraded":"2024-08-17T02:24:32.244489+0000","last_fullsized":"2024-08-17T02:24:32.244489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:07.838446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.239126+0000","last_change":"2024-08-17T02:24:31.247412+0000","last_active":"2024-08-17T02:24:32.239126+0000","last_peered":"2024-08-17T02:24:32.239126+0000","last_clean":"2024-08-17T02:24:32.239126+0000","last_became_active":"2024-08-17T02:24:31.246903+0000","last_became_peered":"2024-08-17T02:24:31.246903+0000","last_unstale":"2024-08-17T02:24:32.239126+0000","last_undegraded":"2024-08-17T02:24:32.239126+0000","last_fullsized":"2024-08-17T02:24:32.239126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:10.046192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.245207+0000","last_change":"2024-08-17T02:24:32.245207+0000","last_active":"2024-08-17T02:24:32.245207+0000","last_peered":"2024-08-17T02:24:32.245207+0000","last_clean":"2024-08-17T02:24:32.245207+0000","last_became_active":"2024-08-17T02:24:32.244898+0000","last_became_peered":"2024-08-17T02:24:32.244898+0000","last_unstale":"2024-08-17T02:24:32.245207+0000","last_undegraded":"2024-08-17T02:24:32.245207+0000","last_fullsized":"2024-08-17T02:24:32.245207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:24:11.697410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.257403+0000","last_change":"2024-08-17T02:24:31.237834+0000","last_active":"2024-08-17T02:24:32.257403+0000","last_peered":"2024-08-17T02:24:32.257403+0000","last_clean":"2024-08-17T02:24:32.257403+0000","last_became_active":"2024-08-17T02:24:31.236377+0000","last_became_peered":"2024-08-17T02:24:31.236377+0000","last_unstale":"2024-08-17T02:24:32.257403+0000","last_undegraded":"2024-08-17T02:24:32.257403+0000","last_fullsized":"2024-08-17T02:24:32.257403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:16.991573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.244374+0000","last_change":"2024-08-17T02:24:32.244374+0000","last_active":"2024-08-17T02:24:32.244374+0000","last_peered":"2024-08-17T02:24:32.244374+0000","last_clean":"2024-08-17T02:24:32.244374+0000","last_became_active":"2024-08-17T02:24:32.244122+0000","last_became_peered":"2024-08-17T02:24:32.244122+0000","last_unstale":"2024-08-17T02:24:32.244374+0000","last_undegraded":"2024-08-17T02:24:32.244374+0000","last_fullsized":"2024-08-17T02:24:32.244374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:47.598833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.237330+0000","last_change":"2024-08-17T02:24:31.239583+0000","last_active":"2024-08-17T02:24:32.237330+0000","last_peered":"2024-08-17T02:24:32.237330+0000","last_clean":"2024-08-17T02:24:32.237330+0000","last_became_active":"2024-08-17T02:24:31.238281+0000","last_became_peered":"2024-08-17T02:24:31.238281+0000","last_unstale":"2024-08-17T02:24:32.237330+0000","last_undegraded":"2024-08-17T02:24:32.237330+0000","last_fullsized":"2024-08-17T02:24:32.237330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:26:50.757189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.254641+0000","last_change":"2024-08-17T02:24:32.254641+0000","last_active":"2024-08-17T02:24:32.254641+0000","last_peered":"2024-08-17T02:24:32.254641+0000","last_clean":"2024-08-17T02:24:32.254641+0000","last_became_active":"2024-08-17T02:24:32.253131+0000","last_became_peered":"2024-08-17T02:24:32.253131+0000","last_unstale":"2024-08-17T02:24:32.254641+0000","last_undegraded":"2024-08-17T02:24:32.254641+0000","last_fullsized":"2024-08-17T02:24:32.254641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:25:21.559975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.240883+0000","last_change":"2024-08-17T02:24:31.235351+0000","last_active":"2024-08-17T02:24:31.240883+0000","last_peered":"2024-08-17T02:24:31.240883+0000","last_clean":"2024-08-17T02:24:31.240883+0000","last_became_active":"2024-08-17T02:24:31.235132+0000","last_became_peered":"2024-08-17T02:24:31.235132+0000","last_unstale":"2024-08-17T02:24:31.240883+0000","last_undegraded":"2024-08-17T02:24:31.240883+0000","last_fullsized":"2024-08-17T02:24:31.240883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:41.490737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.247184+0000","last_change":"2024-08-17T02:24:32.247184+0000","last_active":"2024-08-17T02:24:32.247184+0000","last_peered":"2024-08-17T02:24:32.247184+0000","last_clean":"2024-08-17T02:24:32.247184+0000","last_became_active":"2024-08-17T02:24:32.246840+0000","last_became_peered":"2024-08-17T02:24:32.246840+0000","last_unstale":"2024-08-17T02:24:32.247184+0000","last_undegraded":"2024-08-17T02:24:32.247184+0000","last_fullsized":"2024-08-17T02:24:32.247184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:05:37.221744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.250359+0000","last_change":"2024-08-17T02:24:31.238199+0000","last_active":"2024-08-17T02:24:32.250359+0000","last_peered":"2024-08-17T02:24:32.250359+0000","last_clean":"2024-08-17T02:24:32.250359+0000","last_became_active":"2024-08-17T02:24:31.236391+0000","last_became_peered":"2024-08-17T02:24:31.236391+0000","last_unstale":"2024-08-17T02:24:32.250359+0000","last_undegraded":"2024-08-17T02:24:32.250359+0000","last_fullsized":"2024-08-17T02:24:32.250359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:38.329270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.259068+0000","last_change":"2024-08-17T02:24:32.259068+0000","last_active":"2024-08-17T02:24:32.259068+0000","last_peered":"2024-08-17T02:24:32.259068+0000","last_clean":"2024-08-17T02:24:32.259068+0000","last_became_active":"2024-08-17T02:24:32.258815+0000","last_became_peered":"2024-08-17T02:24:32.258815+0000","last_unstale":"2024-08-17T02:24:32.259068+0000","last_undegraded":"2024-08-17T02:24:32.259068+0000","last_fullsized":"2024-08-17T02:24:32.259068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:59.902289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.243617+0000","last_change":"2024-08-17T02:24:31.241007+0000","last_active":"2024-08-17T02:24:31.243617+0000","last_peered":"2024-08-17T02:24:31.243617+0000","last_clean":"2024-08-17T02:24:31.243617+0000","last_became_active":"2024-08-17T02:24:31.240754+0000","last_became_peered":"2024-08-17T02:24:31.240754+0000","last_unstale":"2024-08-17T02:24:31.243617+0000","last_undegraded":"2024-08-17T02:24:31.243617+0000","last_fullsized":"2024-08-17T02:24:31.243617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:27.261535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.251458+0000","last_change":"2024-08-17T02:24:32.251458+0000","last_active":"2024-08-17T02:24:32.251458+0000","last_peered":"2024-08-17T02:24:32.251458+0000","last_clean":"2024-08-17T02:24:32.251458+0000","last_became_active":"2024-08-17T02:24:32.251219+0000","last_became_peered":"2024-08-17T02:24:32.251219+0000","last_unstale":"2024-08-17T02:24:32.251458+0000","last_undegraded":"2024-08-17T02:24:32.251458+0000","last_fullsized":"2024-08-17T02:24:32.251458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:28.264218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.242649+0000","last_change":"2024-08-17T02:24:31.237122+0000","last_active":"2024-08-17T02:24:31.242649+0000","last_peered":"2024-08-17T02:24:31.242649+0000","last_clean":"2024-08-17T02:24:31.242649+0000","last_became_active":"2024-08-17T02:24:31.231919+0000","last_became_peered":"2024-08-17T02:24:31.231919+0000","last_unstale":"2024-08-17T02:24:31.242649+0000","last_undegraded":"2024-08-17T02:24:31.242649+0000","last_fullsized":"2024-08-17T02:24:31.242649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:09:54.110700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.241006+0000","last_change":"2024-08-17T02:24:32.241006+0000","last_active":"2024-08-17T02:24:32.241006+0000","last_peered":"2024-08-17T02:24:32.241006+0000","last_clean":"2024-08-17T02:24:32.241006+0000","last_became_active":"2024-08-17T02:24:32.240507+0000","last_became_peered":"2024-08-17T02:24:32.240507+0000","last_unstale":"2024-08-17T02:24:32.241006+0000","last_undegraded":"2024-08-17T02:24:32.241006+0000","last_fullsized":"2024-08-17T02:24:32.241006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:30.519447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.245438+0000","last_change":"2024-08-17T02:24:31.241403+0000","last_active":"2024-08-17T02:24:31.245438+0000","last_peered":"2024-08-17T02:24:31.245438+0000","last_clean":"2024-08-17T02:24:31.245438+0000","last_became_active":"2024-08-17T02:24:31.241152+0000","last_became_peered":"2024-08-17T02:24:31.241152+0000","last_unstale":"2024-08-17T02:24:31.245438+0000","last_undegraded":"2024-08-17T02:24:31.245438+0000","last_fullsized":"2024-08-17T02:24:31.245438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:37.365650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.247955+0000","last_change":"2024-08-17T02:24:32.247955+0000","last_active":"2024-08-17T02:24:32.247955+0000","last_peered":"2024-08-17T02:24:32.247955+0000","last_clean":"2024-08-17T02:24:32.247955+0000","last_became_active":"2024-08-17T02:24:32.247685+0000","last_became_peered":"2024-08-17T02:24:32.247685+0000","last_unstale":"2024-08-17T02:24:32.247955+0000","last_undegraded":"2024-08-17T02:24:32.247955+0000","last_fullsized":"2024-08-17T02:24:32.247955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:55.454713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.247807+0000","last_change":"2024-08-17T02:24:31.247537+0000","last_active":"2024-08-17T02:24:32.247807+0000","last_peered":"2024-08-17T02:24:32.247807+0000","last_clean":"2024-08-17T02:24:32.247807+0000","last_became_active":"2024-08-17T02:24:31.247267+0000","last_became_peered":"2024-08-17T02:24:31.247267+0000","last_unstale":"2024-08-17T02:24:32.247807+0000","last_undegraded":"2024-08-17T02:24:32.247807+0000","last_fullsized":"2024-08-17T02:24:32.247807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:23:16.147066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.240897+0000","last_change":"2024-08-17T02:24:32.240897+0000","last_active":"2024-08-17T02:24:32.240897+0000","last_peered":"2024-08-17T02:24:32.240897+0000","last_clean":"2024-08-17T02:24:32.240897+0000","last_became_active":"2024-08-17T02:24:32.240620+0000","last_became_peered":"2024-08-17T02:24:32.240620+0000","last_unstale":"2024-08-17T02:24:32.240897+0000","last_undegraded":"2024-08-17T02:24:32.240897+0000","last_fullsized":"2024-08-17T02:24:32.240897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:35:47.059157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.243280+0000","last_change":"2024-08-17T02:24:31.237602+0000","last_active":"2024-08-17T02:24:31.243280+0000","last_peered":"2024-08-17T02:24:31.243280+0000","last_clean":"2024-08-17T02:24:31.243280+0000","last_became_active":"2024-08-17T02:24:31.236786+0000","last_became_peered":"2024-08-17T02:24:31.236786+0000","last_unstale":"2024-08-17T02:24:31.243280+0000","last_undegraded":"2024-08-17T02:24:31.243280+0000","last_fullsized":"2024-08-17T02:24:31.243280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:10.046192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.243584+0000","last_change":"2024-08-17T02:24:32.243584+0000","last_active":"2024-08-17T02:24:32.243584+0000","last_peered":"2024-08-17T02:24:32.243584+0000","last_clean":"2024-08-17T02:24:32.243584+0000","last_became_active":"2024-08-17T02:24:32.240944+0000","last_became_peered":"2024-08-17T02:24:32.240944+0000","last_unstale":"2024-08-17T02:24:32.243584+0000","last_undegraded":"2024-08-17T02:24:32.243584+0000","last_fullsized":"2024-08-17T02:24:32.243584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:41.748027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.245854+0000","last_change":"2024-08-17T02:24:31.239531+0000","last_active":"2024-08-17T02:24:31.245854+0000","last_peered":"2024-08-17T02:24:31.245854+0000","last_clean":"2024-08-17T02:24:31.245854+0000","last_became_active":"2024-08-17T02:24:31.239198+0000","last_became_peered":"2024-08-17T02:24:31.239198+0000","last_unstale":"2024-08-17T02:24:31.245854+0000","last_undegraded":"2024-08-17T02:24:31.245854+0000","last_fullsized":"2024-08-17T02:24:31.245854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:38.329270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.246085+0000","last_change":"2024-08-17T02:24:32.246085+0000","last_active":"2024-08-17T02:24:32.246085+0000","last_peered":"2024-08-17T02:24:32.246085+0000","last_clean":"2024-08-17T02:24:32.246085+0000","last_became_active":"2024-08-17T02:24:32.245824+0000","last_became_peered":"2024-08-17T02:24:32.245824+0000","last_unstale":"2024-08-17T02:24:32.246085+0000","last_undegraded":"2024-08-17T02:24:32.246085+0000","last_fullsized":"2024-08-17T02:24:32.246085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:42.590278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.244956+0000","last_change":"2024-08-17T02:24:31.243761+0000","last_active":"2024-08-17T02:24:31.244956+0000","last_peered":"2024-08-17T02:24:31.244956+0000","last_clean":"2024-08-17T02:24:31.244956+0000","last_became_active":"2024-08-17T02:24:31.243479+0000","last_became_peered":"2024-08-17T02:24:31.243479+0000","last_unstale":"2024-08-17T02:24:31.244956+0000","last_undegraded":"2024-08-17T02:24:31.244956+0000","last_fullsized":"2024-08-17T02:24:31.244956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:54.452030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.241228+0000","last_change":"2024-08-17T02:24:32.241228+0000","last_active":"2024-08-17T02:24:32.241228+0000","last_peered":"2024-08-17T02:24:32.241228+0000","last_clean":"2024-08-17T02:24:32.241228+0000","last_became_active":"2024-08-17T02:24:32.240964+0000","last_became_peered":"2024-08-17T02:24:32.240964+0000","last_unstale":"2024-08-17T02:24:32.241228+0000","last_undegraded":"2024-08-17T02:24:32.241228+0000","last_fullsized":"2024-08-17T02:24:32.241228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:12:26.547049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.249040+0000","last_change":"2024-08-17T02:24:31.247409+0000","last_active":"2024-08-17T02:24:31.249040+0000","last_peered":"2024-08-17T02:24:31.249040+0000","last_clean":"2024-08-17T02:24:31.249040+0000","last_became_active":"2024-08-17T02:24:31.247147+0000","last_became_peered":"2024-08-17T02:24:31.247147+0000","last_unstale":"2024-08-17T02:24:31.249040+0000","last_undegraded":"2024-08-17T02:24:31.249040+0000","last_fullsized":"2024-08-17T02:24:31.249040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:45.781609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.233899+0000","last_change":"2024-08-17T02:24:32.233899+0000","last_active":"2024-08-17T02:24:32.233899+0000","last_peered":"2024-08-17T02:24:32.233899+0000","last_clean":"2024-08-17T02:24:32.233899+0000","last_became_active":"2024-08-17T02:24:32.232071+0000","last_became_peered":"2024-08-17T02:24:32.232071+0000","last_unstale":"2024-08-17T02:24:32.233899+0000","last_undegraded":"2024-08-17T02:24:32.233899+0000","last_fullsized":"2024-08-17T02:24:32.233899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:43:05.687647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.244003+0000","last_change":"2024-08-17T02:24:31.241841+0000","last_active":"2024-08-17T02:24:31.244003+0000","last_peered":"2024-08-17T02:24:31.244003+0000","last_clean":"2024-08-17T02:24:31.244003+0000","last_became_active":"2024-08-17T02:24:31.241482+0000","last_became_peered":"2024-08-17T02:24:31.241482+0000","last_unstale":"2024-08-17T02:24:31.244003+0000","last_undegraded":"2024-08-17T02:24:31.244003+0000","last_fullsized":"2024-08-17T02:24:31.244003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:28.165917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.256938+0000","last_change":"2024-08-17T02:24:32.256938+0000","last_active":"2024-08-17T02:24:32.256938+0000","last_peered":"2024-08-17T02:24:32.256938+0000","last_clean":"2024-08-17T02:24:32.256938+0000","last_became_active":"2024-08-17T02:24:32.256492+0000","last_became_peered":"2024-08-17T02:24:32.256492+0000","last_unstale":"2024-08-17T02:24:32.256938+0000","last_undegraded":"2024-08-17T02:24:32.256938+0000","last_fullsized":"2024-08-17T02:24:32.256938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:53:11.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.242180+0000","last_change":"2024-08-17T02:24:31.239543+0000","last_active":"2024-08-17T02:24:31.242180+0000","last_peered":"2024-08-17T02:24:31.242180+0000","last_clean":"2024-08-17T02:24:31.242180+0000","last_became_active":"2024-08-17T02:24:31.238983+0000","last_became_peered":"2024-08-17T02:24:31.238983+0000","last_unstale":"2024-08-17T02:24:31.242180+0000","last_undegraded":"2024-08-17T02:24:31.242180+0000","last_fullsized":"2024-08-17T02:24:31.242180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:50.589554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.251069+0000","last_change":"2024-08-17T02:24:32.251069+0000","last_active":"2024-08-17T02:24:32.251069+0000","last_peered":"2024-08-17T02:24:32.251069+0000","last_clean":"2024-08-17T02:24:32.251069+0000","last_became_active":"2024-08-17T02:24:32.249128+0000","last_became_peered":"2024-08-17T02:24:32.249128+0000","last_unstale":"2024-08-17T02:24:32.251069+0000","last_undegraded":"2024-08-17T02:24:32.251069+0000","last_fullsized":"2024-08-17T02:24:32.251069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:28.193997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.242207+0000","last_change":"2024-08-17T02:24:31.236644+0000","last_active":"2024-08-17T02:24:31.242207+0000","last_peered":"2024-08-17T02:24:31.242207+0000","last_clean":"2024-08-17T02:24:31.242207+0000","last_became_active":"2024-08-17T02:24:31.234130+0000","last_became_peered":"2024-08-17T02:24:31.234130+0000","last_unstale":"2024-08-17T02:24:31.242207+0000","last_undegraded":"2024-08-17T02:24:31.242207+0000","last_fullsized":"2024-08-17T02:24:31.242207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:25:20.557291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.238389+0000","last_change":"2024-08-17T02:23:30.651033+0000","last_active":"2024-08-17T02:24:31.238389+0000","last_peered":"2024-08-17T02:24:31.238389+0000","last_clean":"2024-08-17T02:24:31.238389+0000","last_became_active":"2024-08-17T02:23:30.649860+0000","last_became_peered":"2024-08-17T02:23:30.649860+0000","last_unstale":"2024-08-17T02:24:31.238389+0000","last_undegraded":"2024-08-17T02:24:31.238389+0000","last_fullsized":"2024-08-17T02:24:31.238389+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.523857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:29:35.288625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298288,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073552,"statfs":{"total":96636764160,"available":96331317248,"internally_reserved":0,"allocated":950272,"data_stored":724276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.77700000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.78600000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.73099999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.90400000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.749}]},{"osd":5,"last update":"Sat Aug 17 02:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.60899999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.83699999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":376832,"data_stored":141275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.69899999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":3.444,"5min":3.444,"15min":3.444},"last":0.46200000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.4009999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":4.4249999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":0.751}]},{"osd":3,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.61799999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.85399999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.79500000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":356352,"data_stored":133908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.80400000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.499},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.65300000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":3.3340000000000001,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":0.78600000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.5670000000000002,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.751},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.665,"5min":3.665,"15min":3.665},"last":0.84099999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.87}]},{"osd":6,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.90300000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.97399999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":376832,"data_stored":140775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.627},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.70399999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.58399999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.56999999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.745},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.72499999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64300000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.66300000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.65000000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":385024,"data_stored":142245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:24:30 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.501}]},{"osd":1,"last update":"Sat Aug 17 02:24:30 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.47499999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:24:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.52100000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:24:30 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.629}]},{"osd":5,"last update":"Sat Aug 17 02:24:30 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.65800000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:24:30 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.68400000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:24:30 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.57899999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301868,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069972,"statfs":{"total":96636764160,"available":96327651328,"internally_reserved":0,"allocated":356352,"data_stored":133908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.40300000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42799999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.47999999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.69399999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":0.67000000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.83299999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":0.77900000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542160,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":385024,"data_stored":142245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.376}]},{"osd":2,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.7149999999999999,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.432},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":3.7360000000000002,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":0.49399999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.6070000000000002,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":0.41499999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.544,"5min":2.544,"15min":2.544},"last":0.60899999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.6480000000000001,"5min":3.6480000000000001,"15min":3.6480000000000001},"last":0.75}]},{"osd":5,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.625},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.4630000000000001,"5min":2.4630000000000001,"15min":2.4630000000000001},"last":0.73699999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":3.7000000000000002,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":0.66400000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.5550000000000002,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.63700000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542160,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":950272,"data_stored":724276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.40699999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.499}]},{"osd":3,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":0.59999999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.432}]},{"osd":5,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.62}]},{"osd":6,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.70499999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.72099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:24:36.432 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:24:36.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.618+0000 7fa6e1600640 1 Processor -- start 2024-08-17T02:24:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.618+0000 7fa6e1600640 1 -- start start 2024-08-17T02:24:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.619+0000 7fa6e1600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6dc0acf10 0x7fa6dc0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.619+0000 7fa6e1600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6dc0c92b0 con 0x7fa6dc0afca0 2024-08-17T02:24:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.619+0000 7fa6e1600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6dc0ad480 con 0x7fa6dc1590b0 2024-08-17T02:24:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.619+0000 7fa6e1600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc0b0980 con 0x7fa6dc0acf10 2024-08-17T02:24:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.619+0000 7fa6daa00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa6dc0afca0 0x7fa6dc1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55734/0 (socket says 172.21.15.5:55734) 2024-08-17T02:24:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.620+0000 7fa6daa00640 1 -- 172.21.15.5:0/2564442925 learned_addr learned my addr 172.21.15.5:0/2564442925 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.620+0000 7fa6db400640 1 --2- 172.21.15.5:0/2564442925 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6dc0acf10 0x7fa6dc0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.620+0000 7fa6d9600640 1 -- 172.21.15.5:0/2564442925 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320460104 0 0) 0x7fa6dc0c92b0 con 0x7fa6dc0afca0 2024-08-17T02:24:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.620+0000 7fa6d9600640 1 -- 172.21.15.5:0/2564442925 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6c00034e0 con 0x7fa6dc0afca0 2024-08-17T02:24:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.620+0000 7fa6d9600640 1 -- 172.21.15.5:0/2564442925 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527864896 0 0) 0x7fa6dc0ad480 con 0x7fa6dc1590b0 2024-08-17T02:24:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.620+0000 7fa6d9600640 1 -- 172.21.15.5:0/2564442925 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6dc0c92b0 con 0x7fa6dc1590b0 2024-08-17T02:24:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.620+0000 7fa6d9600640 1 -- 172.21.15.5:0/2564442925 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1130307831 0 0) 0x7fa6c00034e0 con 0x7fa6dc0afca0 2024-08-17T02:24:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.620+0000 7fa6d9600640 1 -- 172.21.15.5:0/2564442925 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6dc0acf10 msgr2=0x7fa6dc0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.620+0000 7fa6d9600640 1 --2- 172.21.15.5:0/2564442925 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6dc0acf10 0x7fa6dc0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.620+0000 7fa6d9600640 1 -- 172.21.15.5:0/2564442925 >> v1:172.21.15.87:6789/0 conn(0x7fa6dc1590b0 legacy=0x7fa6dc0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.620+0000 7fa6d9600640 1 -- 172.21.15.5:0/2564442925 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc0ad760 con 0x7fa6dc0afca0 2024-08-17T02:24:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.620+0000 7fa6d9600640 1 -- 172.21.15.5:0/2564442925 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2658686246 0 0) 0x7fa6cc001470 con 0x7fa6dc0afca0 2024-08-17T02:24:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.620+0000 7fa6db400640 1 --2- 172.21.15.5:0/2564442925 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6dc0acf10 0x7fa6dc0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.620+0000 7fa6d9600640 1 -- 172.21.15.5:0/2564442925 >> v1:172.21.15.5:6789/0 conn(0x7fa6dc0afca0 legacy=0x7fa6dc1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.620+0000 7fa6d9600640 1 --2- 172.21.15.5:0/2564442925 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6dc0acf10 0x7fa6c0003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.621+0000 7fa6d9600640 1 --2- 172.21.15.5:0/2564442925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6c00040d0 0x7fa6c0004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.621+0000 7fa6d9600640 1 --2- 172.21.15.5:0/2564442925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c0004cc0 0x7fa6c0005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:36.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.621+0000 7fa6d9600640 1 -- 172.21.15.5:0/2564442925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c000bae0 con 0x7fa6c0004cc0 2024-08-17T02:24:36.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.621+0000 7fa6d9600640 1 -- 172.21.15.5:0/2564442925 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c000bc50 con 0x7fa6c00040d0 2024-08-17T02:24:36.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.621+0000 7fa6d9600640 1 -- 172.21.15.5:0/2564442925 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c000e020 con 0x7fa6dc0acf10 2024-08-17T02:24:36.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.621+0000 7fa6db400640 1 --2- 172.21.15.5:0/2564442925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c0004cc0 0x7fa6c0005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:36.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.621+0000 7fa6daa00640 1 --2- 172.21.15.5:0/2564442925 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6dc0acf10 0x7fa6c0003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:36.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.621+0000 7fa6da000640 1 --2- 172.21.15.5:0/2564442925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6c00040d0 0x7fa6c0004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:36.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.621+0000 7fa6db400640 1 -- 172.21.15.5:0/2564442925 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6dc0acf10 msgr2=0x7fa6c0003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:36.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.621+0000 7fa6db400640 1 --2- 172.21.15.5:0/2564442925 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6dc0acf10 0x7fa6c0003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.621+0000 7fa6db400640 1 -- 172.21.15.5:0/2564442925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6c00040d0 msgr2=0x7fa6c0004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:36.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.621+0000 7fa6db400640 1 --2- 172.21.15.5:0/2564442925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6c00040d0 0x7fa6c0004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.621+0000 7fa6db400640 1 -- 172.21.15.5:0/2564442925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d4009a20 con 0x7fa6c0004cc0 2024-08-17T02:24:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.622+0000 7fa6db400640 1 --2- 172.21.15.5:0/2564442925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c0004cc0 0x7fa6c0005130 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0ad3b0 tx=0x7fa6d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f21681f17f2a661 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.622+0000 7fa6d9600640 1 -- 172.21.15.5:0/2564442925 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d402f470 con 0x7fa6c0004cc0 2024-08-17T02:24:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.622+0000 7fa6d9600640 1 -- 172.21.15.5:0/2564442925 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d400f040 con 0x7fa6c0004cc0 2024-08-17T02:24:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.622+0000 7fa6d9600640 1 -- 172.21.15.5:0/2564442925 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d402f7e0 con 0x7fa6c0004cc0 2024-08-17T02:24:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.623+0000 7fa6e1600640 1 -- 172.21.15.5:0/2564442925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c0004cc0 msgr2=0x7fa6c0005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.623+0000 7fa6e1600640 1 --2- 172.21.15.5:0/2564442925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c0004cc0 0x7fa6c0005130 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0ad3b0 tx=0x7fa6d400b040 comp rx=0 tx=0).stop 2024-08-17T02:24:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.623+0000 7fa6db400640 1 -- 172.21.15.5:0/2564442925 reap_dead start 2024-08-17T02:24:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.623+0000 7fa6e1600640 1 -- 172.21.15.5:0/2564442925 shutdown_connections 2024-08-17T02:24:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.623+0000 7fa6e1600640 1 -- 172.21.15.5:0/2564442925 >> 172.21.15.5:0/2564442925 conn(0x7fa6dc066e60 msgr2=0x7fa6dc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.623+0000 7fa6e1600640 1 -- 172.21.15.5:0/2564442925 shutdown_connections 2024-08-17T02:24:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.623+0000 7fa6e1600640 1 -- 172.21.15.5:0/2564442925 wait complete. 2024-08-17T02:24:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.624+0000 7fa6e1600640 1 Processor -- start 2024-08-17T02:24:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.625+0000 7fa6e1600640 1 -- start start 2024-08-17T02:24:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.625+0000 7fa6e1600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c0004cc0 0x7fa6dc169b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.625+0000 7fa6e1600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6dc15a5e0 0x7fa6dc15dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.625+0000 7fa6e1600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6dc15b080 0x7fa6dc15b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.625+0000 7fa6e1600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc15ba40 con 0x7fa6c0004cc0 2024-08-17T02:24:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.625+0000 7fa6e1600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc15d840 con 0x7fa6dc15b080 2024-08-17T02:24:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.625+0000 7fa6e1600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc16a0b0 con 0x7fa6dc15a5e0 2024-08-17T02:24:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.626+0000 7fa6daa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c0004cc0 0x7fa6dc169b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.626+0000 7fa6daa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c0004cc0 0x7fa6dc169b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44038/0 (socket says 172.21.15.5:44038) 2024-08-17T02:24:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.626+0000 7fa6daa00640 1 -- 172.21.15.5:0/418096485 learned_addr learned my addr 172.21.15.5:0/418096485 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.626+0000 7fa6db400640 1 --2- 172.21.15.5:0/418096485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6dc15b080 0x7fa6dc15b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.626+0000 7fa6da000640 1 --2- 172.21.15.5:0/418096485 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6dc15a5e0 0x7fa6dc15dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.626+0000 7fa6daa00640 1 -- 172.21.15.5:0/418096485 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6dc15a5e0 msgr2=0x7fa6dc15dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.626+0000 7fa6daa00640 1 --2- 172.21.15.5:0/418096485 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6dc15a5e0 0x7fa6dc15dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.626+0000 7fa6daa00640 1 -- 172.21.15.5:0/418096485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6dc15b080 msgr2=0x7fa6dc15b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.626+0000 7fa6daa00640 1 --2- 172.21.15.5:0/418096485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6dc15b080 0x7fa6dc15b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.626+0000 7fa6daa00640 1 -- 172.21.15.5:0/418096485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc157a60 con 0x7fa6c0004cc0 2024-08-17T02:24:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.626+0000 7fa6db400640 1 --2- 172.21.15.5:0/418096485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6dc15b080 0x7fa6dc15b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:36.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.626+0000 7fa6daa00640 1 --2- 172.21.15.5:0/418096485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c0004cc0 0x7fa6dc169b70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc007390 tx=0x7fa6dc06b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:36.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.627+0000 7fa6d2000640 1 -- 172.21.15.5:0/418096485 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc018030 con 0x7fa6c0004cc0 2024-08-17T02:24:36.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.627+0000 7fa6d2000640 1 -- 172.21.15.5:0/418096485 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6cc00f9c0 con 0x7fa6c0004cc0 2024-08-17T02:24:36.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.627+0000 7fa6d2000640 1 -- 172.21.15.5:0/418096485 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc00fd60 con 0x7fa6c0004cc0 2024-08-17T02:24:36.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.627+0000 7fa6e1600640 1 -- 172.21.15.5:0/418096485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6dc157d40 con 0x7fa6c0004cc0 2024-08-17T02:24:36.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.627+0000 7fa6e1600640 1 -- 172.21.15.5:0/418096485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6dc15d4d0 con 0x7fa6c0004cc0 2024-08-17T02:24:36.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.628+0000 7fa6e1600640 1 -- 172.21.15.5:0/418096485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6dc063fb0 con 0x7fa6c0004cc0 2024-08-17T02:24:36.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.629+0000 7fa6d2000640 1 -- 172.21.15.5:0/418096485 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa6cc01b070 con 0x7fa6c0004cc0 2024-08-17T02:24:36.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.629+0000 7fa6d2000640 1 --2- 172.21.15.5:0/418096485 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa6bc065150 0x7fa6bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:36.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.629+0000 7fa6d2000640 1 -- 172.21.15.5:0/418096485 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa6cc019070 con 0x7fa6c0004cc0 2024-08-17T02:24:36.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.630+0000 7fa6da000640 1 --2- 172.21.15.5:0/418096485 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa6bc065150 0x7fa6bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:36.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.630+0000 7fa6da000640 1 --2- 172.21.15.5:0/418096485 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa6bc065150 0x7fa6bc067600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8007fd0 tx=0x7fa6c8007ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:36.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.633+0000 7fa6d2000640 1 -- 172.21.15.5:0/418096485 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa6cc050320 con 0x7fa6c0004cc0 2024-08-17T02:24:36.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.816+0000 7fa6e1600640 1 -- 172.21.15.5:0/418096485 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6dc15d070 con 0x7fa6bc065150 2024-08-17T02:24:36.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.823+0000 7fa6d2000640 1 -- 172.21.15.5:0/418096485 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289073 (secure 0 0 0) 0x7fa6c8003d50 con 0x7fa6bc065150 2024-08-17T02:24:36.827 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:36.828 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:24:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.827+0000 7fa6e1600640 1 -- 172.21.15.5:0/418096485 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa6bc065150 msgr2=0x7fa6bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.827+0000 7fa6e1600640 1 --2- 172.21.15.5:0/418096485 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa6bc065150 0x7fa6bc067600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8007fd0 tx=0x7fa6c8007ca0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.827+0000 7fa6e1600640 1 -- 172.21.15.5:0/418096485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c0004cc0 msgr2=0x7fa6dc169b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.827+0000 7fa6e1600640 1 --2- 172.21.15.5:0/418096485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c0004cc0 0x7fa6dc169b70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc007390 tx=0x7fa6dc06b930 comp rx=0 tx=0).stop 2024-08-17T02:24:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.827+0000 7fa6e1600640 1 -- 172.21.15.5:0/418096485 shutdown_connections 2024-08-17T02:24:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.827+0000 7fa6e1600640 1 --2- 172.21.15.5:0/418096485 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa6bc065150 0x7fa6bc067600 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.827+0000 7fa6e1600640 1 --2- 172.21.15.5:0/418096485 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6dc15a5e0 0x7fa6dc15dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.827+0000 7fa6e1600640 1 --2- 172.21.15.5:0/418096485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6dc15b080 0x7fa6dc15b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.827+0000 7fa6e1600640 1 --2- 172.21.15.5:0/418096485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6c0004cc0 0x7fa6dc169b70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.827+0000 7fa6e1600640 1 -- 172.21.15.5:0/418096485 >> 172.21.15.5:0/418096485 conn(0x7fa6dc066e60 msgr2=0x7fa6dc069830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.828+0000 7fa6e1600640 1 -- 172.21.15.5:0/418096485 shutdown_connections 2024-08-17T02:24:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:36.828+0000 7fa6e1600640 1 -- 172.21.15.5:0/418096485 wait complete. 2024-08-17T02:24:36.844 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-08-17T02:24:36.732263+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":117,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399552,"kb_used_data":4040,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575168,"statfs":{"total":773094113280,"available":770636972032,"internally_reserved":0,"allocated":4136960,"data_stored":2282908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000964"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.233066+0000","last_change":"2024-08-17T02:24:32.233066+0000","last_active":"2024-08-17T02:24:32.233066+0000","last_peered":"2024-08-17T02:24:32.233066+0000","last_clean":"2024-08-17T02:24:32.233066+0000","last_became_active":"2024-08-17T02:24:32.232743+0000","last_became_peered":"2024-08-17T02:24:32.232743+0000","last_unstale":"2024-08-17T02:24:32.233066+0000","last_undegraded":"2024-08-17T02:24:32.233066+0000","last_fullsized":"2024-08-17T02:24:32.233066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:51.592237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.261174+0000","last_change":"2024-08-17T02:24:32.261174+0000","last_active":"2024-08-17T02:24:32.261174+0000","last_peered":"2024-08-17T02:24:32.261174+0000","last_clean":"2024-08-17T02:24:32.261174+0000","last_became_active":"2024-08-17T02:24:32.260923+0000","last_became_peered":"2024-08-17T02:24:32.260923+0000","last_unstale":"2024-08-17T02:24:32.261174+0000","last_undegraded":"2024-08-17T02:24:32.261174+0000","last_fullsized":"2024-08-17T02:24:32.261174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:21:09.790130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.240468+0000","last_change":"2024-08-17T02:24:32.240468+0000","last_active":"2024-08-17T02:24:32.240468+0000","last_peered":"2024-08-17T02:24:32.240468+0000","last_clean":"2024-08-17T02:24:32.240468+0000","last_became_active":"2024-08-17T02:24:32.236701+0000","last_became_peered":"2024-08-17T02:24:32.236701+0000","last_unstale":"2024-08-17T02:24:32.240468+0000","last_undegraded":"2024-08-17T02:24:32.240468+0000","last_fullsized":"2024-08-17T02:24:32.240468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:04.893220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.245985+0000","last_change":"2024-08-17T02:24:32.245985+0000","last_active":"2024-08-17T02:24:32.245985+0000","last_peered":"2024-08-17T02:24:32.245985+0000","last_clean":"2024-08-17T02:24:32.245985+0000","last_became_active":"2024-08-17T02:24:32.245733+0000","last_became_peered":"2024-08-17T02:24:32.245733+0000","last_unstale":"2024-08-17T02:24:32.245985+0000","last_undegraded":"2024-08-17T02:24:32.245985+0000","last_fullsized":"2024-08-17T02:24:32.245985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:42:51.903381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.252470+0000","last_change":"2024-08-17T02:24:32.252470+0000","last_active":"2024-08-17T02:24:32.252470+0000","last_peered":"2024-08-17T02:24:32.252470+0000","last_clean":"2024-08-17T02:24:32.252470+0000","last_became_active":"2024-08-17T02:24:32.252220+0000","last_became_peered":"2024-08-17T02:24:32.252220+0000","last_unstale":"2024-08-17T02:24:32.252470+0000","last_undegraded":"2024-08-17T02:24:32.252470+0000","last_fullsized":"2024-08-17T02:24:32.252470+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:52.447899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.243089+0000","last_change":"2024-08-17T02:24:32.243089+0000","last_active":"2024-08-17T02:24:32.243089+0000","last_peered":"2024-08-17T02:24:32.243089+0000","last_clean":"2024-08-17T02:24:32.243089+0000","last_became_active":"2024-08-17T02:24:32.234262+0000","last_became_peered":"2024-08-17T02:24:32.234262+0000","last_unstale":"2024-08-17T02:24:32.243089+0000","last_undegraded":"2024-08-17T02:24:32.243089+0000","last_fullsized":"2024-08-17T02:24:32.243089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:55.268800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.240817+0000","last_change":"2024-08-17T02:24:32.240817+0000","last_active":"2024-08-17T02:24:32.240817+0000","last_peered":"2024-08-17T02:24:32.240817+0000","last_clean":"2024-08-17T02:24:32.240817+0000","last_became_active":"2024-08-17T02:24:32.240140+0000","last_became_peered":"2024-08-17T02:24:32.240140+0000","last_unstale":"2024-08-17T02:24:32.240817+0000","last_undegraded":"2024-08-17T02:24:32.240817+0000","last_fullsized":"2024-08-17T02:24:32.240817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:43:05.687647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.248790+0000","last_change":"2024-08-17T02:24:32.248790+0000","last_active":"2024-08-17T02:24:32.248790+0000","last_peered":"2024-08-17T02:24:32.248790+0000","last_clean":"2024-08-17T02:24:32.248790+0000","last_became_active":"2024-08-17T02:24:32.247478+0000","last_became_peered":"2024-08-17T02:24:32.247478+0000","last_unstale":"2024-08-17T02:24:32.248790+0000","last_undegraded":"2024-08-17T02:24:32.248790+0000","last_fullsized":"2024-08-17T02:24:32.248790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:42:51.903381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.246404+0000","last_change":"2024-08-17T02:24:32.246404+0000","last_active":"2024-08-17T02:24:32.246404+0000","last_peered":"2024-08-17T02:24:32.246404+0000","last_clean":"2024-08-17T02:24:32.246404+0000","last_became_active":"2024-08-17T02:24:32.246166+0000","last_became_peered":"2024-08-17T02:24:32.246166+0000","last_unstale":"2024-08-17T02:24:32.246404+0000","last_undegraded":"2024-08-17T02:24:32.246404+0000","last_fullsized":"2024-08-17T02:24:32.246404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:32:33.155892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.249855+0000","last_change":"2024-08-17T02:24:32.249855+0000","last_active":"2024-08-17T02:24:32.249855+0000","last_peered":"2024-08-17T02:24:32.249855+0000","last_clean":"2024-08-17T02:24:32.249855+0000","last_became_active":"2024-08-17T02:24:32.249556+0000","last_became_peered":"2024-08-17T02:24:32.249556+0000","last_unstale":"2024-08-17T02:24:32.249855+0000","last_undegraded":"2024-08-17T02:24:32.249855+0000","last_fullsized":"2024-08-17T02:24:32.249855+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:21:09.499050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.243713+0000","last_change":"2024-08-17T02:24:32.243713+0000","last_active":"2024-08-17T02:24:32.243713+0000","last_peered":"2024-08-17T02:24:32.243713+0000","last_clean":"2024-08-17T02:24:32.243713+0000","last_became_active":"2024-08-17T02:24:32.243451+0000","last_became_peered":"2024-08-17T02:24:32.243451+0000","last_unstale":"2024-08-17T02:24:32.243713+0000","last_undegraded":"2024-08-17T02:24:32.243713+0000","last_fullsized":"2024-08-17T02:24:32.243713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:05.460543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.249334+0000","last_change":"2024-08-17T02:24:32.249334+0000","last_active":"2024-08-17T02:24:32.249334+0000","last_peered":"2024-08-17T02:24:32.249334+0000","last_clean":"2024-08-17T02:24:32.249334+0000","last_became_active":"2024-08-17T02:24:32.249100+0000","last_became_peered":"2024-08-17T02:24:32.249100+0000","last_unstale":"2024-08-17T02:24:32.249334+0000","last_undegraded":"2024-08-17T02:24:32.249334+0000","last_fullsized":"2024-08-17T02:24:32.249334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:43:05.687647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.250261+0000","last_change":"2024-08-17T02:24:32.250261+0000","last_active":"2024-08-17T02:24:32.250261+0000","last_peered":"2024-08-17T02:24:32.250261+0000","last_clean":"2024-08-17T02:24:32.250261+0000","last_became_active":"2024-08-17T02:24:32.249492+0000","last_became_peered":"2024-08-17T02:24:32.249492+0000","last_unstale":"2024-08-17T02:24:32.250261+0000","last_undegraded":"2024-08-17T02:24:32.250261+0000","last_fullsized":"2024-08-17T02:24:32.250261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:11.048875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.249137+0000","last_change":"2024-08-17T02:24:32.249137+0000","last_active":"2024-08-17T02:24:32.249137+0000","last_peered":"2024-08-17T02:24:32.249137+0000","last_clean":"2024-08-17T02:24:32.249137+0000","last_became_active":"2024-08-17T02:24:32.248767+0000","last_became_peered":"2024-08-17T02:24:32.248767+0000","last_unstale":"2024-08-17T02:24:32.249137+0000","last_undegraded":"2024-08-17T02:24:32.249137+0000","last_fullsized":"2024-08-17T02:24:32.249137+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:24:11.697410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.233423+0000","last_change":"2024-08-17T02:24:32.233423+0000","last_active":"2024-08-17T02:24:32.233423+0000","last_peered":"2024-08-17T02:24:32.233423+0000","last_clean":"2024-08-17T02:24:32.233423+0000","last_became_active":"2024-08-17T02:24:32.233152+0000","last_became_peered":"2024-08-17T02:24:32.233152+0000","last_unstale":"2024-08-17T02:24:32.233423+0000","last_undegraded":"2024-08-17T02:24:32.233423+0000","last_fullsized":"2024-08-17T02:24:32.233423+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:41.748027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.247753+0000","last_change":"2024-08-17T02:24:32.247753+0000","last_active":"2024-08-17T02:24:32.247753+0000","last_peered":"2024-08-17T02:24:32.247753+0000","last_clean":"2024-08-17T02:24:32.247753+0000","last_became_active":"2024-08-17T02:24:32.247373+0000","last_became_peered":"2024-08-17T02:24:32.247373+0000","last_unstale":"2024-08-17T02:24:32.247753+0000","last_undegraded":"2024-08-17T02:24:32.247753+0000","last_fullsized":"2024-08-17T02:24:32.247753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:21:09.499050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.239654+0000","last_change":"2024-08-17T02:24:32.239654+0000","last_active":"2024-08-17T02:24:32.239654+0000","last_peered":"2024-08-17T02:24:32.239654+0000","last_clean":"2024-08-17T02:24:32.239654+0000","last_became_active":"2024-08-17T02:24:32.239410+0000","last_became_peered":"2024-08-17T02:24:32.239410+0000","last_unstale":"2024-08-17T02:24:32.239654+0000","last_undegraded":"2024-08-17T02:24:32.239654+0000","last_fullsized":"2024-08-17T02:24:32.239654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:04.893220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.252941+0000","last_change":"2024-08-17T02:24:32.252941+0000","last_active":"2024-08-17T02:24:32.252941+0000","last_peered":"2024-08-17T02:24:32.252941+0000","last_clean":"2024-08-17T02:24:32.252941+0000","last_became_active":"2024-08-17T02:24:32.251937+0000","last_became_peered":"2024-08-17T02:24:32.251937+0000","last_unstale":"2024-08-17T02:24:32.252941+0000","last_undegraded":"2024-08-17T02:24:32.252941+0000","last_fullsized":"2024-08-17T02:24:32.252941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:48:23.931561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.255045+0000","last_change":"2024-08-17T02:24:32.255045+0000","last_active":"2024-08-17T02:24:32.255045+0000","last_peered":"2024-08-17T02:24:32.255045+0000","last_clean":"2024-08-17T02:24:32.255045+0000","last_became_active":"2024-08-17T02:24:32.254813+0000","last_became_peered":"2024-08-17T02:24:32.254813+0000","last_unstale":"2024-08-17T02:24:32.255045+0000","last_undegraded":"2024-08-17T02:24:32.255045+0000","last_fullsized":"2024-08-17T02:24:32.255045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:47:33.583547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.254182+0000","last_change":"2024-08-17T02:24:32.254182+0000","last_active":"2024-08-17T02:24:32.254182+0000","last_peered":"2024-08-17T02:24:32.254182+0000","last_clean":"2024-08-17T02:24:32.254182+0000","last_became_active":"2024-08-17T02:24:32.252282+0000","last_became_peered":"2024-08-17T02:24:32.252282+0000","last_unstale":"2024-08-17T02:24:32.254182+0000","last_undegraded":"2024-08-17T02:24:32.254182+0000","last_fullsized":"2024-08-17T02:24:32.254182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:39.331953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.245846+0000","last_change":"2024-08-17T02:24:32.245846+0000","last_active":"2024-08-17T02:24:32.245846+0000","last_peered":"2024-08-17T02:24:32.245846+0000","last_clean":"2024-08-17T02:24:32.245846+0000","last_became_active":"2024-08-17T02:24:32.245572+0000","last_became_peered":"2024-08-17T02:24:32.245572+0000","last_unstale":"2024-08-17T02:24:32.245846+0000","last_undegraded":"2024-08-17T02:24:32.245846+0000","last_fullsized":"2024-08-17T02:24:32.245846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:32.960871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.255816+0000","last_change":"2024-08-17T02:24:32.255816+0000","last_active":"2024-08-17T02:24:32.255816+0000","last_peered":"2024-08-17T02:24:32.255816+0000","last_clean":"2024-08-17T02:24:32.255816+0000","last_became_active":"2024-08-17T02:24:32.255420+0000","last_became_peered":"2024-08-17T02:24:32.255420+0000","last_unstale":"2024-08-17T02:24:32.255816+0000","last_undegraded":"2024-08-17T02:24:32.255816+0000","last_fullsized":"2024-08-17T02:24:32.255816+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:51:13.077603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.235529+0000","last_change":"2024-08-17T02:24:32.235529+0000","last_active":"2024-08-17T02:24:32.235529+0000","last_peered":"2024-08-17T02:24:32.235529+0000","last_clean":"2024-08-17T02:24:32.235529+0000","last_became_active":"2024-08-17T02:24:32.235211+0000","last_became_peered":"2024-08-17T02:24:32.235211+0000","last_unstale":"2024-08-17T02:24:32.235529+0000","last_undegraded":"2024-08-17T02:24:32.235529+0000","last_fullsized":"2024-08-17T02:24:32.235529+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:40:46.752474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.241584+0000","last_change":"2024-08-17T02:24:32.241584+0000","last_active":"2024-08-17T02:24:32.241584+0000","last_peered":"2024-08-17T02:24:32.241584+0000","last_clean":"2024-08-17T02:24:32.241584+0000","last_became_active":"2024-08-17T02:24:32.241255+0000","last_became_peered":"2024-08-17T02:24:32.241255+0000","last_unstale":"2024-08-17T02:24:32.241584+0000","last_undegraded":"2024-08-17T02:24:32.241584+0000","last_fullsized":"2024-08-17T02:24:32.241584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:30.519447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.256219+0000","last_change":"2024-08-17T02:24:32.256219+0000","last_active":"2024-08-17T02:24:32.256219+0000","last_peered":"2024-08-17T02:24:32.256219+0000","last_clean":"2024-08-17T02:24:32.256219+0000","last_became_active":"2024-08-17T02:24:32.255540+0000","last_became_peered":"2024-08-17T02:24:32.255540+0000","last_unstale":"2024-08-17T02:24:32.256219+0000","last_undegraded":"2024-08-17T02:24:32.256219+0000","last_fullsized":"2024-08-17T02:24:32.256219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:28.193997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.233582+0000","last_change":"2024-08-17T02:24:32.233582+0000","last_active":"2024-08-17T02:24:32.233582+0000","last_peered":"2024-08-17T02:24:32.233582+0000","last_clean":"2024-08-17T02:24:32.233582+0000","last_became_active":"2024-08-17T02:24:32.233383+0000","last_became_peered":"2024-08-17T02:24:32.233383+0000","last_unstale":"2024-08-17T02:24:32.233582+0000","last_undegraded":"2024-08-17T02:24:32.233582+0000","last_fullsized":"2024-08-17T02:24:32.233582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:44:16.869639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.245310+0000","last_change":"2024-08-17T02:24:32.245310+0000","last_active":"2024-08-17T02:24:32.245310+0000","last_peered":"2024-08-17T02:24:32.245310+0000","last_clean":"2024-08-17T02:24:32.245310+0000","last_became_active":"2024-08-17T02:24:32.244313+0000","last_became_peered":"2024-08-17T02:24:32.244313+0000","last_unstale":"2024-08-17T02:24:32.245310+0000","last_undegraded":"2024-08-17T02:24:32.245310+0000","last_fullsized":"2024-08-17T02:24:32.245310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:35:47.059157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.241240+0000","last_change":"2024-08-17T02:24:32.241240+0000","last_active":"2024-08-17T02:24:32.241240+0000","last_peered":"2024-08-17T02:24:32.241240+0000","last_clean":"2024-08-17T02:24:32.241240+0000","last_became_active":"2024-08-17T02:24:32.240924+0000","last_became_peered":"2024-08-17T02:24:32.240924+0000","last_unstale":"2024-08-17T02:24:32.241240+0000","last_undegraded":"2024-08-17T02:24:32.241240+0000","last_fullsized":"2024-08-17T02:24:32.241240+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:05.460543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.258658+0000","last_change":"2024-08-17T02:24:32.258658+0000","last_active":"2024-08-17T02:24:32.258658+0000","last_peered":"2024-08-17T02:24:32.258658+0000","last_clean":"2024-08-17T02:24:32.258658+0000","last_became_active":"2024-08-17T02:24:32.258360+0000","last_became_peered":"2024-08-17T02:24:32.258360+0000","last_unstale":"2024-08-17T02:24:32.258658+0000","last_undegraded":"2024-08-17T02:24:32.258658+0000","last_fullsized":"2024-08-17T02:24:32.258658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:24:01.846334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.237375+0000","last_change":"2024-08-17T02:24:32.237375+0000","last_active":"2024-08-17T02:24:32.237375+0000","last_peered":"2024-08-17T02:24:32.237375+0000","last_clean":"2024-08-17T02:24:32.237375+0000","last_became_active":"2024-08-17T02:24:32.237118+0000","last_became_peered":"2024-08-17T02:24:32.237118+0000","last_unstale":"2024-08-17T02:24:32.237375+0000","last_undegraded":"2024-08-17T02:24:32.237375+0000","last_fullsized":"2024-08-17T02:24:32.237375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:35:47.059157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.246635+0000","last_change":"2024-08-17T02:24:32.246635+0000","last_active":"2024-08-17T02:24:32.246635+0000","last_peered":"2024-08-17T02:24:32.246635+0000","last_clean":"2024-08-17T02:24:32.246635+0000","last_became_active":"2024-08-17T02:24:32.246389+0000","last_became_peered":"2024-08-17T02:24:32.246389+0000","last_unstale":"2024-08-17T02:24:32.246635+0000","last_undegraded":"2024-08-17T02:24:32.246635+0000","last_fullsized":"2024-08-17T02:24:32.246635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:12:26.547049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.242444+0000","last_change":"2024-08-17T02:24:32.242444+0000","last_active":"2024-08-17T02:24:32.242444+0000","last_peered":"2024-08-17T02:24:32.242444+0000","last_clean":"2024-08-17T02:24:32.242444+0000","last_became_active":"2024-08-17T02:24:32.242176+0000","last_became_peered":"2024-08-17T02:24:32.242176+0000","last_unstale":"2024-08-17T02:24:32.242444+0000","last_undegraded":"2024-08-17T02:24:32.242444+0000","last_fullsized":"2024-08-17T02:24:32.242444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:04.838752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.236982+0000","last_change":"2024-08-17T02:24:32.236982+0000","last_active":"2024-08-17T02:24:32.236982+0000","last_peered":"2024-08-17T02:24:32.236982+0000","last_clean":"2024-08-17T02:24:32.236982+0000","last_became_active":"2024-08-17T02:24:32.236586+0000","last_became_peered":"2024-08-17T02:24:32.236586+0000","last_unstale":"2024-08-17T02:24:32.236982+0000","last_undegraded":"2024-08-17T02:24:32.236982+0000","last_fullsized":"2024-08-17T02:24:32.236982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:20.236381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.256628+0000","last_change":"2024-08-17T02:24:31.244994+0000","last_active":"2024-08-17T02:24:32.256628+0000","last_peered":"2024-08-17T02:24:32.256628+0000","last_clean":"2024-08-17T02:24:32.256628+0000","last_became_active":"2024-08-17T02:24:31.244722+0000","last_became_peered":"2024-08-17T02:24:31.244722+0000","last_unstale":"2024-08-17T02:24:32.256628+0000","last_undegraded":"2024-08-17T02:24:32.256628+0000","last_fullsized":"2024-08-17T02:24:32.256628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:51.445216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.248839+0000","last_change":"2024-08-17T02:24:32.248839+0000","last_active":"2024-08-17T02:24:32.248839+0000","last_peered":"2024-08-17T02:24:32.248839+0000","last_clean":"2024-08-17T02:24:32.248839+0000","last_became_active":"2024-08-17T02:24:32.248592+0000","last_became_peered":"2024-08-17T02:24:32.248592+0000","last_unstale":"2024-08-17T02:24:32.248839+0000","last_undegraded":"2024-08-17T02:24:32.248839+0000","last_fullsized":"2024-08-17T02:24:32.248839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:20.532399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.231815+0000","last_change":"2024-08-17T02:24:31.238324+0000","last_active":"2024-08-17T02:24:32.231815+0000","last_peered":"2024-08-17T02:24:32.231815+0000","last_clean":"2024-08-17T02:24:32.231815+0000","last_became_active":"2024-08-17T02:24:31.237730+0000","last_became_peered":"2024-08-17T02:24:31.237730+0000","last_unstale":"2024-08-17T02:24:32.231815+0000","last_undegraded":"2024-08-17T02:24:32.231815+0000","last_fullsized":"2024-08-17T02:24:32.231815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:23:16.147066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.255676+0000","last_change":"2024-08-17T02:24:32.255676+0000","last_active":"2024-08-17T02:24:32.255676+0000","last_peered":"2024-08-17T02:24:32.255676+0000","last_clean":"2024-08-17T02:24:32.255676+0000","last_became_active":"2024-08-17T02:24:32.255351+0000","last_became_peered":"2024-08-17T02:24:32.255351+0000","last_unstale":"2024-08-17T02:24:32.255676+0000","last_undegraded":"2024-08-17T02:24:32.255676+0000","last_fullsized":"2024-08-17T02:24:32.255676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:30.557449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.265078+0000","last_change":"2024-08-17T02:24:31.241177+0000","last_active":"2024-08-17T02:24:32.265078+0000","last_peered":"2024-08-17T02:24:32.265078+0000","last_clean":"2024-08-17T02:24:32.265078+0000","last_became_active":"2024-08-17T02:24:31.240876+0000","last_became_peered":"2024-08-17T02:24:31.240876+0000","last_unstale":"2024-08-17T02:24:32.265078+0000","last_undegraded":"2024-08-17T02:24:32.265078+0000","last_fullsized":"2024-08-17T02:24:32.265078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:02:31.666089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.244594+0000","last_change":"2024-08-17T02:24:32.244594+0000","last_active":"2024-08-17T02:24:32.244594+0000","last_peered":"2024-08-17T02:24:32.244594+0000","last_clean":"2024-08-17T02:24:32.244594+0000","last_became_active":"2024-08-17T02:24:32.243911+0000","last_became_peered":"2024-08-17T02:24:32.243911+0000","last_unstale":"2024-08-17T02:24:32.244594+0000","last_undegraded":"2024-08-17T02:24:32.244594+0000","last_fullsized":"2024-08-17T02:24:32.244594+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:05.460543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.261938+0000","last_change":"2024-08-17T02:24:31.241035+0000","last_active":"2024-08-17T02:24:32.261938+0000","last_peered":"2024-08-17T02:24:32.261938+0000","last_clean":"2024-08-17T02:24:32.261938+0000","last_became_active":"2024-08-17T02:24:31.240771+0000","last_became_peered":"2024-08-17T02:24:31.240771+0000","last_unstale":"2024-08-17T02:24:32.261938+0000","last_undegraded":"2024-08-17T02:24:32.261938+0000","last_fullsized":"2024-08-17T02:24:32.261938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:16.655268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.249779+0000","last_change":"2024-08-17T02:24:32.249779+0000","last_active":"2024-08-17T02:24:32.249779+0000","last_peered":"2024-08-17T02:24:32.249779+0000","last_clean":"2024-08-17T02:24:32.249779+0000","last_became_active":"2024-08-17T02:24:32.249450+0000","last_became_peered":"2024-08-17T02:24:32.249450+0000","last_unstale":"2024-08-17T02:24:32.249779+0000","last_undegraded":"2024-08-17T02:24:32.249779+0000","last_fullsized":"2024-08-17T02:24:32.249779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:41.748027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.236402+0000","last_change":"2024-08-17T02:24:31.234841+0000","last_active":"2024-08-17T02:24:32.236402+0000","last_peered":"2024-08-17T02:24:32.236402+0000","last_clean":"2024-08-17T02:24:32.236402+0000","last_became_active":"2024-08-17T02:24:31.234531+0000","last_became_peered":"2024-08-17T02:24:31.234531+0000","last_unstale":"2024-08-17T02:24:32.236402+0000","last_undegraded":"2024-08-17T02:24:32.236402+0000","last_fullsized":"2024-08-17T02:24:32.236402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:05.952497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.242496+0000","last_change":"2024-08-17T02:24:32.242496+0000","last_active":"2024-08-17T02:24:32.242496+0000","last_peered":"2024-08-17T02:24:32.242496+0000","last_clean":"2024-08-17T02:24:32.242496+0000","last_became_active":"2024-08-17T02:24:32.242216+0000","last_became_peered":"2024-08-17T02:24:32.242216+0000","last_unstale":"2024-08-17T02:24:32.242496+0000","last_undegraded":"2024-08-17T02:24:32.242496+0000","last_fullsized":"2024-08-17T02:24:32.242496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:42:51.903381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.236556+0000","last_change":"2024-08-17T02:24:31.241449+0000","last_active":"2024-08-17T02:24:32.236556+0000","last_peered":"2024-08-17T02:24:32.236556+0000","last_clean":"2024-08-17T02:24:32.236556+0000","last_became_active":"2024-08-17T02:24:31.241171+0000","last_became_peered":"2024-08-17T02:24:31.241171+0000","last_unstale":"2024-08-17T02:24:32.236556+0000","last_undegraded":"2024-08-17T02:24:32.236556+0000","last_fullsized":"2024-08-17T02:24:32.236556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:10.440694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.239495+0000","last_change":"2024-08-17T02:24:32.239495+0000","last_active":"2024-08-17T02:24:32.239495+0000","last_peered":"2024-08-17T02:24:32.239495+0000","last_clean":"2024-08-17T02:24:32.239495+0000","last_became_active":"2024-08-17T02:24:32.239199+0000","last_became_peered":"2024-08-17T02:24:32.239199+0000","last_unstale":"2024-08-17T02:24:32.239495+0000","last_undegraded":"2024-08-17T02:24:32.239495+0000","last_fullsized":"2024-08-17T02:24:32.239495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:35:13.818442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.241921+0000","last_change":"2024-08-17T02:24:31.237585+0000","last_active":"2024-08-17T02:24:31.241921+0000","last_peered":"2024-08-17T02:24:31.241921+0000","last_clean":"2024-08-17T02:24:31.241921+0000","last_became_active":"2024-08-17T02:24:31.237418+0000","last_became_peered":"2024-08-17T02:24:31.237418+0000","last_unstale":"2024-08-17T02:24:31.241921+0000","last_undegraded":"2024-08-17T02:24:31.241921+0000","last_fullsized":"2024-08-17T02:24:31.241921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:37.365650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.241252+0000","last_change":"2024-08-17T02:24:32.241252+0000","last_active":"2024-08-17T02:24:32.241252+0000","last_peered":"2024-08-17T02:24:32.241252+0000","last_clean":"2024-08-17T02:24:32.241252+0000","last_became_active":"2024-08-17T02:24:32.239626+0000","last_became_peered":"2024-08-17T02:24:32.239626+0000","last_unstale":"2024-08-17T02:24:32.241252+0000","last_undegraded":"2024-08-17T02:24:32.241252+0000","last_fullsized":"2024-08-17T02:24:32.241252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:20:45.784759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.241641+0000","last_change":"2024-08-17T02:24:31.237462+0000","last_active":"2024-08-17T02:24:31.241641+0000","last_peered":"2024-08-17T02:24:31.241641+0000","last_clean":"2024-08-17T02:24:31.241641+0000","last_became_active":"2024-08-17T02:24:31.236812+0000","last_became_peered":"2024-08-17T02:24:31.236812+0000","last_unstale":"2024-08-17T02:24:31.241641+0000","last_undegraded":"2024-08-17T02:24:31.241641+0000","last_fullsized":"2024-08-17T02:24:31.241641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:13:49.172910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.240430+0000","last_change":"2024-08-17T02:24:32.240430+0000","last_active":"2024-08-17T02:24:32.240430+0000","last_peered":"2024-08-17T02:24:32.240430+0000","last_clean":"2024-08-17T02:24:32.240430+0000","last_became_active":"2024-08-17T02:24:32.239962+0000","last_became_peered":"2024-08-17T02:24:32.239962+0000","last_unstale":"2024-08-17T02:24:32.240430+0000","last_undegraded":"2024-08-17T02:24:32.240430+0000","last_fullsized":"2024-08-17T02:24:32.240430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:21:09.790130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.245396+0000","last_change":"2024-08-17T02:24:31.244224+0000","last_active":"2024-08-17T02:24:31.245396+0000","last_peered":"2024-08-17T02:24:31.245396+0000","last_clean":"2024-08-17T02:24:31.245396+0000","last_became_active":"2024-08-17T02:24:31.243913+0000","last_became_peered":"2024-08-17T02:24:31.243913+0000","last_unstale":"2024-08-17T02:24:31.245396+0000","last_undegraded":"2024-08-17T02:24:31.245396+0000","last_fullsized":"2024-08-17T02:24:31.245396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:40:45.749791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.256566+0000","last_change":"2024-08-17T02:24:32.256566+0000","last_active":"2024-08-17T02:24:32.256566+0000","last_peered":"2024-08-17T02:24:32.256566+0000","last_clean":"2024-08-17T02:24:32.256566+0000","last_became_active":"2024-08-17T02:24:32.253751+0000","last_became_peered":"2024-08-17T02:24:32.253751+0000","last_unstale":"2024-08-17T02:24:32.256566+0000","last_undegraded":"2024-08-17T02:24:32.256566+0000","last_fullsized":"2024-08-17T02:24:32.256566+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:26:31.026068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.242894+0000","last_change":"2024-08-17T02:24:31.235129+0000","last_active":"2024-08-17T02:24:31.242894+0000","last_peered":"2024-08-17T02:24:31.242894+0000","last_clean":"2024-08-17T02:24:31.242894+0000","last_became_active":"2024-08-17T02:24:31.234617+0000","last_became_peered":"2024-08-17T02:24:31.234617+0000","last_unstale":"2024-08-17T02:24:31.242894+0000","last_undegraded":"2024-08-17T02:24:31.242894+0000","last_fullsized":"2024-08-17T02:24:31.242894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:51.445216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.239857+0000","last_change":"2024-08-17T02:24:32.239857+0000","last_active":"2024-08-17T02:24:32.239857+0000","last_peered":"2024-08-17T02:24:32.239857+0000","last_clean":"2024-08-17T02:24:32.239857+0000","last_became_active":"2024-08-17T02:24:32.239566+0000","last_became_peered":"2024-08-17T02:24:32.239566+0000","last_unstale":"2024-08-17T02:24:32.239857+0000","last_undegraded":"2024-08-17T02:24:32.239857+0000","last_fullsized":"2024-08-17T02:24:32.239857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:03.768455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.254316+0000","last_change":"2024-08-17T02:24:31.243434+0000","last_active":"2024-08-17T02:24:32.254316+0000","last_peered":"2024-08-17T02:24:32.254316+0000","last_clean":"2024-08-17T02:24:32.254316+0000","last_became_active":"2024-08-17T02:24:31.243157+0000","last_became_peered":"2024-08-17T02:24:31.243157+0000","last_unstale":"2024-08-17T02:24:32.254316+0000","last_undegraded":"2024-08-17T02:24:32.254316+0000","last_fullsized":"2024-08-17T02:24:32.254316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:41.587594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.237557+0000","last_change":"2024-08-17T02:24:32.237557+0000","last_active":"2024-08-17T02:24:32.237557+0000","last_peered":"2024-08-17T02:24:32.237557+0000","last_clean":"2024-08-17T02:24:32.237557+0000","last_became_active":"2024-08-17T02:24:32.237275+0000","last_became_peered":"2024-08-17T02:24:32.237275+0000","last_unstale":"2024-08-17T02:24:32.237557+0000","last_undegraded":"2024-08-17T02:24:32.237557+0000","last_fullsized":"2024-08-17T02:24:32.237557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:47:33.583547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.266746+0000","last_change":"2024-08-17T02:24:31.247491+0000","last_active":"2024-08-17T02:24:32.266746+0000","last_peered":"2024-08-17T02:24:32.266746+0000","last_clean":"2024-08-17T02:24:32.266746+0000","last_became_active":"2024-08-17T02:24:31.247204+0000","last_became_peered":"2024-08-17T02:24:31.247204+0000","last_unstale":"2024-08-17T02:24:32.266746+0000","last_undegraded":"2024-08-17T02:24:32.266746+0000","last_fullsized":"2024-08-17T02:24:32.266746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:41.587594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.254306+0000","last_change":"2024-08-17T02:24:32.254306+0000","last_active":"2024-08-17T02:24:32.254306+0000","last_peered":"2024-08-17T02:24:32.254306+0000","last_clean":"2024-08-17T02:24:32.254306+0000","last_became_active":"2024-08-17T02:24:32.254116+0000","last_became_peered":"2024-08-17T02:24:32.254116+0000","last_unstale":"2024-08-17T02:24:32.254306+0000","last_undegraded":"2024-08-17T02:24:32.254306+0000","last_fullsized":"2024-08-17T02:24:32.254306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:04.838752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.257439+0000","last_change":"2024-08-17T02:24:31.232182+0000","last_active":"2024-08-17T02:24:32.257439+0000","last_peered":"2024-08-17T02:24:32.257439+0000","last_clean":"2024-08-17T02:24:32.257439+0000","last_became_active":"2024-08-17T02:24:31.228987+0000","last_became_peered":"2024-08-17T02:24:31.228987+0000","last_unstale":"2024-08-17T02:24:32.257439+0000","last_undegraded":"2024-08-17T02:24:32.257439+0000","last_fullsized":"2024-08-17T02:24:32.257439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:53:30.547970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.257017+0000","last_change":"2024-08-17T02:24:32.257017+0000","last_active":"2024-08-17T02:24:32.257017+0000","last_peered":"2024-08-17T02:24:32.257017+0000","last_clean":"2024-08-17T02:24:32.257017+0000","last_became_active":"2024-08-17T02:24:32.256752+0000","last_became_peered":"2024-08-17T02:24:32.256752+0000","last_unstale":"2024-08-17T02:24:32.257017+0000","last_undegraded":"2024-08-17T02:24:32.257017+0000","last_fullsized":"2024-08-17T02:24:32.257017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:08.749667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.245987+0000","last_change":"2024-08-17T02:24:31.243658+0000","last_active":"2024-08-17T02:24:31.245987+0000","last_peered":"2024-08-17T02:24:31.245987+0000","last_clean":"2024-08-17T02:24:31.245987+0000","last_became_active":"2024-08-17T02:24:31.243335+0000","last_became_peered":"2024-08-17T02:24:31.243335+0000","last_unstale":"2024-08-17T02:24:31.245987+0000","last_undegraded":"2024-08-17T02:24:31.245987+0000","last_fullsized":"2024-08-17T02:24:31.245987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:54.452030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.247981+0000","last_change":"2024-08-17T02:24:32.247981+0000","last_active":"2024-08-17T02:24:32.247981+0000","last_peered":"2024-08-17T02:24:32.247981+0000","last_clean":"2024-08-17T02:24:32.247981+0000","last_became_active":"2024-08-17T02:24:32.247732+0000","last_became_peered":"2024-08-17T02:24:32.247732+0000","last_unstale":"2024-08-17T02:24:32.247981+0000","last_undegraded":"2024-08-17T02:24:32.247981+0000","last_fullsized":"2024-08-17T02:24:32.247981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:20.236381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.244749+0000","last_change":"2024-08-17T02:24:31.242946+0000","last_active":"2024-08-17T02:24:31.244749+0000","last_peered":"2024-08-17T02:24:31.244749+0000","last_clean":"2024-08-17T02:24:31.244749+0000","last_became_active":"2024-08-17T02:24:31.242666+0000","last_became_peered":"2024-08-17T02:24:31.242666+0000","last_unstale":"2024-08-17T02:24:31.244749+0000","last_undegraded":"2024-08-17T02:24:31.244749+0000","last_fullsized":"2024-08-17T02:24:31.244749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:12:25.544365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.241750+0000","last_change":"2024-08-17T02:24:32.241750+0000","last_active":"2024-08-17T02:24:32.241750+0000","last_peered":"2024-08-17T02:24:32.241750+0000","last_clean":"2024-08-17T02:24:32.241750+0000","last_became_active":"2024-08-17T02:24:32.241419+0000","last_became_peered":"2024-08-17T02:24:32.241419+0000","last_unstale":"2024-08-17T02:24:32.241750+0000","last_undegraded":"2024-08-17T02:24:32.241750+0000","last_fullsized":"2024-08-17T02:24:32.241750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:02:32.668772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.266506+0000","last_change":"2024-08-17T02:24:31.239730+0000","last_active":"2024-08-17T02:24:32.266506+0000","last_peered":"2024-08-17T02:24:32.266506+0000","last_clean":"2024-08-17T02:24:32.266506+0000","last_became_active":"2024-08-17T02:24:31.239296+0000","last_became_peered":"2024-08-17T02:24:31.239296+0000","last_unstale":"2024-08-17T02:24:32.266506+0000","last_undegraded":"2024-08-17T02:24:32.266506+0000","last_fullsized":"2024-08-17T02:24:32.266506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:19.529716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.244489+0000","last_change":"2024-08-17T02:24:32.244489+0000","last_active":"2024-08-17T02:24:32.244489+0000","last_peered":"2024-08-17T02:24:32.244489+0000","last_clean":"2024-08-17T02:24:32.244489+0000","last_became_active":"2024-08-17T02:24:32.243583+0000","last_became_peered":"2024-08-17T02:24:32.243583+0000","last_unstale":"2024-08-17T02:24:32.244489+0000","last_undegraded":"2024-08-17T02:24:32.244489+0000","last_fullsized":"2024-08-17T02:24:32.244489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:07.838446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.239126+0000","last_change":"2024-08-17T02:24:31.247412+0000","last_active":"2024-08-17T02:24:32.239126+0000","last_peered":"2024-08-17T02:24:32.239126+0000","last_clean":"2024-08-17T02:24:32.239126+0000","last_became_active":"2024-08-17T02:24:31.246903+0000","last_became_peered":"2024-08-17T02:24:31.246903+0000","last_unstale":"2024-08-17T02:24:32.239126+0000","last_undegraded":"2024-08-17T02:24:32.239126+0000","last_fullsized":"2024-08-17T02:24:32.239126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:10.046192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.245207+0000","last_change":"2024-08-17T02:24:32.245207+0000","last_active":"2024-08-17T02:24:32.245207+0000","last_peered":"2024-08-17T02:24:32.245207+0000","last_clean":"2024-08-17T02:24:32.245207+0000","last_became_active":"2024-08-17T02:24:32.244898+0000","last_became_peered":"2024-08-17T02:24:32.244898+0000","last_unstale":"2024-08-17T02:24:32.245207+0000","last_undegraded":"2024-08-17T02:24:32.245207+0000","last_fullsized":"2024-08-17T02:24:32.245207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:24:11.697410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.257403+0000","last_change":"2024-08-17T02:24:31.237834+0000","last_active":"2024-08-17T02:24:32.257403+0000","last_peered":"2024-08-17T02:24:32.257403+0000","last_clean":"2024-08-17T02:24:32.257403+0000","last_became_active":"2024-08-17T02:24:31.236377+0000","last_became_peered":"2024-08-17T02:24:31.236377+0000","last_unstale":"2024-08-17T02:24:32.257403+0000","last_undegraded":"2024-08-17T02:24:32.257403+0000","last_fullsized":"2024-08-17T02:24:32.257403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:16.991573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.244374+0000","last_change":"2024-08-17T02:24:32.244374+0000","last_active":"2024-08-17T02:24:32.244374+0000","last_peered":"2024-08-17T02:24:32.244374+0000","last_clean":"2024-08-17T02:24:32.244374+0000","last_became_active":"2024-08-17T02:24:32.244122+0000","last_became_peered":"2024-08-17T02:24:32.244122+0000","last_unstale":"2024-08-17T02:24:32.244374+0000","last_undegraded":"2024-08-17T02:24:32.244374+0000","last_fullsized":"2024-08-17T02:24:32.244374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:47.598833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.237330+0000","last_change":"2024-08-17T02:24:31.239583+0000","last_active":"2024-08-17T02:24:32.237330+0000","last_peered":"2024-08-17T02:24:32.237330+0000","last_clean":"2024-08-17T02:24:32.237330+0000","last_became_active":"2024-08-17T02:24:31.238281+0000","last_became_peered":"2024-08-17T02:24:31.238281+0000","last_unstale":"2024-08-17T02:24:32.237330+0000","last_undegraded":"2024-08-17T02:24:32.237330+0000","last_fullsized":"2024-08-17T02:24:32.237330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:26:50.757189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.254641+0000","last_change":"2024-08-17T02:24:32.254641+0000","last_active":"2024-08-17T02:24:32.254641+0000","last_peered":"2024-08-17T02:24:32.254641+0000","last_clean":"2024-08-17T02:24:32.254641+0000","last_became_active":"2024-08-17T02:24:32.253131+0000","last_became_peered":"2024-08-17T02:24:32.253131+0000","last_unstale":"2024-08-17T02:24:32.254641+0000","last_undegraded":"2024-08-17T02:24:32.254641+0000","last_fullsized":"2024-08-17T02:24:32.254641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:25:21.559975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.240883+0000","last_change":"2024-08-17T02:24:31.235351+0000","last_active":"2024-08-17T02:24:31.240883+0000","last_peered":"2024-08-17T02:24:31.240883+0000","last_clean":"2024-08-17T02:24:31.240883+0000","last_became_active":"2024-08-17T02:24:31.235132+0000","last_became_peered":"2024-08-17T02:24:31.235132+0000","last_unstale":"2024-08-17T02:24:31.240883+0000","last_undegraded":"2024-08-17T02:24:31.240883+0000","last_fullsized":"2024-08-17T02:24:31.240883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:41.490737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.247184+0000","last_change":"2024-08-17T02:24:32.247184+0000","last_active":"2024-08-17T02:24:32.247184+0000","last_peered":"2024-08-17T02:24:32.247184+0000","last_clean":"2024-08-17T02:24:32.247184+0000","last_became_active":"2024-08-17T02:24:32.246840+0000","last_became_peered":"2024-08-17T02:24:32.246840+0000","last_unstale":"2024-08-17T02:24:32.247184+0000","last_undegraded":"2024-08-17T02:24:32.247184+0000","last_fullsized":"2024-08-17T02:24:32.247184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:05:37.221744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.250359+0000","last_change":"2024-08-17T02:24:31.238199+0000","last_active":"2024-08-17T02:24:32.250359+0000","last_peered":"2024-08-17T02:24:32.250359+0000","last_clean":"2024-08-17T02:24:32.250359+0000","last_became_active":"2024-08-17T02:24:31.236391+0000","last_became_peered":"2024-08-17T02:24:31.236391+0000","last_unstale":"2024-08-17T02:24:32.250359+0000","last_undegraded":"2024-08-17T02:24:32.250359+0000","last_fullsized":"2024-08-17T02:24:32.250359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:38.329270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.259068+0000","last_change":"2024-08-17T02:24:32.259068+0000","last_active":"2024-08-17T02:24:32.259068+0000","last_peered":"2024-08-17T02:24:32.259068+0000","last_clean":"2024-08-17T02:24:32.259068+0000","last_became_active":"2024-08-17T02:24:32.258815+0000","last_became_peered":"2024-08-17T02:24:32.258815+0000","last_unstale":"2024-08-17T02:24:32.259068+0000","last_undegraded":"2024-08-17T02:24:32.259068+0000","last_fullsized":"2024-08-17T02:24:32.259068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:59.902289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.243617+0000","last_change":"2024-08-17T02:24:31.241007+0000","last_active":"2024-08-17T02:24:31.243617+0000","last_peered":"2024-08-17T02:24:31.243617+0000","last_clean":"2024-08-17T02:24:31.243617+0000","last_became_active":"2024-08-17T02:24:31.240754+0000","last_became_peered":"2024-08-17T02:24:31.240754+0000","last_unstale":"2024-08-17T02:24:31.243617+0000","last_undegraded":"2024-08-17T02:24:31.243617+0000","last_fullsized":"2024-08-17T02:24:31.243617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:27.261535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.251458+0000","last_change":"2024-08-17T02:24:32.251458+0000","last_active":"2024-08-17T02:24:32.251458+0000","last_peered":"2024-08-17T02:24:32.251458+0000","last_clean":"2024-08-17T02:24:32.251458+0000","last_became_active":"2024-08-17T02:24:32.251219+0000","last_became_peered":"2024-08-17T02:24:32.251219+0000","last_unstale":"2024-08-17T02:24:32.251458+0000","last_undegraded":"2024-08-17T02:24:32.251458+0000","last_fullsized":"2024-08-17T02:24:32.251458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:28.264218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.242649+0000","last_change":"2024-08-17T02:24:31.237122+0000","last_active":"2024-08-17T02:24:31.242649+0000","last_peered":"2024-08-17T02:24:31.242649+0000","last_clean":"2024-08-17T02:24:31.242649+0000","last_became_active":"2024-08-17T02:24:31.231919+0000","last_became_peered":"2024-08-17T02:24:31.231919+0000","last_unstale":"2024-08-17T02:24:31.242649+0000","last_undegraded":"2024-08-17T02:24:31.242649+0000","last_fullsized":"2024-08-17T02:24:31.242649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:09:54.110700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.241006+0000","last_change":"2024-08-17T02:24:32.241006+0000","last_active":"2024-08-17T02:24:32.241006+0000","last_peered":"2024-08-17T02:24:32.241006+0000","last_clean":"2024-08-17T02:24:32.241006+0000","last_became_active":"2024-08-17T02:24:32.240507+0000","last_became_peered":"2024-08-17T02:24:32.240507+0000","last_unstale":"2024-08-17T02:24:32.241006+0000","last_undegraded":"2024-08-17T02:24:32.241006+0000","last_fullsized":"2024-08-17T02:24:32.241006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:30.519447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.245438+0000","last_change":"2024-08-17T02:24:31.241403+0000","last_active":"2024-08-17T02:24:31.245438+0000","last_peered":"2024-08-17T02:24:31.245438+0000","last_clean":"2024-08-17T02:24:31.245438+0000","last_became_active":"2024-08-17T02:24:31.241152+0000","last_became_peered":"2024-08-17T02:24:31.241152+0000","last_unstale":"2024-08-17T02:24:31.245438+0000","last_undegraded":"2024-08-17T02:24:31.245438+0000","last_fullsized":"2024-08-17T02:24:31.245438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:37.365650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.247955+0000","last_change":"2024-08-17T02:24:32.247955+0000","last_active":"2024-08-17T02:24:32.247955+0000","last_peered":"2024-08-17T02:24:32.247955+0000","last_clean":"2024-08-17T02:24:32.247955+0000","last_became_active":"2024-08-17T02:24:32.247685+0000","last_became_peered":"2024-08-17T02:24:32.247685+0000","last_unstale":"2024-08-17T02:24:32.247955+0000","last_undegraded":"2024-08-17T02:24:32.247955+0000","last_fullsized":"2024-08-17T02:24:32.247955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:55.454713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.247807+0000","last_change":"2024-08-17T02:24:31.247537+0000","last_active":"2024-08-17T02:24:32.247807+0000","last_peered":"2024-08-17T02:24:32.247807+0000","last_clean":"2024-08-17T02:24:32.247807+0000","last_became_active":"2024-08-17T02:24:31.247267+0000","last_became_peered":"2024-08-17T02:24:31.247267+0000","last_unstale":"2024-08-17T02:24:32.247807+0000","last_undegraded":"2024-08-17T02:24:32.247807+0000","last_fullsized":"2024-08-17T02:24:32.247807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:23:16.147066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.240897+0000","last_change":"2024-08-17T02:24:32.240897+0000","last_active":"2024-08-17T02:24:32.240897+0000","last_peered":"2024-08-17T02:24:32.240897+0000","last_clean":"2024-08-17T02:24:32.240897+0000","last_became_active":"2024-08-17T02:24:32.240620+0000","last_became_peered":"2024-08-17T02:24:32.240620+0000","last_unstale":"2024-08-17T02:24:32.240897+0000","last_undegraded":"2024-08-17T02:24:32.240897+0000","last_fullsized":"2024-08-17T02:24:32.240897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:35:47.059157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.243280+0000","last_change":"2024-08-17T02:24:31.237602+0000","last_active":"2024-08-17T02:24:31.243280+0000","last_peered":"2024-08-17T02:24:31.243280+0000","last_clean":"2024-08-17T02:24:31.243280+0000","last_became_active":"2024-08-17T02:24:31.236786+0000","last_became_peered":"2024-08-17T02:24:31.236786+0000","last_unstale":"2024-08-17T02:24:31.243280+0000","last_undegraded":"2024-08-17T02:24:31.243280+0000","last_fullsized":"2024-08-17T02:24:31.243280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:10.046192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.243584+0000","last_change":"2024-08-17T02:24:32.243584+0000","last_active":"2024-08-17T02:24:32.243584+0000","last_peered":"2024-08-17T02:24:32.243584+0000","last_clean":"2024-08-17T02:24:32.243584+0000","last_became_active":"2024-08-17T02:24:32.240944+0000","last_became_peered":"2024-08-17T02:24:32.240944+0000","last_unstale":"2024-08-17T02:24:32.243584+0000","last_undegraded":"2024-08-17T02:24:32.243584+0000","last_fullsized":"2024-08-17T02:24:32.243584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:41.748027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.245854+0000","last_change":"2024-08-17T02:24:31.239531+0000","last_active":"2024-08-17T02:24:31.245854+0000","last_peered":"2024-08-17T02:24:31.245854+0000","last_clean":"2024-08-17T02:24:31.245854+0000","last_became_active":"2024-08-17T02:24:31.239198+0000","last_became_peered":"2024-08-17T02:24:31.239198+0000","last_unstale":"2024-08-17T02:24:31.245854+0000","last_undegraded":"2024-08-17T02:24:31.245854+0000","last_fullsized":"2024-08-17T02:24:31.245854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:38.329270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.246085+0000","last_change":"2024-08-17T02:24:32.246085+0000","last_active":"2024-08-17T02:24:32.246085+0000","last_peered":"2024-08-17T02:24:32.246085+0000","last_clean":"2024-08-17T02:24:32.246085+0000","last_became_active":"2024-08-17T02:24:32.245824+0000","last_became_peered":"2024-08-17T02:24:32.245824+0000","last_unstale":"2024-08-17T02:24:32.246085+0000","last_undegraded":"2024-08-17T02:24:32.246085+0000","last_fullsized":"2024-08-17T02:24:32.246085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:42.590278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.244956+0000","last_change":"2024-08-17T02:24:31.243761+0000","last_active":"2024-08-17T02:24:31.244956+0000","last_peered":"2024-08-17T02:24:31.244956+0000","last_clean":"2024-08-17T02:24:31.244956+0000","last_became_active":"2024-08-17T02:24:31.243479+0000","last_became_peered":"2024-08-17T02:24:31.243479+0000","last_unstale":"2024-08-17T02:24:31.244956+0000","last_undegraded":"2024-08-17T02:24:31.244956+0000","last_fullsized":"2024-08-17T02:24:31.244956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:54.452030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.241228+0000","last_change":"2024-08-17T02:24:32.241228+0000","last_active":"2024-08-17T02:24:32.241228+0000","last_peered":"2024-08-17T02:24:32.241228+0000","last_clean":"2024-08-17T02:24:32.241228+0000","last_became_active":"2024-08-17T02:24:32.240964+0000","last_became_peered":"2024-08-17T02:24:32.240964+0000","last_unstale":"2024-08-17T02:24:32.241228+0000","last_undegraded":"2024-08-17T02:24:32.241228+0000","last_fullsized":"2024-08-17T02:24:32.241228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:12:26.547049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.249040+0000","last_change":"2024-08-17T02:24:31.247409+0000","last_active":"2024-08-17T02:24:31.249040+0000","last_peered":"2024-08-17T02:24:31.249040+0000","last_clean":"2024-08-17T02:24:31.249040+0000","last_became_active":"2024-08-17T02:24:31.247147+0000","last_became_peered":"2024-08-17T02:24:31.247147+0000","last_unstale":"2024-08-17T02:24:31.249040+0000","last_undegraded":"2024-08-17T02:24:31.249040+0000","last_fullsized":"2024-08-17T02:24:31.249040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:45.781609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.233899+0000","last_change":"2024-08-17T02:24:32.233899+0000","last_active":"2024-08-17T02:24:32.233899+0000","last_peered":"2024-08-17T02:24:32.233899+0000","last_clean":"2024-08-17T02:24:32.233899+0000","last_became_active":"2024-08-17T02:24:32.232071+0000","last_became_peered":"2024-08-17T02:24:32.232071+0000","last_unstale":"2024-08-17T02:24:32.233899+0000","last_undegraded":"2024-08-17T02:24:32.233899+0000","last_fullsized":"2024-08-17T02:24:32.233899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:43:05.687647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.244003+0000","last_change":"2024-08-17T02:24:31.241841+0000","last_active":"2024-08-17T02:24:31.244003+0000","last_peered":"2024-08-17T02:24:31.244003+0000","last_clean":"2024-08-17T02:24:31.244003+0000","last_became_active":"2024-08-17T02:24:31.241482+0000","last_became_peered":"2024-08-17T02:24:31.241482+0000","last_unstale":"2024-08-17T02:24:31.244003+0000","last_undegraded":"2024-08-17T02:24:31.244003+0000","last_fullsized":"2024-08-17T02:24:31.244003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:28.165917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.256938+0000","last_change":"2024-08-17T02:24:32.256938+0000","last_active":"2024-08-17T02:24:32.256938+0000","last_peered":"2024-08-17T02:24:32.256938+0000","last_clean":"2024-08-17T02:24:32.256938+0000","last_became_active":"2024-08-17T02:24:32.256492+0000","last_became_peered":"2024-08-17T02:24:32.256492+0000","last_unstale":"2024-08-17T02:24:32.256938+0000","last_undegraded":"2024-08-17T02:24:32.256938+0000","last_fullsized":"2024-08-17T02:24:32.256938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:53:11.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.242180+0000","last_change":"2024-08-17T02:24:31.239543+0000","last_active":"2024-08-17T02:24:31.242180+0000","last_peered":"2024-08-17T02:24:31.242180+0000","last_clean":"2024-08-17T02:24:31.242180+0000","last_became_active":"2024-08-17T02:24:31.238983+0000","last_became_peered":"2024-08-17T02:24:31.238983+0000","last_unstale":"2024-08-17T02:24:31.242180+0000","last_undegraded":"2024-08-17T02:24:31.242180+0000","last_fullsized":"2024-08-17T02:24:31.242180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:50.589554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:24:32.251069+0000","last_change":"2024-08-17T02:24:32.251069+0000","last_active":"2024-08-17T02:24:32.251069+0000","last_peered":"2024-08-17T02:24:32.251069+0000","last_clean":"2024-08-17T02:24:32.251069+0000","last_became_active":"2024-08-17T02:24:32.249128+0000","last_became_peered":"2024-08-17T02:24:32.249128+0000","last_unstale":"2024-08-17T02:24:32.251069+0000","last_undegraded":"2024-08-17T02:24:32.251069+0000","last_fullsized":"2024-08-17T02:24:32.251069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:31.211961+0000","last_clean_scrub_stamp":"2024-08-17T02:24:31.211961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:28.193997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.242207+0000","last_change":"2024-08-17T02:24:31.236644+0000","last_active":"2024-08-17T02:24:31.242207+0000","last_peered":"2024-08-17T02:24:31.242207+0000","last_clean":"2024-08-17T02:24:31.242207+0000","last_became_active":"2024-08-17T02:24:31.234130+0000","last_became_peered":"2024-08-17T02:24:31.234130+0000","last_unstale":"2024-08-17T02:24:31.242207+0000","last_undegraded":"2024-08-17T02:24:31.242207+0000","last_fullsized":"2024-08-17T02:24:31.242207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:30.209278+0000","last_clean_scrub_stamp":"2024-08-17T02:24:30.209278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:25:20.557291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:24:31.238389+0000","last_change":"2024-08-17T02:23:30.651033+0000","last_active":"2024-08-17T02:24:31.238389+0000","last_peered":"2024-08-17T02:24:31.238389+0000","last_clean":"2024-08-17T02:24:31.238389+0000","last_became_active":"2024-08-17T02:23:30.649860+0000","last_became_peered":"2024-08-17T02:23:30.649860+0000","last_unstale":"2024-08-17T02:24:31.238389+0000","last_undegraded":"2024-08-17T02:24:31.238389+0000","last_fullsized":"2024-08-17T02:24:31.238389+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.523857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:29:35.288625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298288,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073552,"statfs":{"total":96636764160,"available":96331317248,"internally_reserved":0,"allocated":950272,"data_stored":724276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.77700000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.78600000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.73099999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.90400000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.749}]},{"osd":5,"last update":"Sat Aug 17 02:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.60899999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.83699999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":376832,"data_stored":141275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.69899999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":3.444,"5min":3.444,"15min":3.444},"last":0.46200000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.4009999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":4.4249999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":0.751}]},{"osd":3,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.61799999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.85399999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.79500000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":356352,"data_stored":133908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.80400000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.499},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.65300000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":3.3340000000000001,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":0.78600000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.5670000000000002,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.751},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.665,"5min":3.665,"15min":3.665},"last":0.84099999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.87}]},{"osd":6,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.90300000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.97399999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":376832,"data_stored":140775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.627},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.70399999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.58399999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.56999999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.745},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.72499999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64300000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.66300000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.65000000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":385024,"data_stored":142245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:24:30 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.501}]},{"osd":1,"last update":"Sat Aug 17 02:24:30 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.47499999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:24:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.52100000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:24:30 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.629}]},{"osd":5,"last update":"Sat Aug 17 02:24:30 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.65800000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:24:30 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.68400000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:24:30 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.57899999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301868,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069972,"statfs":{"total":96636764160,"available":96327651328,"internally_reserved":0,"allocated":356352,"data_stored":133908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.40300000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42799999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.47999999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.69399999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":0.67000000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.83299999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":0.77900000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542160,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":385024,"data_stored":142245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.376}]},{"osd":2,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.7149999999999999,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.432},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":3.7360000000000002,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":0.49399999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.6070000000000002,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":0.41499999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.544,"5min":2.544,"15min":2.544},"last":0.60899999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.6480000000000001,"5min":3.6480000000000001,"15min":3.6480000000000001},"last":0.75}]},{"osd":5,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.625},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.4630000000000001,"5min":2.4630000000000001,"15min":2.4630000000000001},"last":0.73699999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":3.7000000000000002,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":0.66400000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:24:28 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.5550000000000002,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.63700000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542160,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":950272,"data_stored":724276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.40699999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.499}]},{"osd":3,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":0.59999999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.432}]},{"osd":5,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.62}]},{"osd":6,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.70499999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:24:29 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.72099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:24:36.848 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:24:36.849 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:24:37.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.043+0000 7f87ee200640 1 Processor -- start 2024-08-17T02:24:37.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.043+0000 7f87ee200640 1 -- start start 2024-08-17T02:24:37.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.044+0000 7f87ee200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87e80ca050 0x7f87e8156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.044+0000 7f87ee200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f87e80add30 0x7f87e815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.044+0000 7f87ee200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e815b5e0 con 0x7f87e80ad960 2024-08-17T02:24:37.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.044+0000 7f87ee200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e80cb160 con 0x7f87e80ca050 2024-08-17T02:24:37.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.044+0000 7f87ee200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e80b0d10 con 0x7f87e80add30 2024-08-17T02:24:37.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.044+0000 7f87e6a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87e80ca050 0x7f87e8156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.044+0000 7f87e6a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87e80ca050 0x7f87e8156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44048/0 (socket says 172.21.15.5:44048) 2024-08-17T02:24:37.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.044+0000 7f87e6a00640 1 -- 172.21.15.5:0/3030356300 learned_addr learned my addr 172.21.15.5:0/3030356300 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:37.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.045+0000 7f87e7e00640 1 --2- 172.21.15.5:0/3030356300 >> v2:172.21.15.87:3300/0 conn(0x7f87e80add30 0x7f87e815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.045+0000 7f87e6a00640 1 -- 172.21.15.5:0/3030356300 >> v2:172.21.15.87:3300/0 conn(0x7f87e80add30 msgr2=0x7f87e815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:37.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.045+0000 7f87e6a00640 1 --2- 172.21.15.5:0/3030356300 >> v2:172.21.15.87:3300/0 conn(0x7f87e80add30 0x7f87e815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.045+0000 7f87e6a00640 1 -- 172.21.15.5:0/3030356300 >> v1:172.21.15.5:6789/0 conn(0x7f87e80ad960 legacy=0x7f87e8156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.045+0000 7f87e6a00640 1 -- 172.21.15.5:0/3030356300 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e80ca550 con 0x7f87e80ca050 2024-08-17T02:24:37.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.045+0000 7f87e7e00640 1 --2- 172.21.15.5:0/3030356300 >> v2:172.21.15.87:3300/0 conn(0x7f87e80add30 0x7f87e815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:37.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.046+0000 7f87e6a00640 1 --2- 172.21.15.5:0/3030356300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e80ca050 0x7f87e8156b30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f87e80cb0d0 tx=0x7f87d40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2904abfebf5da070 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.046+0000 7f87e6000640 1 -- 172.21.15.5:0/3030356300 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4032440 con 0x7f87e80ca050 2024-08-17T02:24:37.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.046+0000 7f87e6000640 1 -- 172.21.15.5:0/3030356300 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d40325a0 con 0x7f87e80ca050 2024-08-17T02:24:37.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.046+0000 7f87e6000640 1 -- 172.21.15.5:0/3030356300 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4032980 con 0x7f87e80ca050 2024-08-17T02:24:37.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.047+0000 7f87ee200640 1 -- 172.21.15.5:0/3030356300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e80ca050 msgr2=0x7f87e8156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.047+0000 7f87ee200640 1 --2- 172.21.15.5:0/3030356300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e80ca050 0x7f87e8156b30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f87e80cb0d0 tx=0x7f87d40091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.047+0000 7f87ee200640 1 -- 172.21.15.5:0/3030356300 shutdown_connections 2024-08-17T02:24:37.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.047+0000 7f87ee200640 1 --2- 172.21.15.5:0/3030356300 >> v2:172.21.15.87:3300/0 conn(0x7f87e80add30 0x7f87e815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.047+0000 7f87ee200640 1 --2- 172.21.15.5:0/3030356300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e80ca050 0x7f87e8156b30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.047+0000 7f87ee200640 1 -- 172.21.15.5:0/3030356300 >> 172.21.15.5:0/3030356300 conn(0x7f87e8066e60 msgr2=0x7f87e8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.047+0000 7f87ee200640 1 -- 172.21.15.5:0/3030356300 shutdown_connections 2024-08-17T02:24:37.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.047+0000 7f87ee200640 1 -- 172.21.15.5:0/3030356300 wait complete. 2024-08-17T02:24:37.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.048+0000 7f87ee200640 1 Processor -- start 2024-08-17T02:24:37.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.048+0000 7f87ee200640 1 -- start start 2024-08-17T02:24:37.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.049+0000 7f87ee200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87e80ad960 0x7f87e8069830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.049+0000 7f87ee200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87e80add30 0x7f87e8158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.049+0000 7f87ee200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e80ca050 0x7f87e815b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.049+0000 7f87ee200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e806aab0 con 0x7f87e80ca050 2024-08-17T02:24:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.049+0000 7f87ee200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e8069ea0 con 0x7f87e80ad960 2024-08-17T02:24:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.049+0000 7f87ee200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e806a180 con 0x7f87e80add30 2024-08-17T02:24:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.049+0000 7f87e7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e80ca050 0x7f87e815b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.050+0000 7f87e7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e80ca050 0x7f87e815b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44064/0 (socket says 172.21.15.5:44064) 2024-08-17T02:24:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.050+0000 7f87e7e00640 1 -- 172.21.15.5:0/724912341 learned_addr learned my addr 172.21.15.5:0/724912341 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.050+0000 7f87e6a00640 1 --2- 172.21.15.5:0/724912341 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87e80add30 0x7f87e8158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.050+0000 7f87e7400640 1 --2- 172.21.15.5:0/724912341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87e80ad960 0x7f87e8069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.050+0000 7f87e7e00640 1 -- 172.21.15.5:0/724912341 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87e80add30 msgr2=0x7f87e8158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.050+0000 7f87e7e00640 1 --2- 172.21.15.5:0/724912341 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87e80add30 0x7f87e8158640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.050+0000 7f87e7e00640 1 -- 172.21.15.5:0/724912341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87e80ad960 msgr2=0x7f87e8069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.050+0000 7f87e7e00640 1 --2- 172.21.15.5:0/724912341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87e80ad960 0x7f87e8069830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.050+0000 7f87e7e00640 1 -- 172.21.15.5:0/724912341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d4009450 con 0x7f87e80ca050 2024-08-17T02:24:37.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.050+0000 7f87e7e00640 1 --2- 172.21.15.5:0/724912341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e80ca050 0x7f87e815b780 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f87e000a380 tx=0x7f87e0007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.051+0000 7f87dea00640 1 -- 172.21.15.5:0/724912341 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e000d650 con 0x7f87e80ca050 2024-08-17T02:24:37.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.051+0000 7f87dea00640 1 -- 172.21.15.5:0/724912341 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e000d7b0 con 0x7f87e80ca050 2024-08-17T02:24:37.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.051+0000 7f87ee200640 1 -- 172.21.15.5:0/724912341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e806a460 con 0x7f87e80ca050 2024-08-17T02:24:37.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.051+0000 7f87dea00640 1 -- 172.21.15.5:0/724912341 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e000db70 con 0x7f87e80ca050 2024-08-17T02:24:37.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.051+0000 7f87ee200640 1 -- 172.21.15.5:0/724912341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e8158c00 con 0x7f87e80ca050 2024-08-17T02:24:37.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.052+0000 7f87ee200640 1 -- 172.21.15.5:0/724912341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e806ac20 con 0x7f87e80ca050 2024-08-17T02:24:37.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.053+0000 7f87dea00640 1 -- 172.21.15.5:0/724912341 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f87e001e3b0 con 0x7f87e80ca050 2024-08-17T02:24:37.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.053+0000 7f87dea00640 1 --2- 172.21.15.5:0/724912341 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f87c8065150 0x7f87c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.053+0000 7f87dea00640 1 -- 172.21.15.5:0/724912341 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f87e0082ef0 con 0x7f87e80ca050 2024-08-17T02:24:37.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.054+0000 7f87e7400640 1 --2- 172.21.15.5:0/724912341 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f87c8065150 0x7f87c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.054+0000 7f87e7400640 1 --2- 172.21.15.5:0/724912341 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f87c8065150 0x7f87c8067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f87d8007fd0 tx=0x7f87d8007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.058+0000 7f87dea00640 1 -- 172.21.15.5:0/724912341 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f87e0050fc0 con 0x7f87e80ca050 2024-08-17T02:24:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.306+0000 7f87ee200640 1 -- 172.21.15.5:0/724912341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f87e8063fb0 con 0x7f87e80ca050 2024-08-17T02:24:37.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.309+0000 7f87dea00640 1 -- 172.21.15.5:0/724912341 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+0 (secure 0 0 0) 0x7f87e001a0e0 con 0x7f87e80ca050 2024-08-17T02:24:37.310 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-08-17T02:24:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.311+0000 7f87ee200640 1 -- 172.21.15.5:0/724912341 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f87c8065150 msgr2=0x7f87c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.311+0000 7f87ee200640 1 --2- 172.21.15.5:0/724912341 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f87c8065150 0x7f87c8067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f87d8007fd0 tx=0x7f87d8007e30 comp rx=0 tx=0).stop 2024-08-17T02:24:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.311+0000 7f87ee200640 1 -- 172.21.15.5:0/724912341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e80ca050 msgr2=0x7f87e815b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.311+0000 7f87ee200640 1 --2- 172.21.15.5:0/724912341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e80ca050 0x7f87e815b780 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f87e000a380 tx=0x7f87e0007900 comp rx=0 tx=0).stop 2024-08-17T02:24:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.312+0000 7f87ee200640 1 -- 172.21.15.5:0/724912341 shutdown_connections 2024-08-17T02:24:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.312+0000 7f87ee200640 1 --2- 172.21.15.5:0/724912341 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f87c8065150 0x7f87c8067600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.312+0000 7f87ee200640 1 --2- 172.21.15.5:0/724912341 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87e80add30 0x7f87e8158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.312+0000 7f87ee200640 1 --2- 172.21.15.5:0/724912341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e80ca050 0x7f87e815b780 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.312+0000 7f87ee200640 1 --2- 172.21.15.5:0/724912341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87e80ad960 0x7f87e8069830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.312+0000 7f87ee200640 1 -- 172.21.15.5:0/724912341 >> 172.21.15.5:0/724912341 conn(0x7f87e8066e60 msgr2=0x7f87e815a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.312+0000 7f87ee200640 1 -- 172.21.15.5:0/724912341 shutdown_connections 2024-08-17T02:24:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.312+0000 7f87ee200640 1 -- 172.21.15.5:0/724912341 wait complete. 2024-08-17T02:24:37.328 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.479+0000 7fc866c00640 1 Processor -- start 2024-08-17T02:24:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.479+0000 7fc866c00640 1 -- start start 2024-08-17T02:24:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.480+0000 7fc866c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc860158a20 0x7fc8600a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.480+0000 7fc866c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc86006dee0 0x7fc8600afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.480+0000 7fc866c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8600aed90 con 0x7fc8600ae860 2024-08-17T02:24:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.480+0000 7fc866c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8600af070 con 0x7fc86006dee0 2024-08-17T02:24:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.480+0000 7fc866c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8600af350 con 0x7fc860158a20 2024-08-17T02:24:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.481+0000 7fc85f400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc8600ae860 0x7fc86006d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55756/0 (socket says 172.21.15.5:55756) 2024-08-17T02:24:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.481+0000 7fc85f400640 1 -- 172.21.15.5:0/3393847041 learned_addr learned my addr 172.21.15.5:0/3393847041 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.481+0000 7fc864c00640 1 --2- 172.21.15.5:0/3393847041 >> v2:172.21.15.87:3300/0 conn(0x7fc86006dee0 0x7fc8600afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.481+0000 7fc85fe00640 1 --2- 172.21.15.5:0/3393847041 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc860158a20 0x7fc8600a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.481+0000 7fc85ea00640 1 -- 172.21.15.5:0/3393847041 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890218448 0 0) 0x7fc8600aed90 con 0x7fc8600ae860 2024-08-17T02:24:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.481+0000 7fc85ea00640 1 -- 172.21.15.5:0/3393847041 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8440034e0 con 0x7fc8600ae860 2024-08-17T02:24:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.481+0000 7fc864c00640 1 -- 172.21.15.5:0/3393847041 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc860158a20 msgr2=0x7fc8600a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.481+0000 7fc864c00640 1 --2- 172.21.15.5:0/3393847041 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc860158a20 0x7fc8600a89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.481+0000 7fc864c00640 1 -- 172.21.15.5:0/3393847041 >> v1:172.21.15.5:6789/0 conn(0x7fc8600ae860 legacy=0x7fc86006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.481+0000 7fc864c00640 1 -- 172.21.15.5:0/3393847041 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8600af630 con 0x7fc86006dee0 2024-08-17T02:24:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.483+0000 7fc864c00640 1 --2- 172.21.15.5:0/3393847041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc86006dee0 0x7fc8600afe30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc858009e60 tx=0x7fc858009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d142851d075bb885 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.483+0000 7fc85ea00640 1 -- 172.21.15.5:0/3393847041 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858007550 con 0x7fc86006dee0 2024-08-17T02:24:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.483+0000 7fc85ea00640 1 -- 172.21.15.5:0/3393847041 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85802d050 con 0x7fc86006dee0 2024-08-17T02:24:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.483+0000 7fc85ea00640 1 -- 172.21.15.5:0/3393847041 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858007920 con 0x7fc86006dee0 2024-08-17T02:24:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.483+0000 7fc866c00640 1 -- 172.21.15.5:0/3393847041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc86006dee0 msgr2=0x7fc8600afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.483+0000 7fc866c00640 1 --2- 172.21.15.5:0/3393847041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc86006dee0 0x7fc8600afe30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc858009e60 tx=0x7fc858009780 comp rx=0 tx=0).stop 2024-08-17T02:24:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.484+0000 7fc866c00640 1 -- 172.21.15.5:0/3393847041 shutdown_connections 2024-08-17T02:24:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.484+0000 7fc866c00640 1 --2- 172.21.15.5:0/3393847041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc86006dee0 0x7fc8600afe30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.484+0000 7fc866c00640 1 --2- 172.21.15.5:0/3393847041 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc860158a20 0x7fc8600a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.484+0000 7fc866c00640 1 -- 172.21.15.5:0/3393847041 >> 172.21.15.5:0/3393847041 conn(0x7fc860066e60 msgr2=0x7fc860067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.484+0000 7fc866c00640 1 -- 172.21.15.5:0/3393847041 shutdown_connections 2024-08-17T02:24:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.484+0000 7fc866c00640 1 -- 172.21.15.5:0/3393847041 wait complete. 2024-08-17T02:24:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.485+0000 7fc866c00640 1 Processor -- start 2024-08-17T02:24:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.485+0000 7fc866c00640 1 -- start start 2024-08-17T02:24:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.486+0000 7fc866c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc86006dee0 0x7fc8600ab760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.486+0000 7fc866c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8600ae860 0x7fc86006a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.486+0000 7fc866c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc860158a20 0x7fc860151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.486+0000 7fc866c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86015a620 con 0x7fc86006dee0 2024-08-17T02:24:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.486+0000 7fc866c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86006b250 con 0x7fc860158a20 2024-08-17T02:24:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.486+0000 7fc866c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86006a730 con 0x7fc8600ae860 2024-08-17T02:24:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.486+0000 7fc85fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc86006dee0 0x7fc8600ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.486+0000 7fc85fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc86006dee0 0x7fc8600ab760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44076/0 (socket says 172.21.15.5:44076) 2024-08-17T02:24:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.486+0000 7fc85fe00640 1 -- 172.21.15.5:0/2924514551 learned_addr learned my addr 172.21.15.5:0/2924514551 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.486+0000 7fc85f400640 1 --2- 172.21.15.5:0/2924514551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8600ae860 0x7fc86006a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.486+0000 7fc864c00640 1 --2- 172.21.15.5:0/2924514551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc860158a20 0x7fc860151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.487+0000 7fc85fe00640 1 -- 172.21.15.5:0/2924514551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8600ae860 msgr2=0x7fc86006a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.487+0000 7fc85fe00640 1 --2- 172.21.15.5:0/2924514551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8600ae860 0x7fc86006a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.487+0000 7fc85fe00640 1 -- 172.21.15.5:0/2924514551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc860158a20 msgr2=0x7fc860151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.487+0000 7fc85fe00640 1 --2- 172.21.15.5:0/2924514551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc860158a20 0x7fc860151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.487+0000 7fc85fe00640 1 -- 172.21.15.5:0/2924514551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc858009a20 con 0x7fc86006dee0 2024-08-17T02:24:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.487+0000 7fc85fe00640 1 --2- 172.21.15.5:0/2924514551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc86006dee0 0x7fc8600ab760 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc85000e900 tx=0x7fc8500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.487+0000 7fc857400640 1 -- 172.21.15.5:0/2924514551 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85000c8e0 con 0x7fc86006dee0 2024-08-17T02:24:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.487+0000 7fc857400640 1 -- 172.21.15.5:0/2924514551 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85000ca40 con 0x7fc86006dee0 2024-08-17T02:24:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.487+0000 7fc866c00640 1 -- 172.21.15.5:0/2924514551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc860151550 con 0x7fc86006dee0 2024-08-17T02:24:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.488+0000 7fc857400640 1 -- 172.21.15.5:0/2924514551 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85000cde0 con 0x7fc86006dee0 2024-08-17T02:24:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.488+0000 7fc866c00640 1 -- 172.21.15.5:0/2924514551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86006af70 con 0x7fc86006dee0 2024-08-17T02:24:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.489+0000 7fc866c00640 1 -- 172.21.15.5:0/2924514551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc860063fb0 con 0x7fc86006dee0 2024-08-17T02:24:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.489+0000 7fc857400640 1 -- 172.21.15.5:0/2924514551 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc850013680 con 0x7fc86006dee0 2024-08-17T02:24:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.490+0000 7fc857400640 1 --2- 172.21.15.5:0/2924514551 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc840065150 0x7fc840067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.490+0000 7fc857400640 1 -- 172.21.15.5:0/2924514551 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc850082660 con 0x7fc86006dee0 2024-08-17T02:24:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.490+0000 7fc85f400640 1 --2- 172.21.15.5:0/2924514551 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc840065150 0x7fc840067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.491+0000 7fc85f400640 1 --2- 172.21.15.5:0/2924514551 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc840065150 0x7fc840067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc86015c6a0 tx=0x7fc84c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.494+0000 7fc857400640 1 -- 172.21.15.5:0/2924514551 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc850050730 con 0x7fc86006dee0 2024-08-17T02:24:37.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.713+0000 7fc866c00640 1 -- 172.21.15.5:0/2924514551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc86006e4c0 con 0x7fc86006dee0 2024-08-17T02:24:37.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.714+0000 7fc857400640 1 -- 172.21.15.5:0/2924514551 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7fc850053d50 con 0x7fc86006dee0 2024-08-17T02:24:37.714 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:37.714 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1398504310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1398504310},{"type":"v1","addr":"172.21.15.5:6837","nonce":1398504310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/1045077639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1045077639},{"type":"v1","addr":"172.21.15.87:6833","nonce":1045077639}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4858,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1739323622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1739323622},{"type":"v1","addr":"172.21.15.87:6835","nonce":1739323622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:31.652483+0000","modified":"2024-08-17T02:24:35.247786+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6836/1918940200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1918940200},{"type":"v1","addr":"172.21.15.5:6836","nonce":1918940200}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:24:37.715 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 17 2024-08-17T02:24:37.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.716+0000 7fc866c00640 1 -- 172.21.15.5:0/2924514551 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc840065150 msgr2=0x7fc840067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.716+0000 7fc866c00640 1 --2- 172.21.15.5:0/2924514551 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc840065150 0x7fc840067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc86015c6a0 tx=0x7fc84c009040 comp rx=0 tx=0).stop 2024-08-17T02:24:37.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.716+0000 7fc866c00640 1 -- 172.21.15.5:0/2924514551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc86006dee0 msgr2=0x7fc8600ab760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.716+0000 7fc866c00640 1 --2- 172.21.15.5:0/2924514551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc86006dee0 0x7fc8600ab760 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc85000e900 tx=0x7fc8500090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.716+0000 7fc866c00640 1 -- 172.21.15.5:0/2924514551 shutdown_connections 2024-08-17T02:24:37.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.716+0000 7fc866c00640 1 --2- 172.21.15.5:0/2924514551 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc840065150 0x7fc840067600 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.716+0000 7fc866c00640 1 --2- 172.21.15.5:0/2924514551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8600ae860 0x7fc86006a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.716+0000 7fc866c00640 1 --2- 172.21.15.5:0/2924514551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc860158a20 0x7fc860151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.716+0000 7fc866c00640 1 --2- 172.21.15.5:0/2924514551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc86006dee0 0x7fc8600ab760 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.716+0000 7fc866c00640 1 -- 172.21.15.5:0/2924514551 >> 172.21.15.5:0/2924514551 conn(0x7fc860066e60 msgr2=0x7fc860157020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.716+0000 7fc866c00640 1 -- 172.21.15.5:0/2924514551 shutdown_connections 2024-08-17T02:24:37.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:37.716+0000 7fc866c00640 1 -- 172.21.15.5:0/2924514551 wait complete. 2024-08-17T02:24:38.133 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:24:31.652483+0000', 'modified': '2024-08-17T02:24:35.247786+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4977}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4977': {'gid': 4977, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.5:6836/1918940200', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6835', 'nonce': 1918940200}, {'type': 'v1', 'addr': '172.21.15.5:6836', 'nonce': 1918940200}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:24:38.133 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:24:38.134 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-17T02:24:38.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.290+0000 7fb03c400640 1 Processor -- start 2024-08-17T02:24:38.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.290+0000 7fb03c400640 1 -- start start 2024-08-17T02:24:38.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.291+0000 7fb03c400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb0340add30 0x7fb034156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.291+0000 7fb03c400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0340cb160 con 0x7fb0340ad960 2024-08-17T02:24:38.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.291+0000 7fb03c400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0340b0d10 con 0x7fb0340ca050 2024-08-17T02:24:38.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.291+0000 7fb03c400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0340ca550 con 0x7fb0340add30 2024-08-17T02:24:38.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.292+0000 7fb039a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb0340ad960 0x7fb034156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55758/0 (socket says 172.21.15.5:55758) 2024-08-17T02:24:38.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.292+0000 7fb039a00640 1 -- 172.21.15.5:0/3804018475 learned_addr learned my addr 172.21.15.5:0/3804018475 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.292+0000 7fb03a400640 1 --2- 172.21.15.5:0/3804018475 >> v2:172.21.15.87:3300/0 conn(0x7fb0340add30 0x7fb034156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.292+0000 7fb033e00640 1 -- 172.21.15.5:0/3804018475 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956347869 0 0) 0x7fb0340cb160 con 0x7fb0340ad960 2024-08-17T02:24:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.292+0000 7fb033e00640 1 -- 172.21.15.5:0/3804018475 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb01c0034e0 con 0x7fb0340ad960 2024-08-17T02:24:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.292+0000 7fb033e00640 1 -- 172.21.15.5:0/3804018475 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 721555441 0 0) 0x7fb01c0034e0 con 0x7fb0340ad960 2024-08-17T02:24:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.292+0000 7fb033e00640 1 -- 172.21.15.5:0/3804018475 >> v2:172.21.15.87:3300/0 conn(0x7fb0340add30 msgr2=0x7fb034156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.292+0000 7fb033e00640 1 --2- 172.21.15.5:0/3804018475 >> v2:172.21.15.87:3300/0 conn(0x7fb0340add30 0x7fb034156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb033e00640 1 -- 172.21.15.5:0/3804018475 >> v1:172.21.15.87:6789/0 conn(0x7fb0340ca050 legacy=0x7fb0340aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb033e00640 1 -- 172.21.15.5:0/3804018475 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0340ca830 con 0x7fb0340ad960 2024-08-17T02:24:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb033e00640 1 -- 172.21.15.5:0/3804018475 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2658686246 0 0) 0x7fb028001470 con 0x7fb0340ad960 2024-08-17T02:24:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb033e00640 1 -- 172.21.15.5:0/3804018475 >> v1:172.21.15.5:6789/0 conn(0x7fb0340ad960 legacy=0x7fb034156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb033e00640 1 --2- 172.21.15.5:0/3804018475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb01c0039d0 0x7fb01c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb033e00640 1 --2- 172.21.15.5:0/3804018475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01c004780 0x7fb01c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb033e00640 1 --2- 172.21.15.5:0/3804018475 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb01c005130 0x7fb01c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb033e00640 1 -- 172.21.15.5:0/3804018475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0340ca550 con 0x7fb01c004780 2024-08-17T02:24:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb033e00640 1 -- 172.21.15.5:0/3804018475 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c00c020 con 0x7fb01c0039d0 2024-08-17T02:24:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb033e00640 1 -- 172.21.15.5:0/3804018475 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c00c1e0 con 0x7fb01c005130 2024-08-17T02:24:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb039a00640 1 --2- 172.21.15.5:0/3804018475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb01c0039d0 0x7fb01c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb039000640 1 --2- 172.21.15.5:0/3804018475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01c004780 0x7fb01c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb03a400640 1 --2- 172.21.15.5:0/3804018475 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb01c005130 0x7fb01c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb039000640 1 -- 172.21.15.5:0/3804018475 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb01c005130 msgr2=0x7fb01c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb039000640 1 --2- 172.21.15.5:0/3804018475 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb01c005130 0x7fb01c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb039000640 1 -- 172.21.15.5:0/3804018475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb01c0039d0 msgr2=0x7fb01c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb039000640 1 --2- 172.21.15.5:0/3804018475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb01c0039d0 0x7fb01c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb039000640 1 -- 172.21.15.5:0/3804018475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c0034e0 con 0x7fb01c004780 2024-08-17T02:24:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.293+0000 7fb03a400640 1 -- 172.21.15.5:0/3804018475 reap_dead start 2024-08-17T02:24:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.294+0000 7fb039000640 1 --2- 172.21.15.5:0/3804018475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01c004780 0x7fb01c004bf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb020001920 tx=0x7fb020007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea71afb9f1f9199 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.295+0000 7fb033e00640 1 -- 172.21.15.5:0/3804018475 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02002aac0 con 0x7fb01c004780 2024-08-17T02:24:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.295+0000 7fb033e00640 1 -- 172.21.15.5:0/3804018475 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02002ac40 con 0x7fb01c004780 2024-08-17T02:24:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.295+0000 7fb033e00640 1 -- 172.21.15.5:0/3804018475 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200323f0 con 0x7fb01c004780 2024-08-17T02:24:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.295+0000 7fb03c400640 1 -- 172.21.15.5:0/3804018475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01c004780 msgr2=0x7fb01c004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.295+0000 7fb03c400640 1 --2- 172.21.15.5:0/3804018475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01c004780 0x7fb01c004bf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb020001920 tx=0x7fb020007c80 comp rx=0 tx=0).stop 2024-08-17T02:24:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.295+0000 7fb03c400640 1 -- 172.21.15.5:0/3804018475 shutdown_connections 2024-08-17T02:24:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.295+0000 7fb03c400640 1 --2- 172.21.15.5:0/3804018475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01c004780 0x7fb01c004bf0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.295+0000 7fb03c400640 1 -- 172.21.15.5:0/3804018475 >> 172.21.15.5:0/3804018475 conn(0x7fb034066e60 msgr2=0x7fb034067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.295+0000 7fb03c400640 1 -- 172.21.15.5:0/3804018475 shutdown_connections 2024-08-17T02:24:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.295+0000 7fb03c400640 1 -- 172.21.15.5:0/3804018475 wait complete. 2024-08-17T02:24:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.297+0000 7fb03c400640 1 Processor -- start 2024-08-17T02:24:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.297+0000 7fb03c400640 1 -- start start 2024-08-17T02:24:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.298+0000 7fb03c400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01c004780 0x7fb03406b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.298+0000 7fb03c400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb03406b570 0x7fb0340a73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.298+0000 7fb03c400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0340a7930 0x7fb0340a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.298+0000 7fb03c400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0340ab290 con 0x7fb01c004780 2024-08-17T02:24:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.298+0000 7fb03c400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0340a5760 con 0x7fb03406b570 2024-08-17T02:24:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.298+0000 7fb03c400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0340aacd0 con 0x7fb0340a7930 2024-08-17T02:24:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.298+0000 7fb039a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01c004780 0x7fb03406b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.298+0000 7fb039a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01c004780 0x7fb03406b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44084/0 (socket says 172.21.15.5:44084) 2024-08-17T02:24:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.298+0000 7fb039a00640 1 -- 172.21.15.5:0/319967978 learned_addr learned my addr 172.21.15.5:0/319967978 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.298+0000 7fb03a400640 1 --2- 172.21.15.5:0/319967978 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0340a7930 0x7fb0340a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.298+0000 7fb039000640 1 --2- 172.21.15.5:0/319967978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb03406b570 0x7fb0340a73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.298+0000 7fb039a00640 1 -- 172.21.15.5:0/319967978 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0340a7930 msgr2=0x7fb0340a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.298+0000 7fb039a00640 1 --2- 172.21.15.5:0/319967978 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0340a7930 0x7fb0340a9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.298+0000 7fb039a00640 1 -- 172.21.15.5:0/319967978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb03406b570 msgr2=0x7fb0340a73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.298+0000 7fb039a00640 1 --2- 172.21.15.5:0/319967978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb03406b570 0x7fb0340a73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.298+0000 7fb039a00640 1 -- 172.21.15.5:0/319967978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0340aafb0 con 0x7fb01c004780 2024-08-17T02:24:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.298+0000 7fb039000640 1 --2- 172.21.15.5:0/319967978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb03406b570 0x7fb0340a73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.299+0000 7fb039a00640 1 --2- 172.21.15.5:0/319967978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01c004780 0x7fb03406b030 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb028007fd0 tx=0x7fb028001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.299+0000 7fb030c00640 1 -- 172.21.15.5:0/319967978 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb028004e80 con 0x7fb01c004780 2024-08-17T02:24:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.299+0000 7fb030c00640 1 -- 172.21.15.5:0/319967978 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb028012560 con 0x7fb01c004780 2024-08-17T02:24:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.299+0000 7fb030c00640 1 -- 172.21.15.5:0/319967978 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0280128e0 con 0x7fb01c004780 2024-08-17T02:24:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.299+0000 7fb03c400640 1 -- 172.21.15.5:0/319967978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0340a53f0 con 0x7fb01c004780 2024-08-17T02:24:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.299+0000 7fb03c400640 1 -- 172.21.15.5:0/319967978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0340aa490 con 0x7fb01c004780 2024-08-17T02:24:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.301+0000 7fb030c00640 1 -- 172.21.15.5:0/319967978 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb028012d10 con 0x7fb01c004780 2024-08-17T02:24:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.302+0000 7fb030c00640 1 --2- 172.21.15.5:0/319967978 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb014065150 0x7fb014067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.302+0000 7fb030c00640 1 -- 172.21.15.5:0/319967978 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb028082380 con 0x7fb01c004780 2024-08-17T02:24:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.302+0000 7fb039000640 1 --2- 172.21.15.5:0/319967978 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb014065150 0x7fb014067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.303+0000 7fb03ea3a740 1 Processor -- start 2024-08-17T02:24:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.303+0000 7fb03ea3a740 1 -- start start 2024-08-17T02:24:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.303+0000 7fb039000640 1 --2- 172.21.15.5:0/319967978 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb014065150 0x7fb014067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb0200018f0 tx=0x7fb020003000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.304+0000 7fb03ea3a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 0x559d837d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.304+0000 7fb03ea3a740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d8381b850 0x559d837d32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.304+0000 7fb03ea3a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 0x559d837f9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.304+0000 7fb03ea3a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d8378f380 con 0x559d837d50a0 2024-08-17T02:24:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.304+0000 7fb03ea3a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d837389e0 con 0x559d837d2860 2024-08-17T02:24:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.304+0000 7fb03ea3a740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d83736170 con 0x559d8381b850 2024-08-17T02:24:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.304+0000 7fb03a400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 0x559d837f9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.304+0000 7fb039a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 0x559d837d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.304+0000 7fb039000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d8381b850 0x559d837d32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.304+0000 7fb03a400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 0x559d837f9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44092/0 (socket says 172.21.15.5:44092) 2024-08-17T02:24:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.304+0000 7fb03a400640 1 -- 172.21.15.5:0/2191518637 learned_addr learned my addr 172.21.15.5:0/2191518637 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:38.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.305+0000 7fb03a400640 1 -- 172.21.15.5:0/2191518637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d8381b850 msgr2=0x559d837d32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:38.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.305+0000 7fb03a400640 1 --2- 172.21.15.5:0/2191518637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d8381b850 0x559d837d32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.305+0000 7fb03a400640 1 -- 172.21.15.5:0/2191518637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 msgr2=0x559d837d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:38.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.305+0000 7fb03a400640 1 --2- 172.21.15.5:0/2191518637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 0x559d837d2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.305+0000 7fb03a400640 1 -- 172.21.15.5:0/2191518637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d836e5820 con 0x559d837d50a0 2024-08-17T02:24:38.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.305+0000 7fb039a00640 1 --2- 172.21.15.5:0/2191518637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 0x559d837d2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:38.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.305+0000 7fb03a400640 1 --2- 172.21.15.5:0/2191518637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 0x559d837f9b60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb03406cc20 tx=0x7fb02c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6aba63483e2f7c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.305+0000 7fb025600640 1 -- 172.21.15.5:0/2191518637 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c00e040 con 0x559d837d50a0 2024-08-17T02:24:38.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.305+0000 7fb025600640 1 -- 172.21.15.5:0/2191518637 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02c00f040 con 0x559d837d50a0 2024-08-17T02:24:38.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.305+0000 7fb025600640 1 -- 172.21.15.5:0/2191518637 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c007a50 con 0x559d837d50a0 2024-08-17T02:24:38.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.306+0000 7fb03ea3a740 1 -- 172.21.15.5:0/2191518637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 msgr2=0x559d837f9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.306+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/2191518637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 0x559d837f9b60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb03406cc20 tx=0x7fb02c00b040 comp rx=0 tx=0).stop 2024-08-17T02:24:38.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.306+0000 7fb03ea3a740 1 -- 172.21.15.5:0/2191518637 shutdown_connections 2024-08-17T02:24:38.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.306+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/2191518637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d8381b850 0x559d837d32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.306+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/2191518637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 0x559d837f9b60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.306+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/2191518637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 0x559d837d2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.306+0000 7fb03ea3a740 1 -- 172.21.15.5:0/2191518637 >> 172.21.15.5:0/2191518637 conn(0x559d8376d030 msgr2=0x559d8381bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.306+0000 7fb03ea3a740 1 -- 172.21.15.5:0/2191518637 shutdown_connections 2024-08-17T02:24:38.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.306+0000 7fb03ea3a740 1 -- 172.21.15.5:0/2191518637 wait complete. 2024-08-17T02:24:38.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.307+0000 7fb03ea3a740 1 -- start start 2024-08-17T02:24:38.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.307+0000 7fb03ea3a740 1 Processor -- start 2024-08-17T02:24:38.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.308+0000 7fb03ea3a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 0x559d837fdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.308+0000 7fb03ea3a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 0x559d837fce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.308+0000 7fb03ea3a740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d8381b850 0x559d837fd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.308+0000 7fb03ea3a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d83731f60 con 0x559d837d50a0 2024-08-17T02:24:38.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.308+0000 7fb03ea3a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d836da690 con 0x559d837d2860 2024-08-17T02:24:38.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.308+0000 7fb03ea3a740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d836da330 con 0x559d8381b850 2024-08-17T02:24:38.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.308+0000 7fb03ea3a740 10 client.0 _ll_register_callbacks cb 0x559d836d42b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:24:38.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.308+0000 7fb039000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 0x559d837fce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.308+0000 7fb039000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 0x559d837fce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44098/0 (socket says 172.21.15.5:44098) 2024-08-17T02:24:38.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.308+0000 7fb039000640 1 -- 172.21.15.5:0/2685969144 learned_addr learned my addr 172.21.15.5:0/2685969144 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:38.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.308+0000 7fb039a00640 1 --2- 172.21.15.5:0/2685969144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 0x559d837fdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.308+0000 7fb03a400640 1 --2- 172.21.15.5:0/2685969144 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d8381b850 0x559d837fd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.308+0000 7fb039000640 1 -- 172.21.15.5:0/2685969144 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d8381b850 msgr2=0x559d837fd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:38.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.308+0000 7fb039000640 1 --2- 172.21.15.5:0/2685969144 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d8381b850 0x559d837fd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.308+0000 7fb039000640 1 -- 172.21.15.5:0/2685969144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 msgr2=0x559d837fdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:38.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.308+0000 7fb039000640 1 --2- 172.21.15.5:0/2685969144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 0x559d837fdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.308+0000 7fb039000640 1 -- 172.21.15.5:0/2685969144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c009d10 con 0x559d837d50a0 2024-08-17T02:24:38.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.309+0000 7fb039000640 1 --2- 172.21.15.5:0/2685969144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 0x559d837fce00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb02002a6c0 tx=0x7fb02003b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6338ec00cf7522d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.309+0000 7fb01a000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-17T02:24:38.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.309+0000 7fb01a000640 1 -- 172.21.15.5:0/2685969144 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020006ce0 con 0x559d837d50a0 2024-08-17T02:24:38.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.309+0000 7fb03ea3a740 1 -- 172.21.15.5:0/2685969144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d83765d20 con 0x559d837d50a0 2024-08-17T02:24:38.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.309+0000 7fb01a000640 1 -- 172.21.15.5:0/2685969144 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb020006e40 con 0x559d837d50a0 2024-08-17T02:24:38.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.309+0000 7fb01a000640 1 -- 172.21.15.5:0/2685969144 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0200076e0 con 0x559d837d50a0 2024-08-17T02:24:38.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.309+0000 7fb03ea3a740 10 client.5160 fetch_fsmap learned FSMap version 17 2024-08-17T02:24:38.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.309+0000 7fb03ea3a740 1 -- 172.21.15.5:0/2685969144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x559d836fbab0 con 0x559d837d50a0 2024-08-17T02:24:38.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.309+0000 7fb01a000640 1 -- 172.21.15.5:0/2685969144 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559d83765d20 con 0x559d837d50a0 2024-08-17T02:24:38.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.310+0000 7fb01a000640 1 -- 172.21.15.5:0/2685969144 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb020049070 con 0x559d837d50a0 2024-08-17T02:24:38.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.310+0000 7fb03ea3a740 10 client.5160 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:24:38.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.310+0000 7fb03ea3a740 10 client.5160 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:24:38.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.310+0000 7fb03ea3a740 20 client.5160 populate_metadata read hostname 'smithi005' 2024-08-17T02:24:38.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.310+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/2685969144 >> [v2:172.21.15.5:6835/1918940200,v1:172.21.15.5:6836/1918940200] conn(0x559d8382c8d0 0x559d838195c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.310+0000 7fb03ea3a740 4 client.5160 mds_command: new command op to 4977 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:24:38.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.310+0000 7fb03ea3a740 1 -- 172.21.15.5:0/2685969144 --> [v2:172.21.15.5:6835/1918940200,v1:172.21.15.5:6836/1918940200] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d834393c0 con 0x559d8382c8d0 2024-08-17T02:24:38.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.310+0000 7fb039a00640 1 --2- 172.21.15.5:0/2685969144 >> [v2:172.21.15.5:6835/1918940200,v1:172.21.15.5:6836/1918940200] conn(0x559d8382c8d0 0x559d838195c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.310+0000 7fb01a000640 10 client.5160 ms_handle_connect on v2:172.21.15.5:6835/1918940200 2024-08-17T02:24:38.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.310+0000 7fb039a00640 1 --2- 172.21.15.5:0/2685969144 >> [v2:172.21.15.5:6835/1918940200,v1:172.21.15.5:6836/1918940200] conn(0x559d8382c8d0 0x559d838195c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f2eb3cee9844f11 server_cookie=a848348d97c9a8b in_seq=0 out_seq=0 2024-08-17T02:24:38.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.311+0000 7fb01a000640 1 -- 172.21.15.5:0/2685969144 <== mds.0 v2:172.21.15.5:6835/1918940200 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x559d834393c0 con 0x559d8382c8d0 2024-08-17T02:24:38.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.311+0000 7fb01a000640 10 client.5160 handle_command_reply: tid=0 2024-08-17T02:24:38.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.311+0000 7fb03ea3a740 1 client.5160 shutdown 2024-08-17T02:24:38.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.311+0000 7fb03ea3a740 1 -- 172.21.15.5:0/2685969144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 msgr2=0x559d837fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.311+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/2685969144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 0x559d837fce00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb02002a6c0 tx=0x7fb02003b000 comp rx=0 tx=0).stop 2024-08-17T02:24:38.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.311+0000 7fb03ea3a740 1 -- 172.21.15.5:0/2685969144 shutdown_connections 2024-08-17T02:24:38.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.311+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/2685969144 >> [v2:172.21.15.5:6835/1918940200,v1:172.21.15.5:6836/1918940200] conn(0x559d8382c8d0 0x559d838195c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.311+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/2685969144 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d8381b850 0x559d837fd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.311+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/2685969144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 0x559d837fce00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.311+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/2685969144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 0x559d837fdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.311+0000 7fb01a000640 0 client.5160 ms_handle_reset on v2:172.21.15.5:6835/1918940200 2024-08-17T02:24:38.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.311+0000 7fb03ea3a740 1 -- 172.21.15.5:0/2685969144 >> 172.21.15.5:0/2685969144 conn(0x559d8376d030 msgr2=0x559d837f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.312+0000 7fb03ea3a740 1 -- 172.21.15.5:0/2685969144 shutdown_connections 2024-08-17T02:24:38.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.312+0000 7fb03ea3a740 1 -- 172.21.15.5:0/2685969144 wait complete. 2024-08-17T02:24:38.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.312+0000 7fb03ea3a740 20 client.5160 trim_cache size 0 max 16384 2024-08-17T02:24:38.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.327+0000 7fb03ea3a740 1 Processor -- start 2024-08-17T02:24:38.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.327+0000 7fb03ea3a740 1 -- start start 2024-08-17T02:24:38.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.328+0000 7fb03ea3a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 0x559d8381abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.328+0000 7fb03ea3a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 0x559d8381b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.328+0000 7fb03ea3a740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d8381b850 0x559d83817120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.328+0000 7fb03ea3a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d834acf20 con 0x559d837d50a0 2024-08-17T02:24:38.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.328+0000 7fb03ea3a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d837cfda0 con 0x559d837d2860 2024-08-17T02:24:38.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.328+0000 7fb03ea3a740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d837cce80 con 0x559d8381b850 2024-08-17T02:24:38.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.328+0000 7fb039000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 0x559d8381b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.329+0000 7fb039000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 0x559d8381b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44112/0 (socket says 172.21.15.5:44112) 2024-08-17T02:24:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.329+0000 7fb039000640 1 -- 172.21.15.5:0/2986663860 learned_addr learned my addr 172.21.15.5:0/2986663860 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.329+0000 7fb039a00640 1 --2- 172.21.15.5:0/2986663860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 0x559d8381abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.329+0000 7fb03a400640 1 --2- 172.21.15.5:0/2986663860 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d8381b850 0x559d83817120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.329+0000 7fb039000640 1 -- 172.21.15.5:0/2986663860 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d8381b850 msgr2=0x559d83817120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.329+0000 7fb039000640 1 --2- 172.21.15.5:0/2986663860 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d8381b850 0x559d83817120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.329+0000 7fb039000640 1 -- 172.21.15.5:0/2986663860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 msgr2=0x559d8381abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.329+0000 7fb039000640 1 --2- 172.21.15.5:0/2986663860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 0x559d8381abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.329+0000 7fb039000640 1 -- 172.21.15.5:0/2986663860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d836ff490 con 0x559d837d50a0 2024-08-17T02:24:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.329+0000 7fb03a400640 1 --2- 172.21.15.5:0/2986663860 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d8381b850 0x559d83817120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.329+0000 7fb039000640 1 --2- 172.21.15.5:0/2986663860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 0x559d8381b130 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb020007ce0 tx=0x7fb020049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8652fbb74b07f37 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.329+0000 7fb026000640 1 -- 172.21.15.5:0/2986663860 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200076e0 con 0x559d837d50a0 2024-08-17T02:24:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.330+0000 7fb026000640 1 -- 172.21.15.5:0/2986663860 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02002aa90 con 0x559d837d50a0 2024-08-17T02:24:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.330+0000 7fb026000640 1 -- 172.21.15.5:0/2986663860 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200325e0 con 0x559d837d50a0 2024-08-17T02:24:38.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.330+0000 7fb03ea3a740 1 -- 172.21.15.5:0/2986663860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 msgr2=0x559d8381b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.330+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/2986663860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 0x559d8381b130 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb020007ce0 tx=0x7fb020049000 comp rx=0 tx=0).stop 2024-08-17T02:24:38.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.330+0000 7fb03ea3a740 1 -- 172.21.15.5:0/2986663860 shutdown_connections 2024-08-17T02:24:38.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.330+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/2986663860 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d8381b850 0x559d83817120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.330+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/2986663860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d837d50a0 0x559d8381b130 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.330+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/2986663860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 0x559d8381abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.330+0000 7fb03ea3a740 1 -- 172.21.15.5:0/2986663860 >> 172.21.15.5:0/2986663860 conn(0x559d8376d030 msgr2=0x559d837d3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.330+0000 7fb03ea3a740 1 -- 172.21.15.5:0/2986663860 shutdown_connections 2024-08-17T02:24:38.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.330+0000 7fb03ea3a740 1 -- 172.21.15.5:0/2986663860 wait complete. 2024-08-17T02:24:38.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.331+0000 7fb03ea3a740 1 -- start start 2024-08-17T02:24:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.331+0000 7fb03ea3a740 1 Processor -- start 2024-08-17T02:24:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.332+0000 7fb03ea3a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 0x559d837fec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.332+0000 7fb03ea3a740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d837d50a0 0x559d838830b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.332+0000 7fb03ea3a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d8381b850 0x559d838835f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.332+0000 7fb03ea3a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d837fca90 con 0x559d8381b850 2024-08-17T02:24:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.332+0000 7fb03ea3a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d838161a0 con 0x559d837d2860 2024-08-17T02:24:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.332+0000 7fb03ea3a740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d83883b30 con 0x559d837d50a0 2024-08-17T02:24:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.332+0000 7fb03ea3a740 10 client.0 _ll_register_callbacks cb 0x7fb02c009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:24:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.332+0000 7fb03a400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d8381b850 0x559d838835f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.332+0000 7fb03a400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d8381b850 0x559d838835f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44116/0 (socket says 172.21.15.5:44116) 2024-08-17T02:24:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.332+0000 7fb03a400640 1 -- 172.21.15.5:0/1385314001 learned_addr learned my addr 172.21.15.5:0/1385314001 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.332+0000 7fb039a00640 1 --2- 172.21.15.5:0/1385314001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 0x559d837fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.333+0000 7fb039000640 1 --2- 172.21.15.5:0/1385314001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d837d50a0 0x559d838830b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.333+0000 7fb03a400640 1 -- 172.21.15.5:0/1385314001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d837d50a0 msgr2=0x559d838830b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.333+0000 7fb03a400640 1 --2- 172.21.15.5:0/1385314001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d837d50a0 0x559d838830b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.333+0000 7fb03a400640 1 -- 172.21.15.5:0/1385314001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 msgr2=0x559d837fec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.333+0000 7fb03a400640 1 --2- 172.21.15.5:0/1385314001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 0x559d837fec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.333+0000 7fb03a400640 1 -- 172.21.15.5:0/1385314001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d836fbab0 con 0x559d8381b850 2024-08-17T02:24:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.333+0000 7fb039000640 1 --2- 172.21.15.5:0/1385314001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d837d50a0 0x559d838830b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.333+0000 7fb03a400640 1 --2- 172.21.15.5:0/1385314001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d8381b850 0x559d838835f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x559d837d20f0 tx=0x7fb02c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f5c37f481579f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.333+0000 7fb01a000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-17T02:24:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.333+0000 7fb01a000640 1 -- 172.21.15.5:0/1385314001 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c026070 con 0x559d8381b850 2024-08-17T02:24:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.333+0000 7fb01a000640 1 -- 172.21.15.5:0/1385314001 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb02c016770 con 0x559d8381b850 2024-08-17T02:24:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.333+0000 7fb03ea3a740 1 -- 172.21.15.5:0/1385314001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb02c00f040 con 0x559d8381b850 2024-08-17T02:24:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.334+0000 7fb01a000640 1 -- 172.21.15.5:0/1385314001 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb02c00e040 con 0x559d8381b850 2024-08-17T02:24:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.334+0000 7fb03ea3a740 10 client.5166 fetch_fsmap learned FSMap version 17 2024-08-17T02:24:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.334+0000 7fb03ea3a740 1 -- 172.21.15.5:0/1385314001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x559d836ff1e0 con 0x559d8381b850 2024-08-17T02:24:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.334+0000 7fb01a000640 1 -- 172.21.15.5:0/1385314001 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02c00f040 con 0x559d8381b850 2024-08-17T02:24:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.334+0000 7fb01a000640 1 -- 172.21.15.5:0/1385314001 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb02c014040 con 0x559d8381b850 2024-08-17T02:24:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.334+0000 7fb03ea3a740 10 client.5166 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:24:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.334+0000 7fb03ea3a740 10 client.5166 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:24:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.334+0000 7fb03ea3a740 20 client.5166 populate_metadata read hostname 'smithi005' 2024-08-17T02:24:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.334+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/1385314001 >> [v2:172.21.15.5:6835/1918940200,v1:172.21.15.5:6836/1918940200] conn(0x559d83800300 0x559d838006d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.334+0000 7fb03ea3a740 4 client.5166 mds_command: new command op to 4977 tid=0[{"prefix": "status"}] 2024-08-17T02:24:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.334+0000 7fb03ea3a740 1 -- 172.21.15.5:0/1385314001 --> [v2:172.21.15.5:6835/1918940200,v1:172.21.15.5:6836/1918940200] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559d8344a6c0 con 0x559d83800300 2024-08-17T02:24:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.334+0000 7fb039a00640 1 --2- 172.21.15.5:0/1385314001 >> [v2:172.21.15.5:6835/1918940200,v1:172.21.15.5:6836/1918940200] conn(0x559d83800300 0x559d838006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.335+0000 7fb039a00640 1 --2- 172.21.15.5:0/1385314001 >> [v2:172.21.15.5:6835/1918940200,v1:172.21.15.5:6836/1918940200] conn(0x559d83800300 0x559d838006d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a247a54d124ee2e8 server_cookie=2405a56b4d483a2d in_seq=0 out_seq=0 2024-08-17T02:24:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.335+0000 7fb01a000640 10 client.5166 ms_handle_connect on v2:172.21.15.5:6835/1918940200 2024-08-17T02:24:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.335+0000 7fb01a000640 1 -- 172.21.15.5:0/1385314001 <== mds.0 v2:172.21.15.5:6835/1918940200 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x559d8344a6c0 con 0x559d83800300 2024-08-17T02:24:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.335+0000 7fb01a000640 10 client.5166 handle_command_reply: tid=0 2024-08-17T02:24:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.335+0000 7fb03ea3a740 1 client.5166 shutdown 2024-08-17T02:24:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.335+0000 7fb03ea3a740 1 -- 172.21.15.5:0/1385314001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d8381b850 msgr2=0x559d838835f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.335+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/1385314001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d8381b850 0x559d838835f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x559d837d20f0 tx=0x7fb02c01c000 comp rx=0 tx=0).stop 2024-08-17T02:24:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.335+0000 7fb03ea3a740 1 -- 172.21.15.5:0/1385314001 shutdown_connections 2024-08-17T02:24:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.335+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/1385314001 >> [v2:172.21.15.5:6835/1918940200,v1:172.21.15.5:6836/1918940200] conn(0x559d83800300 0x559d838006d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.335+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/1385314001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x559d837d50a0 0x559d838830b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.335+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/1385314001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559d8381b850 0x559d838835f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.335+0000 7fb03ea3a740 1 --2- 172.21.15.5:0/1385314001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d837d2860 0x559d837fec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.335+0000 7fb01a000640 0 client.5166 ms_handle_reset on v2:172.21.15.5:6835/1918940200 2024-08-17T02:24:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.335+0000 7fb03ea3a740 1 -- 172.21.15.5:0/1385314001 >> 172.21.15.5:0/1385314001 conn(0x559d8376d030 msgr2=0x559d837d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.335+0000 7fb03ea3a740 1 -- 172.21.15.5:0/1385314001 shutdown_connections 2024-08-17T02:24:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.335+0000 7fb03ea3a740 1 -- 172.21.15.5:0/1385314001 wait complete. 2024-08-17T02:24:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.336+0000 7fb03ea3a740 20 client.5166 trim_cache size 0 max 16384 2024-08-17T02:24:38.341 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:24:38.341 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "9411fcb4-b308-4a27-a404-b7a846d24e75", 2024-08-17T02:24:38.341 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-17T02:24:38.341 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4977, 2024-08-17T02:24:38.341 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-17T02:24:38.341 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-17T02:24:38.341 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-17T02:24:38.342 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 6.1155689569999998, 2024-08-17T02:24:38.342 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 17, 2024-08-17T02:24:38.342 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 34, 2024-08-17T02:24:38.342 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 34, 2024-08-17T02:24:38.342 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 21.020308289999999 2024-08-17T02:24:38.342 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:24:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.336+0000 7fb03c400640 1 -- 172.21.15.5:0/319967978 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb014065150 msgr2=0x7fb014067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.336+0000 7fb03c400640 1 --2- 172.21.15.5:0/319967978 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb014065150 0x7fb014067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb0200018f0 tx=0x7fb020003000 comp rx=0 tx=0).stop 2024-08-17T02:24:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.336+0000 7fb03c400640 1 -- 172.21.15.5:0/319967978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01c004780 msgr2=0x7fb03406b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.336+0000 7fb03c400640 1 --2- 172.21.15.5:0/319967978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01c004780 0x7fb03406b030 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb028007fd0 tx=0x7fb028001da0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.336+0000 7fb03c400640 1 -- 172.21.15.5:0/319967978 shutdown_connections 2024-08-17T02:24:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.336+0000 7fb03c400640 1 --2- 172.21.15.5:0/319967978 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb014065150 0x7fb014067600 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.336+0000 7fb03c400640 1 --2- 172.21.15.5:0/319967978 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0340a7930 0x7fb0340a9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.336+0000 7fb03c400640 1 --2- 172.21.15.5:0/319967978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb03406b570 0x7fb0340a73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.336+0000 7fb03c400640 1 --2- 172.21.15.5:0/319967978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01c004780 0x7fb03406b030 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.336+0000 7fb03c400640 1 -- 172.21.15.5:0/319967978 >> 172.21.15.5:0/319967978 conn(0x7fb034066e60 msgr2=0x7fb034069830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.336+0000 7fb03c400640 1 -- 172.21.15.5:0/319967978 shutdown_connections 2024-08-17T02:24:38.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.336+0000 7fb03c400640 1 -- 172.21.15.5:0/319967978 wait complete. 2024-08-17T02:24:38.352 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:24:38.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.502+0000 7fc781c00640 1 Processor -- start 2024-08-17T02:24:38.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.502+0000 7fc781c00640 1 -- start start 2024-08-17T02:24:38.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.503+0000 7fc781c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc77c06e060 0x7fc77c06e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.503+0000 7fc781c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc77c0af340 0x7fc77c0af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.503+0000 7fc781c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77c0aeeb0 con 0x7fc77c155040 2024-08-17T02:24:38.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.503+0000 7fc781c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77c06e9f0 con 0x7fc77c0af340 2024-08-17T02:24:38.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.503+0000 7fc781c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c0aadd0 con 0x7fc77c06e060 2024-08-17T02:24:38.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.504+0000 7fc77a000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc77c06e060 0x7fc77c06e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.504+0000 7fc77a000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc77c06e060 0x7fc77c06e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:44816/0 (socket says 172.21.15.5:44816) 2024-08-17T02:24:38.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.504+0000 7fc77a000640 1 -- 172.21.15.5:0/2173087187 learned_addr learned my addr 172.21.15.5:0/2173087187 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:38.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.504+0000 7fc77b400640 1 --2- 172.21.15.5:0/2173087187 >> v2:172.21.15.87:3300/0 conn(0x7fc77c0af340 0x7fc77c0af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.504+0000 7fc77a000640 1 -- 172.21.15.5:0/2173087187 >> v2:172.21.15.87:3300/0 conn(0x7fc77c0af340 msgr2=0x7fc77c0af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:38.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.504+0000 7fc77a000640 1 --2- 172.21.15.5:0/2173087187 >> v2:172.21.15.87:3300/0 conn(0x7fc77c0af340 0x7fc77c0af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.504+0000 7fc77a000640 1 -- 172.21.15.5:0/2173087187 >> v1:172.21.15.87:6789/0 conn(0x7fc77c155040 legacy=0x7fc77c158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.504+0000 7fc77a000640 1 -- 172.21.15.5:0/2173087187 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c1597f0 con 0x7fc77c06e060 2024-08-17T02:24:38.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.505+0000 7fc77a000640 1 --2- 172.21.15.5:0/2173087187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc77c06e060 0x7fc77c06e4b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc768009910 tx=0x7fc7680091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5155a20cd4aed8c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.506+0000 7fc779600640 1 -- 172.21.15.5:0/2173087187 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768033440 con 0x7fc77c06e060 2024-08-17T02:24:38.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.506+0000 7fc779600640 1 -- 172.21.15.5:0/2173087187 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7680335a0 con 0x7fc77c06e060 2024-08-17T02:24:38.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.506+0000 7fc779600640 1 -- 172.21.15.5:0/2173087187 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768033980 con 0x7fc77c06e060 2024-08-17T02:24:38.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.506+0000 7fc781c00640 1 -- 172.21.15.5:0/2173087187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc77c06e060 msgr2=0x7fc77c06e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.506+0000 7fc781c00640 1 --2- 172.21.15.5:0/2173087187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc77c06e060 0x7fc77c06e4b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc768009910 tx=0x7fc7680091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.506+0000 7fc781c00640 1 -- 172.21.15.5:0/2173087187 shutdown_connections 2024-08-17T02:24:38.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.506+0000 7fc781c00640 1 --2- 172.21.15.5:0/2173087187 >> v2:172.21.15.87:3300/0 conn(0x7fc77c0af340 0x7fc77c0af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.506+0000 7fc781c00640 1 --2- 172.21.15.5:0/2173087187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc77c06e060 0x7fc77c06e4b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.506+0000 7fc781c00640 1 -- 172.21.15.5:0/2173087187 >> 172.21.15.5:0/2173087187 conn(0x7fc77c066e60 msgr2=0x7fc77c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.506+0000 7fc781c00640 1 -- 172.21.15.5:0/2173087187 shutdown_connections 2024-08-17T02:24:38.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.506+0000 7fc781c00640 1 -- 172.21.15.5:0/2173087187 wait complete. 2024-08-17T02:24:38.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.508+0000 7fc781c00640 1 Processor -- start 2024-08-17T02:24:38.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.508+0000 7fc781c00640 1 -- start start 2024-08-17T02:24:38.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.508+0000 7fc781c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc77c06e060 0x7fc77c1536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.509+0000 7fc781c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc77c0af340 0x7fc77c069830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.509+0000 7fc781c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc77c155040 0x7fc77c0c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.509+0000 7fc781c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c06b040 con 0x7fc77c155040 2024-08-17T02:24:38.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.509+0000 7fc781c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c1692a0 con 0x7fc77c0af340 2024-08-17T02:24:38.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.509+0000 7fc781c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c069f30 con 0x7fc77c06e060 2024-08-17T02:24:38.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.509+0000 7fc77b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc77c155040 0x7fc77c0c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.509+0000 7fc77b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc77c155040 0x7fc77c0c2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44134/0 (socket says 172.21.15.5:44134) 2024-08-17T02:24:38.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.509+0000 7fc77b400640 1 -- 172.21.15.5:0/1100711892 learned_addr learned my addr 172.21.15.5:0/1100711892 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:38.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.509+0000 7fc77aa00640 1 --2- 172.21.15.5:0/1100711892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc77c06e060 0x7fc77c1536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.509+0000 7fc77a000640 1 --2- 172.21.15.5:0/1100711892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc77c0af340 0x7fc77c069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.509+0000 7fc77b400640 1 -- 172.21.15.5:0/1100711892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc77c06e060 msgr2=0x7fc77c1536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.509+0000 7fc77b400640 1 --2- 172.21.15.5:0/1100711892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc77c06e060 0x7fc77c1536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.509+0000 7fc77b400640 1 -- 172.21.15.5:0/1100711892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc77c0af340 msgr2=0x7fc77c069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.509+0000 7fc77b400640 1 --2- 172.21.15.5:0/1100711892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc77c0af340 0x7fc77c069830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.509+0000 7fc77b400640 1 -- 172.21.15.5:0/1100711892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc768009450 con 0x7fc77c155040 2024-08-17T02:24:38.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.510+0000 7fc77b400640 1 --2- 172.21.15.5:0/1100711892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc77c155040 0x7fc77c0c2aa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc774009e90 tx=0x7fc77400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.510+0000 7fc772000640 1 -- 172.21.15.5:0/1100711892 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77400ce10 con 0x7fc77c155040 2024-08-17T02:24:38.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.510+0000 7fc772000640 1 -- 172.21.15.5:0/1100711892 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77400f040 con 0x7fc77c155040 2024-08-17T02:24:38.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.510+0000 7fc772000640 1 -- 172.21.15.5:0/1100711892 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7740146d0 con 0x7fc77c155040 2024-08-17T02:24:38.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.510+0000 7fc781c00640 1 -- 172.21.15.5:0/1100711892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77c06a210 con 0x7fc77c155040 2024-08-17T02:24:38.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.510+0000 7fc781c00640 1 -- 172.21.15.5:0/1100711892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77c06a7d0 con 0x7fc77c155040 2024-08-17T02:24:38.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.511+0000 7fc781c00640 1 -- 172.21.15.5:0/1100711892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc77c169410 con 0x7fc77c155040 2024-08-17T02:24:38.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.512+0000 7fc772000640 1 -- 172.21.15.5:0/1100711892 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc774014a80 con 0x7fc77c155040 2024-08-17T02:24:38.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.513+0000 7fc772000640 1 --2- 172.21.15.5:0/1100711892 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc75c065150 0x7fc75c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.513+0000 7fc772000640 1 -- 172.21.15.5:0/1100711892 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc774082f80 con 0x7fc77c155040 2024-08-17T02:24:38.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.513+0000 7fc77aa00640 1 --2- 172.21.15.5:0/1100711892 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc75c065150 0x7fc75c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.514+0000 7fc77aa00640 1 --2- 172.21.15.5:0/1100711892 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc75c065150 0x7fc75c067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc76c007fd0 tx=0x7fc76c007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.517+0000 7fc772000640 1 -- 172.21.15.5:0/1100711892 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc774054ae0 con 0x7fc77c155040 2024-08-17T02:24:38.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.736+0000 7fc781c00640 1 -- 172.21.15.5:0/1100711892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc77c063fb0 con 0x7fc77c155040 2024-08-17T02:24:38.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.736+0000 7fc772000640 1 -- 172.21.15.5:0/1100711892 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc774018060 con 0x7fc77c155040 2024-08-17T02:24:38.737 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:24:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.739+0000 7fc781c00640 1 -- 172.21.15.5:0/1100711892 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc75c065150 msgr2=0x7fc75c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.739+0000 7fc781c00640 1 --2- 172.21.15.5:0/1100711892 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc75c065150 0x7fc75c067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc76c007fd0 tx=0x7fc76c007e30 comp rx=0 tx=0).stop 2024-08-17T02:24:38.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.739+0000 7fc781c00640 1 -- 172.21.15.5:0/1100711892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc77c155040 msgr2=0x7fc77c0c2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.739+0000 7fc781c00640 1 --2- 172.21.15.5:0/1100711892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc77c155040 0x7fc77c0c2aa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc774009e90 tx=0x7fc77400b040 comp rx=0 tx=0).stop 2024-08-17T02:24:38.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.739+0000 7fc781c00640 1 -- 172.21.15.5:0/1100711892 shutdown_connections 2024-08-17T02:24:38.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.739+0000 7fc781c00640 1 --2- 172.21.15.5:0/1100711892 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc75c065150 0x7fc75c067600 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.739+0000 7fc781c00640 1 --2- 172.21.15.5:0/1100711892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc77c155040 0x7fc77c0c2aa0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.739+0000 7fc781c00640 1 --2- 172.21.15.5:0/1100711892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc77c0af340 0x7fc77c069830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.739+0000 7fc781c00640 1 --2- 172.21.15.5:0/1100711892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc77c06e060 0x7fc77c1536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.739+0000 7fc781c00640 1 -- 172.21.15.5:0/1100711892 >> 172.21.15.5:0/1100711892 conn(0x7fc77c066e60 msgr2=0x7fc77c0ab020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.739+0000 7fc781c00640 1 -- 172.21.15.5:0/1100711892 shutdown_connections 2024-08-17T02:24:38.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:38.739+0000 7fc781c00640 1 -- 172.21.15.5:0/1100711892 wait complete. 2024-08-17T02:24:38.754 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:24:38.754 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:24:38.754 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-17T02:24:38.754 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:24:38.754 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:24:38.754 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:24:38.755 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:24:38.755 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:24:38.755 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:24:38.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:38.755 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-17T02:24:38.791 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:24:38.791 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:24:38.791 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:24:38.791 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:38.791 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-17T02:24:38.791 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:38.791 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:38.792 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:38.792 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-17T02:24:38.792 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:38.792 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:38.792 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-17T02:24:38.792 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:24:38.792 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:38.792 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-17T02:24:38.792 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:24:38.792 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42616sec preferred_lft 42616sec 2024-08-17T02:24:38.792 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-08-17T02:24:38.792 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:38.792 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:38.792 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:38.792 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-17T02:24:38.793 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:24:38.793 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether ae:97:3b:2a:da:cd brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:38.793 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:24:38.793 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:38.793 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c8fe:10ff:feb3:597a/64 scope link 2024-08-17T02:24:38.793 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:38.793 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:24:38.793 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether ae:97:3b:2a:da:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:24:38.793 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ac97:3bff:fe2a:dacd/64 scope link 2024-08-17T02:24:38.793 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:38.793 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:24:38.793 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether de:2b:6f:88:70:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:24:38.793 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::dc2b:6fff:fe88:7037/64 scope link 2024-08-17T02:24:38.793 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:38.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:38.794 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:24:38.884 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-17T02:24:38.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:38.887 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-17T02:24:38.924 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-17T02:24:38.924 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:24:38.924 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:24:38.924 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:24:38.924 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:24:38.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:38.924 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:24:38.924 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:24:38.924 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:24:38.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:24:38.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:24:38.925 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:24:39.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:39.074 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-17T02:24:39.109 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:24:39.109 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:24:39.110 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:24:39.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:39.110 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-17T02:24:39.207 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:24:39.207 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:24:39.243 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:24:39.243 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:24:39.243 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:24:39.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:39.290 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:39.318 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:24:39.318 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:24:39.318 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:39.440 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:39.441 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:24:39.467 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:39.468 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:24:39.468 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.87:3300,172.21.15.87:3301" 2024-08-17T02:24:39.468 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@9411fcb4-b308-4a27-a404-b7a846d24e75.cephfs=/ 2024-08-17T02:24:39.468 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.87:3300/172.21.15.87:3301" will pass to kernel 2024-08-17T02:24:39.468 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:24:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:24:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:24:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:24:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:24:39.471 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:24:39.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:39.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:24:39.528 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:24:39.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.679+0000 7f302b800640 1 Processor -- start 2024-08-17T02:24:39.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.680+0000 7f302b800640 1 -- start start 2024-08-17T02:24:39.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.681+0000 7f302b800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30240afca0 0x7f30240b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.681+0000 7f302b800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f30241590b0 0x7f3024159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.681+0000 7f302b800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302415a4e0 con 0x7f30240acf10 2024-08-17T02:24:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.681+0000 7f302b800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30240b0980 con 0x7f30241590b0 2024-08-17T02:24:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.681+0000 7f302b800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30240c92b0 con 0x7f30240afca0 2024-08-17T02:24:39.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.681+0000 7f3028e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30240afca0 0x7f30240b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.682+0000 7f3023e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f30240acf10 0x7f30241589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:33114/0 (socket says 172.21.15.5:33114) 2024-08-17T02:24:39.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.682+0000 7f3028e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30240afca0 0x7f30240b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:44836/0 (socket says 172.21.15.5:44836) 2024-08-17T02:24:39.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.682+0000 7f3028e00640 1 -- 172.21.15.5:0/2643775851 learned_addr learned my addr 172.21.15.5:0/2643775851 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:39.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.682+0000 7f3029800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f30241590b0 0x7f3024159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.682+0000 7f3028e00640 1 -- 172.21.15.5:0/2643775851 >> v2:172.21.15.87:3300/0 conn(0x7f30241590b0 msgr2=0x7f3024159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.682+0000 7f3028e00640 1 --2- 172.21.15.5:0/2643775851 >> v2:172.21.15.87:3300/0 conn(0x7f30241590b0 0x7f3024159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.682+0000 7f3023400640 1 -- 172.21.15.5:0/2643775851 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509170816 0 0) 0x7f3010001110 con 0x7f30240acf10 2024-08-17T02:24:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.682+0000 7f3028e00640 1 -- 172.21.15.5:0/2643775851 >> v1:172.21.15.87:6789/0 conn(0x7f30240acf10 legacy=0x7f30241589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.682+0000 7f3028e00640 1 -- 172.21.15.5:0/2643775851 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30240ad480 con 0x7f30240afca0 2024-08-17T02:24:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.683+0000 7f3028e00640 1 --2- 172.21.15.5:0/2643775851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30240afca0 0x7f30240b0070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3018009910 tx=0x7f30180091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c7949dbebdca51b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.683+0000 7f3023400640 1 -- 172.21.15.5:0/2643775851 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301802ae40 con 0x7f30240afca0 2024-08-17T02:24:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.683+0000 7f3023400640 1 -- 172.21.15.5:0/2643775851 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3018032440 con 0x7f30240afca0 2024-08-17T02:24:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.683+0000 7f3023400640 1 -- 172.21.15.5:0/2643775851 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30180327e0 con 0x7f30240afca0 2024-08-17T02:24:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.684+0000 7f302b800640 1 -- 172.21.15.5:0/2643775851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30240afca0 msgr2=0x7f30240b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.684+0000 7f302b800640 1 --2- 172.21.15.5:0/2643775851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30240afca0 0x7f30240b0070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3018009910 tx=0x7f30180091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.684+0000 7f302b800640 1 -- 172.21.15.5:0/2643775851 shutdown_connections 2024-08-17T02:24:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.684+0000 7f302b800640 1 --2- 172.21.15.5:0/2643775851 >> v2:172.21.15.87:3300/0 conn(0x7f30241590b0 0x7f3024159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.684+0000 7f302b800640 1 --2- 172.21.15.5:0/2643775851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30240afca0 0x7f30240b0070 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.684+0000 7f302b800640 1 -- 172.21.15.5:0/2643775851 >> 172.21.15.5:0/2643775851 conn(0x7f3024066e60 msgr2=0x7f3024067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.684+0000 7f302b800640 1 -- 172.21.15.5:0/2643775851 shutdown_connections 2024-08-17T02:24:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.684+0000 7f302b800640 1 -- 172.21.15.5:0/2643775851 wait complete. 2024-08-17T02:24:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.685+0000 7f302b800640 1 Processor -- start 2024-08-17T02:24:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.686+0000 7f302b800640 1 -- start start 2024-08-17T02:24:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.686+0000 7f302b800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30240acf10 0x7f3024169490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.686+0000 7f302b800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30240afca0 0x7f30240c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.687+0000 7f302b800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30241590b0 0x7f302414e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.687+0000 7f302b800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3024153ad0 con 0x7f30240afca0 2024-08-17T02:24:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.687+0000 7f302b800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3024153230 con 0x7f30241590b0 2024-08-17T02:24:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.687+0000 7f302b800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3024153510 con 0x7f30240acf10 2024-08-17T02:24:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.687+0000 7f3023e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30240afca0 0x7f30240c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.687+0000 7f3028e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30240acf10 0x7f3024169490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.687+0000 7f3029800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30241590b0 0x7f302414e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.687+0000 7f3023e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30240afca0 0x7f30240c9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44148/0 (socket says 172.21.15.5:44148) 2024-08-17T02:24:39.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.687+0000 7f3028e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30240acf10 0x7f3024169490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:44848/0 (socket says 172.21.15.5:44848) 2024-08-17T02:24:39.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.687+0000 7f3023e00640 1 -- 172.21.15.5:0/3043125860 learned_addr learned my addr 172.21.15.5:0/3043125860 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:39.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.687+0000 7f3023e00640 1 -- 172.21.15.5:0/3043125860 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30240acf10 msgr2=0x7f3024169490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.687+0000 7f3023e00640 1 --2- 172.21.15.5:0/3043125860 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30240acf10 0x7f3024169490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.687+0000 7f3023e00640 1 -- 172.21.15.5:0/3043125860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30241590b0 msgr2=0x7f302414e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.687+0000 7f3023e00640 1 --2- 172.21.15.5:0/3043125860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30241590b0 0x7f302414e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.687+0000 7f3023e00640 1 -- 172.21.15.5:0/3043125860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018009450 con 0x7f30240afca0 2024-08-17T02:24:39.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.688+0000 7f3023e00640 1 --2- 172.21.15.5:0/3043125860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30240afca0 0x7f30240c9970 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f301000c810 tx=0x7f3010007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.688+0000 7f3017e00640 1 -- 172.21.15.5:0/3043125860 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30100070f0 con 0x7f30240afca0 2024-08-17T02:24:39.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.688+0000 7f3017e00640 1 -- 172.21.15.5:0/3043125860 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3010007290 con 0x7f30240afca0 2024-08-17T02:24:39.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.688+0000 7f3017e00640 1 -- 172.21.15.5:0/3043125860 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3010007690 con 0x7f30240afca0 2024-08-17T02:24:39.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.688+0000 7f302b800640 1 -- 172.21.15.5:0/3043125860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30241537f0 con 0x7f30240afca0 2024-08-17T02:24:39.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.688+0000 7f302b800640 1 -- 172.21.15.5:0/3043125860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30241699d0 con 0x7f30240afca0 2024-08-17T02:24:39.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.689+0000 7f302b800640 1 -- 172.21.15.5:0/3043125860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302414eff0 con 0x7f30240afca0 2024-08-17T02:24:39.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.690+0000 7f3017e00640 1 -- 172.21.15.5:0/3043125860 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f30100049b0 con 0x7f30240afca0 2024-08-17T02:24:39.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.691+0000 7f3017e00640 1 --2- 172.21.15.5:0/3043125860 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3004065150 0x7f3004067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.691+0000 7f3017e00640 1 -- 172.21.15.5:0/3043125860 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3010081700 con 0x7f30240afca0 2024-08-17T02:24:39.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.691+0000 7f3028e00640 1 --2- 172.21.15.5:0/3043125860 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3004065150 0x7f3004067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.692+0000 7f3028e00640 1 --2- 172.21.15.5:0/3043125860 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3004065150 0x7f3004067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3018034000 tx=0x7f3018032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.695+0000 7f3017e00640 1 -- 172.21.15.5:0/3043125860 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f301004ce40 con 0x7f30240afca0 2024-08-17T02:24:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.919+0000 7f302b800640 1 -- 172.21.15.5:0/3043125860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f302415aca0 con 0x7f30240afca0 2024-08-17T02:24:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.919+0000 7f3017e00640 1 -- 172.21.15.5:0/3043125860 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f302415aca0 con 0x7f30240afca0 2024-08-17T02:24:39.920 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:24:39.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.921+0000 7f302b800640 1 -- 172.21.15.5:0/3043125860 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3004065150 msgr2=0x7f3004067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.921+0000 7f302b800640 1 --2- 172.21.15.5:0/3043125860 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3004065150 0x7f3004067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3018034000 tx=0x7f3018032000 comp rx=0 tx=0).stop 2024-08-17T02:24:39.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.921+0000 7f302b800640 1 -- 172.21.15.5:0/3043125860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30240afca0 msgr2=0x7f30240c9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.921+0000 7f302b800640 1 --2- 172.21.15.5:0/3043125860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30240afca0 0x7f30240c9970 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f301000c810 tx=0x7f3010007bc0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.921+0000 7f302b800640 1 -- 172.21.15.5:0/3043125860 shutdown_connections 2024-08-17T02:24:39.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.921+0000 7f302b800640 1 --2- 172.21.15.5:0/3043125860 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3004065150 0x7f3004067600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.921+0000 7f302b800640 1 --2- 172.21.15.5:0/3043125860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30241590b0 0x7f302414e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.921+0000 7f302b800640 1 --2- 172.21.15.5:0/3043125860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30240afca0 0x7f30240c9970 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.921+0000 7f302b800640 1 --2- 172.21.15.5:0/3043125860 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30240acf10 0x7f3024169490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.921+0000 7f302b800640 1 -- 172.21.15.5:0/3043125860 >> 172.21.15.5:0/3043125860 conn(0x7f3024066e60 msgr2=0x7f302415b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:39.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.921+0000 7f302b800640 1 -- 172.21.15.5:0/3043125860 shutdown_connections 2024-08-17T02:24:39.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:39.921+0000 7f302b800640 1 -- 172.21.15.5:0/3043125860 wait complete. 2024-08-17T02:24:39.937 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:24:39.937 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:24:39.937 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-08-17T02:24:39.937 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:24:39.937 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:24:39.937 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:24:39.937 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:24:39.938 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:24:39.938 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:24:39.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:39.938 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-08-17T02:24:39.979 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:24:39.979 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:24:39.979 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:24:39.979 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:39.979 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-08-17T02:24:39.979 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:39.979 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:39.979 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:39.979 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-08-17T02:24:39.979 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:39.979 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:39.980 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-08-17T02:24:39.980 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:39.980 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:39.980 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:24:39.980 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:39.980 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:24:39.980 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42625sec preferred_lft 42625sec 2024-08-17T02:24:39.980 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-08-17T02:24:39.980 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:39.980 INFO:teuthology.orchestra.run.smithi087.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:24:39.980 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 9e:87:d1:dc:df:7e brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:39.981 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:24:39.981 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:39.981 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::88e7:cbff:fee8:c6b8/64 scope link 2024-08-17T02:24:39.981 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:39.981 INFO:teuthology.orchestra.run.smithi087.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:24:39.981 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 9e:87:d1:dc:df:7e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:24:39.981 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::9c87:d1ff:fedc:df7e/64 scope link 2024-08-17T02:24:39.981 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:39.981 INFO:teuthology.orchestra.run.smithi087.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:24:39.981 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether da:c2:99:e4:f8:f5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:24:39.981 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::d8c2:99ff:fee4:f8f5/64 scope link 2024-08-17T02:24:39.981 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:39.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:39.982 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:24:40.076 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-08-17T02:24:40.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:40.080 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-08-17T02:24:40.117 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-08-17T02:24:40.117 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:24:40.117 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:24:40.117 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:24:40.118 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:24:40.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:40.118 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-08-17T02:24:40.118 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-08-17T02:24:40.118 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:24:40.118 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:24:40.118 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:24:40.118 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-08-17T02:24:40.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:40.266 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-08-17T02:24:40.302 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:24:40.302 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:24:40.302 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:24:40.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:40.302 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-08-17T02:24:40.398 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:24:40.398 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:24:40.433 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:24:40.433 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:24:40.433 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:24:40.508 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:24:40.508 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:24:40.508 DEBUG:teuthology.orchestra.run.smithi087:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:40.629 INFO:teuthology.orchestra.run.smithi087.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:40.629 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:24:40.656 INFO:teuthology.orchestra.run.smithi087.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:40.656 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:24:40.656 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.87:3300,172.21.15.87:3301" 2024-08-17T02:24:40.656 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: trying mount with new device syntax: 1@9411fcb4-b308-4a27-a404-b7a846d24e75.cephfs=/ 2024-08-17T02:24:40.656 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.87:3300/172.21.15.87:3301" will pass to kernel 2024-08-17T02:24:40.658 INFO:teuthology.orchestra.run.smithi087.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:24:40.658 INFO:teuthology.orchestra.run.smithi087.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:24:40.658 INFO:teuthology.orchestra.run.smithi087.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:24:40.658 INFO:teuthology.orchestra.run.smithi087.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:24:40.658 INFO:teuthology.orchestra.run.smithi087.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:24:40.661 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:24:40.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:40.661 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:24:40.716 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:24:40.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.882+0000 7fdc63e00640 1 Processor -- start 2024-08-17T02:24:40.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.882+0000 7fdc63e00640 1 -- start start 2024-08-17T02:24:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.884+0000 7fdc63e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdc640cae20 0x7fdc640adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.884+0000 7fdc63e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc640ca060 con 0x7fdc640ad780 2024-08-17T02:24:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.884+0000 7fdc63e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc640ca340 con 0x7fdc640ae6e0 2024-08-17T02:24:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.884+0000 7fdc63e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc640ca620 con 0x7fdc640cae20 2024-08-17T02:24:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.884+0000 7fdc62a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdc640ad780 0x7fdc640af6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39608/0 (socket says 172.21.15.5:39608) 2024-08-17T02:24:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.884+0000 7fdc62a00640 1 -- 172.21.15.5:0/4209798772 learned_addr learned my addr 172.21.15.5:0/4209798772 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.884+0000 7fdc5be00640 1 --2- 172.21.15.5:0/4209798772 >> v2:172.21.15.87:3300/0 conn(0x7fdc640cae20 0x7fdc640adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.884+0000 7fdc62000640 1 -- 172.21.15.5:0/4209798772 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053725086 0 0) 0x7fdc640ca060 con 0x7fdc640ad780 2024-08-17T02:24:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.885+0000 7fdc62000640 1 -- 172.21.15.5:0/4209798772 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc480034e0 con 0x7fdc640ad780 2024-08-17T02:24:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.885+0000 7fdc5be00640 1 -- 172.21.15.5:0/4209798772 >> v1:172.21.15.87:6789/0 conn(0x7fdc640ae6e0 legacy=0x7fdc64157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.885+0000 7fdc62000640 1 -- 172.21.15.5:0/4209798772 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2377209550 0 0) 0x7fdc480034e0 con 0x7fdc640ad780 2024-08-17T02:24:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.885+0000 7fdc5be00640 1 -- 172.21.15.5:0/4209798772 >> v1:172.21.15.5:6789/0 conn(0x7fdc640ad780 legacy=0x7fdc640af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.885+0000 7fdc5be00640 1 -- 172.21.15.5:0/4209798772 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc640ca900 con 0x7fdc640cae20 2024-08-17T02:24:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.886+0000 7fdc5be00640 1 --2- 172.21.15.5:0/4209798772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc640cae20 0x7fdc640adb50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009850 tx=0x7fdc4c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e5b4a561d6eb51 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.886+0000 7fdc62000640 1 -- 172.21.15.5:0/4209798772 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc54001470 con 0x7fdc640cae20 2024-08-17T02:24:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.886+0000 7fdc62000640 1 -- 172.21.15.5:0/4209798772 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c02aa10 con 0x7fdc640cae20 2024-08-17T02:24:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.886+0000 7fdc62000640 1 -- 172.21.15.5:0/4209798772 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c02adb0 con 0x7fdc640cae20 2024-08-17T02:24:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.887+0000 7fdc63e00640 1 -- 172.21.15.5:0/4209798772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc640cae20 msgr2=0x7fdc640adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.887+0000 7fdc63e00640 1 --2- 172.21.15.5:0/4209798772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc640cae20 0x7fdc640adb50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009850 tx=0x7fdc4c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.887+0000 7fdc63e00640 1 -- 172.21.15.5:0/4209798772 shutdown_connections 2024-08-17T02:24:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.887+0000 7fdc63e00640 1 --2- 172.21.15.5:0/4209798772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc640cae20 0x7fdc640adb50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.887+0000 7fdc63e00640 1 -- 172.21.15.5:0/4209798772 >> 172.21.15.5:0/4209798772 conn(0x7fdc64066e60 msgr2=0x7fdc64067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:40.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.887+0000 7fdc63e00640 1 -- 172.21.15.5:0/4209798772 shutdown_connections 2024-08-17T02:24:40.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.887+0000 7fdc63e00640 1 -- 172.21.15.5:0/4209798772 wait complete. 2024-08-17T02:24:40.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.888+0000 7fdc63e00640 1 Processor -- start 2024-08-17T02:24:40.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.888+0000 7fdc63e00640 1 -- start start 2024-08-17T02:24:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.889+0000 7fdc63e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc640ad780 0x7fdc64140030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.889+0000 7fdc63e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc640ae6e0 0x7fdc640ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.889+0000 7fdc63e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc640cae20 0x7fdc6415a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.889+0000 7fdc63e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640ad3d0 con 0x7fdc640cae20 2024-08-17T02:24:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.889+0000 7fdc63e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640abdf0 con 0x7fdc640ad780 2024-08-17T02:24:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.889+0000 7fdc63e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640ac0d0 con 0x7fdc640ae6e0 2024-08-17T02:24:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.890+0000 7fdc62a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc640ad780 0x7fdc64140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.890+0000 7fdc63400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc640cae20 0x7fdc6415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.890+0000 7fdc62a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc640ad780 0x7fdc64140030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:33614/0 (socket says 172.21.15.5:33614) 2024-08-17T02:24:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.890+0000 7fdc62a00640 1 -- 172.21.15.5:0/193728325 learned_addr learned my addr 172.21.15.5:0/193728325 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.890+0000 7fdc5be00640 1 --2- 172.21.15.5:0/193728325 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc640ae6e0 0x7fdc640ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.890+0000 7fdc62a00640 1 -- 172.21.15.5:0/193728325 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc640ae6e0 msgr2=0x7fdc640ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.890+0000 7fdc62a00640 1 --2- 172.21.15.5:0/193728325 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc640ae6e0 0x7fdc640ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.890+0000 7fdc62a00640 1 -- 172.21.15.5:0/193728325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc640cae20 msgr2=0x7fdc6415a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.890+0000 7fdc62a00640 1 --2- 172.21.15.5:0/193728325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc640cae20 0x7fdc6415a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.890+0000 7fdc62a00640 1 -- 172.21.15.5:0/193728325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c009390 con 0x7fdc640ad780 2024-08-17T02:24:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.890+0000 7fdc62a00640 1 --2- 172.21.15.5:0/193728325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc640ad780 0x7fdc64140030 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400cb60 tx=0x7fdc54001b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.891+0000 7fdc5a000640 1 -- 172.21.15.5:0/193728325 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc54007360 con 0x7fdc640ad780 2024-08-17T02:24:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.891+0000 7fdc5a000640 1 -- 172.21.15.5:0/193728325 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc540074c0 con 0x7fdc640ad780 2024-08-17T02:24:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.891+0000 7fdc63e00640 1 -- 172.21.15.5:0/193728325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc640ac3b0 con 0x7fdc640ad780 2024-08-17T02:24:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.891+0000 7fdc5a000640 1 -- 172.21.15.5:0/193728325 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc540049d0 con 0x7fdc640ad780 2024-08-17T02:24:40.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.891+0000 7fdc63e00640 1 -- 172.21.15.5:0/193728325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc640ac970 con 0x7fdc640ad780 2024-08-17T02:24:40.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.892+0000 7fdc63e00640 1 -- 172.21.15.5:0/193728325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc640acb90 con 0x7fdc640ad780 2024-08-17T02:24:40.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.893+0000 7fdc5a000640 1 -- 172.21.15.5:0/193728325 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdc5400a640 con 0x7fdc640ad780 2024-08-17T02:24:40.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.894+0000 7fdc5a000640 1 --2- 172.21.15.5:0/193728325 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdc40065180 0x7fdc40067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.894+0000 7fdc5a000640 1 -- 172.21.15.5:0/193728325 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdc54081d00 con 0x7fdc640ad780 2024-08-17T02:24:40.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.894+0000 7fdc5be00640 1 --2- 172.21.15.5:0/193728325 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdc40065180 0x7fdc40067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.895+0000 7fdc5be00640 1 --2- 172.21.15.5:0/193728325 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdc40065180 0x7fdc40067630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c034000 tx=0x7fdc4c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:40.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:40.898+0000 7fdc5a000640 1 -- 172.21.15.5:0/193728325 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdc5404fe50 con 0x7fdc640ad780 2024-08-17T02:24:41.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.121+0000 7fdc63e00640 1 -- 172.21.15.5:0/193728325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdc64063f10 con 0x7fdc640ad780 2024-08-17T02:24:41.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.277+0000 7fdc5a000640 1 -- 172.21.15.5:0/193728325 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7fdc54018020 con 0x7fdc640ad780 2024-08-17T02:24:41.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.279+0000 7fdc63e00640 1 -- 172.21.15.5:0/193728325 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdc40065180 msgr2=0x7fdc40067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.279+0000 7fdc63e00640 1 --2- 172.21.15.5:0/193728325 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdc40065180 0x7fdc40067630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c034000 tx=0x7fdc4c032000 comp rx=0 tx=0).stop 2024-08-17T02:24:41.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.279+0000 7fdc63e00640 1 -- 172.21.15.5:0/193728325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc640ad780 msgr2=0x7fdc64140030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.279+0000 7fdc63e00640 1 --2- 172.21.15.5:0/193728325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc640ad780 0x7fdc64140030 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400cb60 tx=0x7fdc54001b90 comp rx=0 tx=0).stop 2024-08-17T02:24:41.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.279+0000 7fdc63e00640 1 -- 172.21.15.5:0/193728325 shutdown_connections 2024-08-17T02:24:41.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.279+0000 7fdc63e00640 1 --2- 172.21.15.5:0/193728325 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdc40065180 0x7fdc40067630 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.279+0000 7fdc63e00640 1 --2- 172.21.15.5:0/193728325 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc640ae6e0 0x7fdc640ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.279+0000 7fdc63e00640 1 --2- 172.21.15.5:0/193728325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc640cae20 0x7fdc6415a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.279+0000 7fdc63e00640 1 --2- 172.21.15.5:0/193728325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc640ad780 0x7fdc64140030 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.279+0000 7fdc63e00640 1 -- 172.21.15.5:0/193728325 >> 172.21.15.5:0/193728325 conn(0x7fdc64066e60 msgr2=0x7fdc6406e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:41.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.279+0000 7fdc63e00640 1 -- 172.21.15.5:0/193728325 shutdown_connections 2024-08-17T02:24:41.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.279+0000 7fdc63e00640 1 -- 172.21.15.5:0/193728325 wait complete. 2024-08-17T02:24:41.295 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:24:41.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.446+0000 7ff716c00640 1 Processor -- start 2024-08-17T02:24:41.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.446+0000 7ff716c00640 1 -- start start 2024-08-17T02:24:41.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.447+0000 7ff716c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7100ca050 0x7ff710156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.447+0000 7ff716c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7100add30 0x7ff71015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.448+0000 7ff716c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71015b5e0 con 0x7ff7100ad960 2024-08-17T02:24:41.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.448+0000 7ff716c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7100cb160 con 0x7ff7100ca050 2024-08-17T02:24:41.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.448+0000 7ff716c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7100b0d10 con 0x7ff7100add30 2024-08-17T02:24:41.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.448+0000 7ff707e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7100ca050 0x7ff710156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.448+0000 7ff707e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7100ca050 0x7ff710156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59908/0 (socket says 172.21.15.5:59908) 2024-08-17T02:24:41.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.448+0000 7ff707e00640 1 -- 172.21.15.5:0/2790162009 learned_addr learned my addr 172.21.15.5:0/2790162009 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:41.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.448+0000 7ff714c00640 1 --2- 172.21.15.5:0/2790162009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7100add30 0x7ff71015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.448+0000 7ff707e00640 1 -- 172.21.15.5:0/2790162009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7100add30 msgr2=0x7ff71015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:41.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.448+0000 7ff707e00640 1 --2- 172.21.15.5:0/2790162009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7100add30 0x7ff71015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.448+0000 7ff707e00640 1 -- 172.21.15.5:0/2790162009 >> v1:172.21.15.87:6789/0 conn(0x7ff7100ad960 legacy=0x7ff710156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.448+0000 7ff707e00640 1 -- 172.21.15.5:0/2790162009 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7100ca550 con 0x7ff7100ca050 2024-08-17T02:24:41.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.449+0000 7ff707e00640 1 --2- 172.21.15.5:0/2790162009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7100ca050 0x7ff710156b30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009910 tx=0x7ff6f80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5a7a71fcd06ed3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:41.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.450+0000 7ff70f400640 1 -- 172.21.15.5:0/2790162009 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8032440 con 0x7ff7100ca050 2024-08-17T02:24:41.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.450+0000 7ff70f400640 1 -- 172.21.15.5:0/2790162009 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f80325a0 con 0x7ff7100ca050 2024-08-17T02:24:41.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.450+0000 7ff70f400640 1 -- 172.21.15.5:0/2790162009 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8032980 con 0x7ff7100ca050 2024-08-17T02:24:41.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.450+0000 7ff716c00640 1 -- 172.21.15.5:0/2790162009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7100ca050 msgr2=0x7ff710156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.450+0000 7ff716c00640 1 --2- 172.21.15.5:0/2790162009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7100ca050 0x7ff710156b30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009910 tx=0x7ff6f80091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.450+0000 7ff716c00640 1 -- 172.21.15.5:0/2790162009 shutdown_connections 2024-08-17T02:24:41.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.450+0000 7ff716c00640 1 --2- 172.21.15.5:0/2790162009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7100add30 0x7ff71015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.450+0000 7ff716c00640 1 --2- 172.21.15.5:0/2790162009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7100ca050 0x7ff710156b30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.450+0000 7ff716c00640 1 -- 172.21.15.5:0/2790162009 >> 172.21.15.5:0/2790162009 conn(0x7ff710066e60 msgr2=0x7ff710067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:41.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.450+0000 7ff716c00640 1 -- 172.21.15.5:0/2790162009 shutdown_connections 2024-08-17T02:24:41.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.450+0000 7ff716c00640 1 -- 172.21.15.5:0/2790162009 wait complete. 2024-08-17T02:24:41.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.452+0000 7ff716c00640 1 Processor -- start 2024-08-17T02:24:41.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.452+0000 7ff716c00640 1 -- start start 2024-08-17T02:24:41.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.453+0000 7ff716c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7100ad960 0x7ff7101482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.453+0000 7ff716c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7100add30 0x7ff7100aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.453+0000 7ff716c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7100ca050 0x7ff7100af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.453+0000 7ff716c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff710157100 con 0x7ff7100add30 2024-08-17T02:24:41.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.453+0000 7ff716c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff710157c80 con 0x7ff7100ca050 2024-08-17T02:24:41.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.453+0000 7ff716c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff710157350 con 0x7ff7100ad960 2024-08-17T02:24:41.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.453+0000 7ff707e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7100add30 0x7ff7100aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.453+0000 7ff707e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7100add30 0x7ff7100aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59922/0 (socket says 172.21.15.5:59922) 2024-08-17T02:24:41.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.453+0000 7ff707e00640 1 -- 172.21.15.5:0/1497013094 learned_addr learned my addr 172.21.15.5:0/1497013094 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:41.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.453+0000 7ff70fe00640 1 --2- 172.21.15.5:0/1497013094 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7100ad960 0x7ff7101482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.453+0000 7ff714c00640 1 --2- 172.21.15.5:0/1497013094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7100ca050 0x7ff7100af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.453+0000 7ff707e00640 1 -- 172.21.15.5:0/1497013094 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7100ad960 msgr2=0x7ff7101482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.453+0000 7ff707e00640 1 --2- 172.21.15.5:0/1497013094 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7100ad960 0x7ff7101482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.453+0000 7ff707e00640 1 -- 172.21.15.5:0/1497013094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7100ca050 msgr2=0x7ff7100af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.453+0000 7ff707e00640 1 --2- 172.21.15.5:0/1497013094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7100ca050 0x7ff7100af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.453+0000 7ff707e00640 1 -- 172.21.15.5:0/1497013094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f8009450 con 0x7ff7100add30 2024-08-17T02:24:41.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.454+0000 7ff707e00640 1 --2- 172.21.15.5:0/1497013094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7100add30 0x7ff7100aec60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009210 tx=0x7ff6f8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:41.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.454+0000 7ff707400640 1 -- 172.21.15.5:0/1497013094 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8031ae0 con 0x7ff7100add30 2024-08-17T02:24:41.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.454+0000 7ff707400640 1 -- 172.21.15.5:0/1497013094 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f8031c80 con 0x7ff7100add30 2024-08-17T02:24:41.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.454+0000 7ff707400640 1 -- 172.21.15.5:0/1497013094 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f803d670 con 0x7ff7100add30 2024-08-17T02:24:41.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.454+0000 7ff716c00640 1 -- 172.21.15.5:0/1497013094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff710157630 con 0x7ff7100add30 2024-08-17T02:24:41.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.454+0000 7ff716c00640 1 -- 172.21.15.5:0/1497013094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff710158110 con 0x7ff7100add30 2024-08-17T02:24:41.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.455+0000 7ff716c00640 1 -- 172.21.15.5:0/1497013094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff710157e10 con 0x7ff7100add30 2024-08-17T02:24:41.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.456+0000 7ff707400640 1 -- 172.21.15.5:0/1497013094 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff6f8039040 con 0x7ff7100add30 2024-08-17T02:24:41.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.457+0000 7ff707400640 1 --2- 172.21.15.5:0/1497013094 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff6ec065150 0x7ff6ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.457+0000 7ff707400640 1 -- 172.21.15.5:0/1497013094 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff6f80a20d0 con 0x7ff7100add30 2024-08-17T02:24:41.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.457+0000 7ff70fe00640 1 --2- 172.21.15.5:0/1497013094 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff6ec065150 0x7ff6ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.457+0000 7ff70fe00640 1 --2- 172.21.15.5:0/1497013094 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff6ec065150 0x7ff6ec067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff700007fd0 tx=0x7ff700007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:41.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.461+0000 7ff707400640 1 -- 172.21.15.5:0/1497013094 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff6f80701a0 con 0x7ff7100add30 2024-08-17T02:24:41.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.671+0000 7ff716c00640 1 -- 172.21.15.5:0/1497013094 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff710063fb0 con 0x7ff6ec065150 2024-08-17T02:24:41.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.672+0000 7ff707400640 1 -- 172.21.15.5:0/1497013094 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff710063fb0 con 0x7ff6ec065150 2024-08-17T02:24:41.672 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-17T02:24:41.673 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:41.673 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2024-08-17T02:24:41.673 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:41.673 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-17T02:24:41.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.674+0000 7ff716c00640 1 -- 172.21.15.5:0/1497013094 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff6ec065150 msgr2=0x7ff6ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.674+0000 7ff716c00640 1 --2- 172.21.15.5:0/1497013094 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff6ec065150 0x7ff6ec067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff700007fd0 tx=0x7ff700007e30 comp rx=0 tx=0).stop 2024-08-17T02:24:41.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.674+0000 7ff716c00640 1 -- 172.21.15.5:0/1497013094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7100add30 msgr2=0x7ff7100aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.674+0000 7ff716c00640 1 --2- 172.21.15.5:0/1497013094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7100add30 0x7ff7100aec60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009210 tx=0x7ff6f8032000 comp rx=0 tx=0).stop 2024-08-17T02:24:41.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.674+0000 7ff716c00640 1 -- 172.21.15.5:0/1497013094 shutdown_connections 2024-08-17T02:24:41.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.674+0000 7ff716c00640 1 --2- 172.21.15.5:0/1497013094 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff6ec065150 0x7ff6ec067600 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.674+0000 7ff716c00640 1 --2- 172.21.15.5:0/1497013094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7100ca050 0x7ff7100af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.674+0000 7ff716c00640 1 --2- 172.21.15.5:0/1497013094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7100add30 0x7ff7100aec60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.674+0000 7ff716c00640 1 --2- 172.21.15.5:0/1497013094 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7100ad960 0x7ff7101482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.674+0000 7ff716c00640 1 -- 172.21.15.5:0/1497013094 >> 172.21.15.5:0/1497013094 conn(0x7ff710066e60 msgr2=0x7ff710153130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:41.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.675+0000 7ff716c00640 1 -- 172.21.15.5:0/1497013094 shutdown_connections 2024-08-17T02:24:41.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.675+0000 7ff716c00640 1 -- 172.21.15.5:0/1497013094 wait complete. 2024-08-17T02:24:41.690 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:24:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.845+0000 7fd5b2c00640 1 Processor -- start 2024-08-17T02:24:41.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.845+0000 7fd5b2c00640 1 -- start start 2024-08-17T02:24:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.846+0000 7fd5b2c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5ac0ad960 0x7fd5ac15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.846+0000 7fd5b2c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd5ac0add30 0x7fd5ac156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.846+0000 7fd5b2c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5ac15b5e0 con 0x7fd5ac0ca050 2024-08-17T02:24:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.846+0000 7fd5b2c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ac0cb160 con 0x7fd5ac0add30 2024-08-17T02:24:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.846+0000 7fd5b2c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac0b0d10 con 0x7fd5ac0ad960 2024-08-17T02:24:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.847+0000 7fd5b0c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd5ac0add30 0x7fd5ac156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.847+0000 7fd5abe00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5ac0ad960 0x7fd5ac15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.847+0000 7fd5b0c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd5ac0add30 0x7fd5ac156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:33632/0 (socket says 172.21.15.5:33632) 2024-08-17T02:24:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.847+0000 7fd5b0c00640 1 -- 172.21.15.5:0/2282152787 learned_addr learned my addr 172.21.15.5:0/2282152787 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.847+0000 7fd5ab400640 1 --1- 172.21.15.5:0/2282152787 >> v1:172.21.15.87:6789/0 conn(0x7fd5ac0ca050 0x7fd5ac156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:34848/0 (socket says 172.21.15.5:34848) 2024-08-17T02:24:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.847+0000 7fd5b0c00640 1 -- 172.21.15.5:0/2282152787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5ac0ad960 msgr2=0x7fd5ac15b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.847+0000 7fd5b0c00640 1 --2- 172.21.15.5:0/2282152787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5ac0ad960 0x7fd5ac15b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.847+0000 7fd5b0c00640 1 -- 172.21.15.5:0/2282152787 >> v1:172.21.15.87:6789/0 conn(0x7fd5ac0ca050 legacy=0x7fd5ac156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.847+0000 7fd5b0c00640 1 -- 172.21.15.5:0/2282152787 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac0ca550 con 0x7fd5ac0add30 2024-08-17T02:24:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.847+0000 7fd5abe00640 1 --2- 172.21.15.5:0/2282152787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5ac0ad960 0x7fd5ac15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.848+0000 7fd5b0c00640 1 --2- 172.21.15.5:0/2282152787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5ac0add30 0x7fd5ac156b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009f20 tx=0x7fd5a4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=995264917b4b795 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.848+0000 7fd5aaa00640 1 -- 172.21.15.5:0/2282152787 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4032450 con 0x7fd5ac0add30 2024-08-17T02:24:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.849+0000 7fd5aaa00640 1 -- 172.21.15.5:0/2282152787 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a40325b0 con 0x7fd5ac0add30 2024-08-17T02:24:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.849+0000 7fd5aaa00640 1 -- 172.21.15.5:0/2282152787 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4032990 con 0x7fd5ac0add30 2024-08-17T02:24:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.849+0000 7fd5b2c00640 1 -- 172.21.15.5:0/2282152787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5ac0add30 msgr2=0x7fd5ac156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.849+0000 7fd5b2c00640 1 --2- 172.21.15.5:0/2282152787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5ac0add30 0x7fd5ac156b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009f20 tx=0x7fd5a4009840 comp rx=0 tx=0).stop 2024-08-17T02:24:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.849+0000 7fd5b2c00640 1 -- 172.21.15.5:0/2282152787 shutdown_connections 2024-08-17T02:24:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.849+0000 7fd5b2c00640 1 --2- 172.21.15.5:0/2282152787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5ac0add30 0x7fd5ac156b30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.849+0000 7fd5b2c00640 1 --2- 172.21.15.5:0/2282152787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5ac0ad960 0x7fd5ac15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.849+0000 7fd5b2c00640 1 -- 172.21.15.5:0/2282152787 >> 172.21.15.5:0/2282152787 conn(0x7fd5ac066e60 msgr2=0x7fd5ac067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.849+0000 7fd5b2c00640 1 -- 172.21.15.5:0/2282152787 shutdown_connections 2024-08-17T02:24:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.849+0000 7fd5b2c00640 1 -- 172.21.15.5:0/2282152787 wait complete. 2024-08-17T02:24:41.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.851+0000 7fd5b2c00640 1 Processor -- start 2024-08-17T02:24:41.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.851+0000 7fd5b2c00640 1 -- start start 2024-08-17T02:24:41.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.851+0000 7fd5b2c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5ac0ad960 0x7fd5ac1534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.851+0000 7fd5b2c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5ac0add30 0x7fd5ac14b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.851+0000 7fd5b2c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5ac0ca050 0x7fd5ac1510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.852+0000 7fd5b2c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac157100 con 0x7fd5ac0add30 2024-08-17T02:24:41.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.852+0000 7fd5b2c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac159860 con 0x7fd5ac0ad960 2024-08-17T02:24:41.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.852+0000 7fd5b2c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac159b40 con 0x7fd5ac0ca050 2024-08-17T02:24:41.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.852+0000 7fd5ab400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5ac0add30 0x7fd5ac14b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.852+0000 7fd5ab400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5ac0add30 0x7fd5ac14b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59926/0 (socket says 172.21.15.5:59926) 2024-08-17T02:24:41.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.852+0000 7fd5ab400640 1 -- 172.21.15.5:0/3024123836 learned_addr learned my addr 172.21.15.5:0/3024123836 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.852+0000 7fd5abe00640 1 --2- 172.21.15.5:0/3024123836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5ac0ad960 0x7fd5ac1534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.852+0000 7fd5b0c00640 1 --2- 172.21.15.5:0/3024123836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5ac0ca050 0x7fd5ac1510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.852+0000 7fd5ab400640 1 -- 172.21.15.5:0/3024123836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5ac0ca050 msgr2=0x7fd5ac1510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.852+0000 7fd5ab400640 1 --2- 172.21.15.5:0/3024123836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5ac0ca050 0x7fd5ac1510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.852+0000 7fd5ab400640 1 -- 172.21.15.5:0/3024123836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5ac0ad960 msgr2=0x7fd5ac1534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.852+0000 7fd5ab400640 1 --2- 172.21.15.5:0/3024123836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5ac0ad960 0x7fd5ac1534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.852+0000 7fd5ab400640 1 -- 172.21.15.5:0/3024123836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c00d830 con 0x7fd5ac0add30 2024-08-17T02:24:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.853+0000 7fd5ab400640 1 --2- 172.21.15.5:0/3024123836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5ac0add30 0x7fd5ac14b8c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd59800c590 tx=0x7fd598007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.853+0000 7fd5a3400640 1 -- 172.21.15.5:0/3024123836 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd598007300 con 0x7fd5ac0add30 2024-08-17T02:24:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.853+0000 7fd5a3400640 1 -- 172.21.15.5:0/3024123836 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5980074a0 con 0x7fd5ac0add30 2024-08-17T02:24:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.853+0000 7fd5b2c00640 1 -- 172.21.15.5:0/3024123836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a4009ae0 con 0x7fd5ac0add30 2024-08-17T02:24:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.853+0000 7fd5a3400640 1 -- 172.21.15.5:0/3024123836 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5980047a0 con 0x7fd5ac0add30 2024-08-17T02:24:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.853+0000 7fd5b2c00640 1 -- 172.21.15.5:0/3024123836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ac157350 con 0x7fd5ac0add30 2024-08-17T02:24:41.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.854+0000 7fd5b2c00640 1 -- 172.21.15.5:0/3024123836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ac157540 con 0x7fd5ac0add30 2024-08-17T02:24:41.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.855+0000 7fd5a3400640 1 -- 172.21.15.5:0/3024123836 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd598004bf0 con 0x7fd5ac0add30 2024-08-17T02:24:41.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.856+0000 7fd5a3400640 1 --2- 172.21.15.5:0/3024123836 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fd58c065180 0x7fd58c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.856+0000 7fd5a3400640 1 -- 172.21.15.5:0/3024123836 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd598081550 con 0x7fd5ac0add30 2024-08-17T02:24:41.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.856+0000 7fd5abe00640 1 --2- 172.21.15.5:0/3024123836 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fd58c065180 0x7fd58c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.857+0000 7fd5abe00640 1 --2- 172.21.15.5:0/3024123836 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fd58c065180 0x7fd58c067630 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00dfd0 tx=0x7fd59c00f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:41.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:41.860+0000 7fd5a3400640 1 -- 172.21.15.5:0/3024123836 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd59804ce40 con 0x7fd5ac0add30 2024-08-17T02:24:42.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.045+0000 7fd5b2c00640 1 -- 172.21.15.5:0/3024123836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd5ac15b5e0 con 0x7fd5ac0add30 2024-08-17T02:24:42.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.045+0000 7fd5a3400640 1 -- 172.21.15.5:0/3024123836 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd5ac15b5e0 con 0x7fd5ac0add30 2024-08-17T02:24:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.047+0000 7fd5b2c00640 1 -- 172.21.15.5:0/3024123836 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fd58c065180 msgr2=0x7fd58c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.047+0000 7fd5b2c00640 1 --2- 172.21.15.5:0/3024123836 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fd58c065180 0x7fd58c067630 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00dfd0 tx=0x7fd59c00f040 comp rx=0 tx=0).stop 2024-08-17T02:24:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.047+0000 7fd5b2c00640 1 -- 172.21.15.5:0/3024123836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5ac0add30 msgr2=0x7fd5ac14b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.047+0000 7fd5b2c00640 1 --2- 172.21.15.5:0/3024123836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5ac0add30 0x7fd5ac14b8c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd59800c590 tx=0x7fd598007eb0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.048+0000 7fd5b2c00640 1 -- 172.21.15.5:0/3024123836 shutdown_connections 2024-08-17T02:24:42.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.048+0000 7fd5b2c00640 1 --2- 172.21.15.5:0/3024123836 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fd58c065180 0x7fd58c067630 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.048+0000 7fd5b2c00640 1 --2- 172.21.15.5:0/3024123836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5ac0ca050 0x7fd5ac1510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.048+0000 7fd5b2c00640 1 --2- 172.21.15.5:0/3024123836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5ac0add30 0x7fd5ac14b8c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.048+0000 7fd5b2c00640 1 --2- 172.21.15.5:0/3024123836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5ac0ad960 0x7fd5ac1534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.048+0000 7fd5b2c00640 1 -- 172.21.15.5:0/3024123836 >> 172.21.15.5:0/3024123836 conn(0x7fd5ac066e60 msgr2=0x7fd5ac154710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:42.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.048+0000 7fd5b2c00640 1 -- 172.21.15.5:0/3024123836 shutdown_connections 2024-08-17T02:24:42.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.048+0000 7fd5b2c00640 1 -- 172.21.15.5:0/3024123836 wait complete. 2024-08-17T02:24:42.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000001044363 2024-08-17T02:24:42.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.217+0000 7f8a07000640 1 Processor -- start 2024-08-17T02:24:42.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.217+0000 7f8a07000640 1 -- start start 2024-08-17T02:24:42.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.219+0000 7f8a07000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8a00156900 0x7f8a000b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.219+0000 7f8a07000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a000ae7d0 0x7f8a000ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.219+0000 7f8a07000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a000b0b10 con 0x7f8a00156cd0 2024-08-17T02:24:42.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.219+0000 7f8a07000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a000b0df0 con 0x7f8a00156900 2024-08-17T02:24:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.219+0000 7f8a07000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a000b10d0 con 0x7f8a000ae7d0 2024-08-17T02:24:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.219+0000 7f8a05c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8a00156900 0x7f8a000b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.219+0000 7f8a05200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a000ae7d0 0x7f8a000ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.219+0000 7f8a06600640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8a00156cd0 0x7f8a0015a790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39610/0 (socket says 172.21.15.5:39610) 2024-08-17T02:24:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.219+0000 7f8a06600640 1 -- 172.21.15.5:0/3301407076 learned_addr learned my addr 172.21.15.5:0/3301407076 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.219+0000 7f8a05200640 1 -- 172.21.15.5:0/3301407076 >> v2:172.21.15.5:3300/0 conn(0x7f8a00156900 msgr2=0x7f8a000b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.219+0000 7f8a05200640 1 --2- 172.21.15.5:0/3301407076 >> v2:172.21.15.5:3300/0 conn(0x7f8a00156900 0x7f8a000b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.220+0000 7f8a05200640 1 -- 172.21.15.5:0/3301407076 >> v1:172.21.15.5:6789/0 conn(0x7f8a00156cd0 legacy=0x7f8a0015a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.220+0000 7f8a05200640 1 -- 172.21.15.5:0/3301407076 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a000b13b0 con 0x7f8a000ae7d0 2024-08-17T02:24:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.220+0000 7f8a05c00640 1 --2- 172.21.15.5:0/3301407076 >> v2:172.21.15.5:3300/0 conn(0x7f8a00156900 0x7f8a000b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.221+0000 7f8a05200640 1 --2- 172.21.15.5:0/3301407076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a000ae7d0 0x7f8a000ada70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8a000b17f0 tx=0x7f89ec0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43eedc1bddaefeba server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.221+0000 7f89ffe00640 1 -- 172.21.15.5:0/3301407076 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec02adb0 con 0x7f8a000ae7d0 2024-08-17T02:24:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.221+0000 7f89ffe00640 1 -- 172.21.15.5:0/3301407076 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec032440 con 0x7f8a000ae7d0 2024-08-17T02:24:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.221+0000 7f89ffe00640 1 -- 172.21.15.5:0/3301407076 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec032820 con 0x7f8a000ae7d0 2024-08-17T02:24:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.221+0000 7f8a07000640 1 -- 172.21.15.5:0/3301407076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a000ae7d0 msgr2=0x7f8a000ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.221+0000 7f8a07000640 1 --2- 172.21.15.5:0/3301407076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a000ae7d0 0x7f8a000ada70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8a000b17f0 tx=0x7f89ec0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.222+0000 7f8a07000640 1 -- 172.21.15.5:0/3301407076 shutdown_connections 2024-08-17T02:24:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.222+0000 7f8a07000640 1 --2- 172.21.15.5:0/3301407076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a000ae7d0 0x7f8a000ada70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.222+0000 7f8a07000640 1 --2- 172.21.15.5:0/3301407076 >> v2:172.21.15.5:3300/0 conn(0x7f8a00156900 0x7f8a000b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.222+0000 7f8a07000640 1 -- 172.21.15.5:0/3301407076 >> 172.21.15.5:0/3301407076 conn(0x7f8a00067930 msgr2=0x7f8a000cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.222+0000 7f8a07000640 1 -- 172.21.15.5:0/3301407076 shutdown_connections 2024-08-17T02:24:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.222+0000 7f8a07000640 1 -- 172.21.15.5:0/3301407076 wait complete. 2024-08-17T02:24:42.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.223+0000 7f8a07000640 1 Processor -- start 2024-08-17T02:24:42.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.223+0000 7f8a07000640 1 -- start start 2024-08-17T02:24:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.224+0000 7f8a07000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a000ae7d0 0x7f8a000c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.224+0000 7f8a07000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a00156900 0x7f8a000c0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.224+0000 7f8a07000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00156cd0 0x7f8a00154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.224+0000 7f8a07000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a00154270 con 0x7f8a00156cd0 2024-08-17T02:24:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.224+0000 7f8a07000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a00153b00 con 0x7f8a00156900 2024-08-17T02:24:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.224+0000 7f8a07000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a00153de0 con 0x7f8a000ae7d0 2024-08-17T02:24:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.224+0000 7f8a06600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00156cd0 0x7f8a00154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.224+0000 7f8a06600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00156cd0 0x7f8a00154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59934/0 (socket says 172.21.15.5:59934) 2024-08-17T02:24:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.224+0000 7f8a06600640 1 -- 172.21.15.5:0/2343176501 learned_addr learned my addr 172.21.15.5:0/2343176501 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.224+0000 7f8a05200640 1 --2- 172.21.15.5:0/2343176501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a00156900 0x7f8a000c0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.224+0000 7f8a05c00640 1 --2- 172.21.15.5:0/2343176501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a000ae7d0 0x7f8a000c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.225+0000 7f8a06600640 1 -- 172.21.15.5:0/2343176501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a000ae7d0 msgr2=0x7f8a000c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.225+0000 7f8a06600640 1 --2- 172.21.15.5:0/2343176501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a000ae7d0 0x7f8a000c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.225+0000 7f8a06600640 1 -- 172.21.15.5:0/2343176501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a00156900 msgr2=0x7f8a000c0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.225+0000 7f8a06600640 1 --2- 172.21.15.5:0/2343176501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a00156900 0x7f8a000c0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.225+0000 7f8a06600640 1 -- 172.21.15.5:0/2343176501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f4009390 con 0x7f8a00156cd0 2024-08-17T02:24:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.225+0000 7f8a05c00640 1 --2- 172.21.15.5:0/2343176501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a000ae7d0 0x7f8a000c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.225+0000 7f8a06600640 1 --2- 172.21.15.5:0/2343176501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00156cd0 0x7f8a00154470 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f89f800cbf0 tx=0x7f89f80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.225+0000 7f89fcc00640 1 -- 172.21.15.5:0/2343176501 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f800ce10 con 0x7f8a00156cd0 2024-08-17T02:24:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.225+0000 7f89fcc00640 1 -- 172.21.15.5:0/2343176501 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f800a850 con 0x7f8a00156cd0 2024-08-17T02:24:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.225+0000 7f8a07000640 1 -- 172.21.15.5:0/2343176501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ec009390 con 0x7f8a00156cd0 2024-08-17T02:24:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.225+0000 7f89fcc00640 1 -- 172.21.15.5:0/2343176501 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f800ac10 con 0x7f8a00156cd0 2024-08-17T02:24:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.225+0000 7f8a07000640 1 -- 172.21.15.5:0/2343176501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a000c1470 con 0x7f8a00156cd0 2024-08-17T02:24:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.226+0000 7f8a07000640 1 -- 172.21.15.5:0/2343176501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a00070720 con 0x7f8a00156cd0 2024-08-17T02:24:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.227+0000 7f89fcc00640 1 -- 172.21.15.5:0/2343176501 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f89f80070f0 con 0x7f8a00156cd0 2024-08-17T02:24:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.228+0000 7f89fcc00640 1 --2- 172.21.15.5:0/2343176501 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f89e0065150 0x7f89e0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.228+0000 7f89fcc00640 1 -- 172.21.15.5:0/2343176501 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f89f8082590 con 0x7f8a00156cd0 2024-08-17T02:24:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.228+0000 7f8a05c00640 1 --2- 172.21.15.5:0/2343176501 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f89e0065150 0x7f89e0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.229+0000 7f8a05c00640 1 --2- 172.21.15.5:0/2343176501 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f89e0065150 0x7f89e0067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009360 tx=0x7f89f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:42.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.232+0000 7f89fcc00640 1 -- 172.21.15.5:0/2343176501 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f89f8054070 con 0x7f8a00156cd0 2024-08-17T02:24:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:42.446+0000 7f8a07000640 1 -- 172.21.15.5:0/2343176501 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000001044363", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a000ad3c0 con 0x7f89e0065150 2024-08-17T02:24:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.291+0000 7f89fcc00640 1 -- 172.21.15.5:0/2343176501 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f8a000ad3c0 con 0x7f89e0065150 2024-08-17T02:24:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:24:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.294+0000 7f8a07000640 1 -- 172.21.15.5:0/2343176501 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f89e0065150 msgr2=0x7f89e0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.294+0000 7f8a07000640 1 --2- 172.21.15.5:0/2343176501 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f89e0065150 0x7f89e0067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009360 tx=0x7f89f4008040 comp rx=0 tx=0).stop 2024-08-17T02:24:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.294+0000 7f8a07000640 1 -- 172.21.15.5:0/2343176501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00156cd0 msgr2=0x7f8a00154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.294+0000 7f8a07000640 1 --2- 172.21.15.5:0/2343176501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00156cd0 0x7f8a00154470 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f89f800cbf0 tx=0x7f89f80019b0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.295+0000 7f8a07000640 1 -- 172.21.15.5:0/2343176501 shutdown_connections 2024-08-17T02:24:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.295+0000 7f8a07000640 1 --2- 172.21.15.5:0/2343176501 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f89e0065150 0x7f89e0067600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.295+0000 7f8a07000640 1 --2- 172.21.15.5:0/2343176501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00156cd0 0x7f8a00154470 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.295+0000 7f8a07000640 1 --2- 172.21.15.5:0/2343176501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a00156900 0x7f8a000c0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.295+0000 7f8a07000640 1 --2- 172.21.15.5:0/2343176501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a000ae7d0 0x7f8a000c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.295+0000 7f8a07000640 1 -- 172.21.15.5:0/2343176501 >> 172.21.15.5:0/2343176501 conn(0x7f8a00067930 msgr2=0x7f8a000c9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.295+0000 7f8a07000640 1 -- 172.21.15.5:0/2343176501 shutdown_connections 2024-08-17T02:24:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.295+0000 7f8a07000640 1 -- 172.21.15.5:0/2343176501 wait complete. 2024-08-17T02:24:45.321 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:24:45.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.484+0000 7fba2e000640 1 Processor -- start 2024-08-17T02:24:45.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.484+0000 7fba2e000640 1 -- start start 2024-08-17T02:24:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.486+0000 7fba2e000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba28159eb0 0x7fba28156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.486+0000 7fba2e000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fba280adcd0 0x7fba280c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.486+0000 7fba2e000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba28157430 con 0x7fba280c81a0 2024-08-17T02:24:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.486+0000 7fba2e000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba280b0c50 con 0x7fba280adcd0 2024-08-17T02:24:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.486+0000 7fba2e000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba280cb1e0 con 0x7fba28159eb0 2024-08-17T02:24:45.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.486+0000 7fba2cc00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba28159eb0 0x7fba28156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.486+0000 7fba2d600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fba280adcd0 0x7fba280c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.486+0000 7fba2d600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fba280adcd0 0x7fba280c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:33668/0 (socket says 172.21.15.5:33668) 2024-08-17T02:24:45.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.486+0000 7fba2d600640 1 -- 172.21.15.5:0/353528938 learned_addr learned my addr 172.21.15.5:0/353528938 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:45.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.486+0000 7fba27e00640 1 --1- 172.21.15.5:0/353528938 >> v1:172.21.15.87:6789/0 conn(0x7fba280c81a0 0x7fba280ad5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:34856/0 (socket says 172.21.15.5:34856) 2024-08-17T02:24:45.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.487+0000 7fba2cc00640 1 -- 172.21.15.5:0/353528938 >> v2:172.21.15.87:3300/0 conn(0x7fba280adcd0 msgr2=0x7fba280c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:45.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.487+0000 7fba2cc00640 1 --2- 172.21.15.5:0/353528938 >> v2:172.21.15.87:3300/0 conn(0x7fba280adcd0 0x7fba280c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.487+0000 7fba2cc00640 1 -- 172.21.15.5:0/353528938 >> v1:172.21.15.87:6789/0 conn(0x7fba280c81a0 legacy=0x7fba280ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.487+0000 7fba27400640 1 -- 172.21.15.5:0/353528938 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008130294 0 0) 0x7fba14001110 con 0x7fba280c81a0 2024-08-17T02:24:45.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.487+0000 7fba2cc00640 1 -- 172.21.15.5:0/353528938 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba280cac20 con 0x7fba28159eb0 2024-08-17T02:24:45.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.487+0000 7fba2d600640 1 --2- 172.21.15.5:0/353528938 >> v2:172.21.15.87:3300/0 conn(0x7fba280adcd0 0x7fba280c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:45.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.488+0000 7fba2cc00640 1 --2- 172.21.15.5:0/353528938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba28159eb0 0x7fba28156ef0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fba1c009850 tx=0x7fba1c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dd6a93898a68cbe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:45.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.489+0000 7fba27400640 1 -- 172.21.15.5:0/353528938 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c02ad00 con 0x7fba28159eb0 2024-08-17T02:24:45.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.489+0000 7fba27400640 1 -- 172.21.15.5:0/353528938 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1c02ae60 con 0x7fba28159eb0 2024-08-17T02:24:45.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.489+0000 7fba27400640 1 -- 172.21.15.5:0/353528938 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c032670 con 0x7fba28159eb0 2024-08-17T02:24:45.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.489+0000 7fba2e000640 1 -- 172.21.15.5:0/353528938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba28159eb0 msgr2=0x7fba28156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.489+0000 7fba2e000640 1 --2- 172.21.15.5:0/353528938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba28159eb0 0x7fba28156ef0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fba1c009850 tx=0x7fba1c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.489+0000 7fba2e000640 1 -- 172.21.15.5:0/353528938 shutdown_connections 2024-08-17T02:24:45.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.489+0000 7fba2e000640 1 --2- 172.21.15.5:0/353528938 >> v2:172.21.15.87:3300/0 conn(0x7fba280adcd0 0x7fba280c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.489+0000 7fba2e000640 1 --2- 172.21.15.5:0/353528938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba28159eb0 0x7fba28156ef0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.489+0000 7fba2e000640 1 -- 172.21.15.5:0/353528938 >> 172.21.15.5:0/353528938 conn(0x7fba28066e60 msgr2=0x7fba28067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:45.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.489+0000 7fba2e000640 1 -- 172.21.15.5:0/353528938 shutdown_connections 2024-08-17T02:24:45.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.489+0000 7fba2e000640 1 -- 172.21.15.5:0/353528938 wait complete. 2024-08-17T02:24:45.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.491+0000 7fba2e000640 1 Processor -- start 2024-08-17T02:24:45.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.491+0000 7fba2e000640 1 -- start start 2024-08-17T02:24:45.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.492+0000 7fba2e000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba280adcd0 0x7fba28169360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.492+0000 7fba2e000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba280c81a0 0x7fba280a9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.492+0000 7fba2e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba28159eb0 0x7fba2816c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.492+0000 7fba2e000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2815c290 con 0x7fba28159eb0 2024-08-17T02:24:45.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.492+0000 7fba2e000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2815c9a0 con 0x7fba280adcd0 2024-08-17T02:24:45.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.492+0000 7fba2e000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2816d450 con 0x7fba280c81a0 2024-08-17T02:24:45.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.492+0000 7fba2d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba28159eb0 0x7fba2816c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.492+0000 7fba2d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba28159eb0 0x7fba2816c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59940/0 (socket says 172.21.15.5:59940) 2024-08-17T02:24:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.492+0000 7fba2d600640 1 -- 172.21.15.5:0/1125890074 learned_addr learned my addr 172.21.15.5:0/1125890074 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.492+0000 7fba27e00640 1 --2- 172.21.15.5:0/1125890074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba280c81a0 0x7fba280a9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.492+0000 7fba2cc00640 1 --2- 172.21.15.5:0/1125890074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba280adcd0 0x7fba28169360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.493+0000 7fba2d600640 1 -- 172.21.15.5:0/1125890074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba280c81a0 msgr2=0x7fba280a9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.493+0000 7fba2d600640 1 --2- 172.21.15.5:0/1125890074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba280c81a0 0x7fba280a9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.493+0000 7fba2d600640 1 -- 172.21.15.5:0/1125890074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba280adcd0 msgr2=0x7fba28169360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.493+0000 7fba2d600640 1 --2- 172.21.15.5:0/1125890074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba280adcd0 0x7fba28169360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.493+0000 7fba2d600640 1 -- 172.21.15.5:0/1125890074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba20009ae0 con 0x7fba28159eb0 2024-08-17T02:24:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.493+0000 7fba27e00640 1 --2- 172.21.15.5:0/1125890074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba280c81a0 0x7fba280a9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.493+0000 7fba2d600640 1 --2- 172.21.15.5:0/1125890074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba28159eb0 0x7fba2816c8e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fba20009fd0 tx=0x7fba2000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:45.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.493+0000 7fba1be00640 1 -- 172.21.15.5:0/1125890074 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba20018070 con 0x7fba28159eb0 2024-08-17T02:24:45.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.493+0000 7fba1be00640 1 -- 172.21.15.5:0/1125890074 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2000f040 con 0x7fba28159eb0 2024-08-17T02:24:45.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.493+0000 7fba1be00640 1 -- 172.21.15.5:0/1125890074 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba200092e0 con 0x7fba28159eb0 2024-08-17T02:24:45.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.493+0000 7fba2e000640 1 -- 172.21.15.5:0/1125890074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1c009390 con 0x7fba28159eb0 2024-08-17T02:24:45.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.493+0000 7fba2e000640 1 -- 172.21.15.5:0/1125890074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2816d730 con 0x7fba28159eb0 2024-08-17T02:24:45.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.495+0000 7fba2e000640 1 -- 172.21.15.5:0/1125890074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2815d0f0 con 0x7fba28159eb0 2024-08-17T02:24:45.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.495+0000 7fba1be00640 1 -- 172.21.15.5:0/1125890074 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fba20003020 con 0x7fba28159eb0 2024-08-17T02:24:45.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.497+0000 7fba1be00640 1 --2- 172.21.15.5:0/1125890074 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fba08065150 0x7fba08067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.497+0000 7fba1be00640 1 -- 172.21.15.5:0/1125890074 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fba20082e80 con 0x7fba28159eb0 2024-08-17T02:24:45.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.497+0000 7fba2cc00640 1 --2- 172.21.15.5:0/1125890074 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fba08065150 0x7fba08067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.498+0000 7fba2cc00640 1 --2- 172.21.15.5:0/1125890074 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fba08065150 0x7fba08067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fba1c034000 tx=0x7fba1c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:45.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.501+0000 7fba1be00640 1 -- 172.21.15.5:0/1125890074 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fba20050b20 con 0x7fba28159eb0 2024-08-17T02:24:45.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.709+0000 7fba2e000640 1 -- 172.21.15.5:0/1125890074 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fba28070720 con 0x7fba08065150 2024-08-17T02:24:45.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.710+0000 7fba1be00640 1 -- 172.21.15.5:0/1125890074 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7fba28070720 con 0x7fba08065150 2024-08-17T02:24:45.711 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-17T02:24:45.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:45.711 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2024-08-17T02:24:45.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:24:45.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:24:45.711 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volume_0000000001044363" 2024-08-17T02:24:45.711 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:24:45.711 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-17T02:24:45.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.712+0000 7fba2e000640 1 -- 172.21.15.5:0/1125890074 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fba08065150 msgr2=0x7fba08067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.712+0000 7fba2e000640 1 --2- 172.21.15.5:0/1125890074 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fba08065150 0x7fba08067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fba1c034000 tx=0x7fba1c032000 comp rx=0 tx=0).stop 2024-08-17T02:24:45.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.712+0000 7fba2e000640 1 -- 172.21.15.5:0/1125890074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba28159eb0 msgr2=0x7fba2816c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.712+0000 7fba2e000640 1 --2- 172.21.15.5:0/1125890074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba28159eb0 0x7fba2816c8e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fba20009fd0 tx=0x7fba2000b040 comp rx=0 tx=0).stop 2024-08-17T02:24:45.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.712+0000 7fba2e000640 1 -- 172.21.15.5:0/1125890074 shutdown_connections 2024-08-17T02:24:45.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.712+0000 7fba2e000640 1 --2- 172.21.15.5:0/1125890074 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fba08065150 0x7fba08067600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.712+0000 7fba2e000640 1 --2- 172.21.15.5:0/1125890074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba280c81a0 0x7fba280a9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.712+0000 7fba2e000640 1 --2- 172.21.15.5:0/1125890074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba28159eb0 0x7fba2816c8e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.712+0000 7fba2e000640 1 --2- 172.21.15.5:0/1125890074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba280adcd0 0x7fba28169360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.712+0000 7fba2e000640 1 -- 172.21.15.5:0/1125890074 >> 172.21.15.5:0/1125890074 conn(0x7fba28066e60 msgr2=0x7fba2806acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:45.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.713+0000 7fba2e000640 1 -- 172.21.15.5:0/1125890074 shutdown_connections 2024-08-17T02:24:45.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.713+0000 7fba2e000640 1 -- 172.21.15.5:0/1125890074 wait complete. 2024-08-17T02:24:45.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:24:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.882+0000 7fa2f3200640 1 Processor -- start 2024-08-17T02:24:45.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.882+0000 7fa2f3200640 1 -- start start 2024-08-17T02:24:45.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.883+0000 7fa2f3200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa2f40ae7d0 0x7fa2f40ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.883+0000 7fa2f3200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa2f4156cd0 0x7fa2f40adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.883+0000 7fa2f3200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f40b08d0 con 0x7fa2f4156900 2024-08-17T02:24:45.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.883+0000 7fa2f3200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f40b0b10 con 0x7fa2f40ae7d0 2024-08-17T02:24:45.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.883+0000 7fa2f3200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f40b0df0 con 0x7fa2f4156cd0 2024-08-17T02:24:45.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.883+0000 7fa2f1e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa2f4156900 0x7fa2f40b01c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39614/0 (socket says 172.21.15.5:39614) 2024-08-17T02:24:45.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.884+0000 7fa2f1e00640 1 -- 172.21.15.5:0/1605558217 learned_addr learned my addr 172.21.15.5:0/1605558217 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:45.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.883+0000 7fa2e9400640 1 --2- 172.21.15.5:0/1605558217 >> v2:172.21.15.5:3300/0 conn(0x7fa2f40ae7d0 0x7fa2f40ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.884+0000 7fa2f2800640 1 --2- 172.21.15.5:0/1605558217 >> v2:172.21.15.87:3300/0 conn(0x7fa2f4156cd0 0x7fa2f40adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.884+0000 7fa2e9400640 1 -- 172.21.15.5:0/1605558217 >> v2:172.21.15.87:3300/0 conn(0x7fa2f4156cd0 msgr2=0x7fa2f40adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.884+0000 7fa2e9400640 1 --2- 172.21.15.5:0/1605558217 >> v2:172.21.15.87:3300/0 conn(0x7fa2f4156cd0 0x7fa2f40adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.884+0000 7fa2e9400640 1 -- 172.21.15.5:0/1605558217 >> v1:172.21.15.5:6789/0 conn(0x7fa2f4156900 legacy=0x7fa2f40b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.884+0000 7fa2e9400640 1 -- 172.21.15.5:0/1605558217 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f40b10d0 con 0x7fa2f40ae7d0 2024-08-17T02:24:45.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.885+0000 7fa2e9400640 1 --2- 172.21.15.5:0/1605558217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f40ae7d0 0x7fa2f40ada70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40cb730 tx=0x7fa2dc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695b227396fac433 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.885+0000 7fa2f1400640 1 -- 172.21.15.5:0/1605558217 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc02adb0 con 0x7fa2f40ae7d0 2024-08-17T02:24:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.885+0000 7fa2f1400640 1 -- 172.21.15.5:0/1605558217 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2dc032440 con 0x7fa2f40ae7d0 2024-08-17T02:24:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.885+0000 7fa2f1400640 1 -- 172.21.15.5:0/1605558217 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc032820 con 0x7fa2f40ae7d0 2024-08-17T02:24:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.886+0000 7fa2f3200640 1 -- 172.21.15.5:0/1605558217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f40ae7d0 msgr2=0x7fa2f40ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.886+0000 7fa2f3200640 1 --2- 172.21.15.5:0/1605558217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f40ae7d0 0x7fa2f40ada70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40cb730 tx=0x7fa2dc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.886+0000 7fa2f3200640 1 -- 172.21.15.5:0/1605558217 shutdown_connections 2024-08-17T02:24:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.886+0000 7fa2f3200640 1 --2- 172.21.15.5:0/1605558217 >> v2:172.21.15.87:3300/0 conn(0x7fa2f4156cd0 0x7fa2f40adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.886+0000 7fa2f3200640 1 --2- 172.21.15.5:0/1605558217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f40ae7d0 0x7fa2f40ada70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.886+0000 7fa2f3200640 1 -- 172.21.15.5:0/1605558217 >> 172.21.15.5:0/1605558217 conn(0x7fa2f4067930 msgr2=0x7fa2f40cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.886+0000 7fa2f3200640 1 -- 172.21.15.5:0/1605558217 shutdown_connections 2024-08-17T02:24:45.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.886+0000 7fa2f3200640 1 -- 172.21.15.5:0/1605558217 wait complete. 2024-08-17T02:24:45.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.887+0000 7fa2f3200640 1 Processor -- start 2024-08-17T02:24:45.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.888+0000 7fa2f3200640 1 -- start start 2024-08-17T02:24:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.888+0000 7fa2f3200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2f40ae7d0 0x7fa2f4169d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.888+0000 7fa2f3200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2f4156900 0x7fa2f414f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.888+0000 7fa2f3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f4156cd0 0x7fa2f4154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.888+0000 7fa2f3200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f416a2b0 con 0x7fa2f4156cd0 2024-08-17T02:24:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.888+0000 7fa2f3200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f414f900 con 0x7fa2f40ae7d0 2024-08-17T02:24:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.888+0000 7fa2f3200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f406b5a0 con 0x7fa2f4156900 2024-08-17T02:24:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.889+0000 7fa2f2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f4156cd0 0x7fa2f4154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.889+0000 7fa2f2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f4156cd0 0x7fa2f4154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59952/0 (socket says 172.21.15.5:59952) 2024-08-17T02:24:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.889+0000 7fa2f2800640 1 -- 172.21.15.5:0/2846567201 learned_addr learned my addr 172.21.15.5:0/2846567201 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.889+0000 7fa2f1e00640 1 --2- 172.21.15.5:0/2846567201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2f40ae7d0 0x7fa2f4169d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.889+0000 7fa2e9400640 1 --2- 172.21.15.5:0/2846567201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2f4156900 0x7fa2f414f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.889+0000 7fa2f2800640 1 -- 172.21.15.5:0/2846567201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2f4156900 msgr2=0x7fa2f414f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.889+0000 7fa2f2800640 1 --2- 172.21.15.5:0/2846567201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2f4156900 0x7fa2f414f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.889+0000 7fa2f2800640 1 -- 172.21.15.5:0/2846567201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2f40ae7d0 msgr2=0x7fa2f4169d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.889+0000 7fa2f2800640 1 --2- 172.21.15.5:0/2846567201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2f40ae7d0 0x7fa2f4169d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.889+0000 7fa2f2800640 1 -- 172.21.15.5:0/2846567201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc009390 con 0x7fa2f4156cd0 2024-08-17T02:24:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.889+0000 7fa2f2800640 1 --2- 172.21.15.5:0/2846567201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f4156cd0 0x7fa2f4154710 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009df0 tx=0x7fa2ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.890+0000 7fa2ea000640 1 -- 172.21.15.5:0/2846567201 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec00cd40 con 0x7fa2f4156cd0 2024-08-17T02:24:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.890+0000 7fa2ea000640 1 -- 172.21.15.5:0/2846567201 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec00f040 con 0x7fa2f4156cd0 2024-08-17T02:24:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.890+0000 7fa2ea000640 1 -- 172.21.15.5:0/2846567201 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0146d0 con 0x7fa2f4156cd0 2024-08-17T02:24:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.890+0000 7fa2f3200640 1 -- 172.21.15.5:0/2846567201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f406a500 con 0x7fa2f4156cd0 2024-08-17T02:24:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.890+0000 7fa2f3200640 1 -- 172.21.15.5:0/2846567201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f406aac0 con 0x7fa2f4156cd0 2024-08-17T02:24:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.891+0000 7fa2f3200640 1 -- 172.21.15.5:0/2846567201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f4070720 con 0x7fa2f4156cd0 2024-08-17T02:24:45.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.892+0000 7fa2ea000640 1 -- 172.21.15.5:0/2846567201 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa2ec014a80 con 0x7fa2f4156cd0 2024-08-17T02:24:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.892+0000 7fa2ea000640 1 --2- 172.21.15.5:0/2846567201 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa2d0065180 0x7fa2d0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.893+0000 7fa2ea000640 1 -- 172.21.15.5:0/2846567201 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fa2ec082ff0 con 0x7fa2f4156cd0 2024-08-17T02:24:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.893+0000 7fa2f1e00640 1 --2- 172.21.15.5:0/2846567201 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa2d0065180 0x7fa2d0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.893+0000 7fa2f1e00640 1 --2- 172.21.15.5:0/2846567201 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa2d0065180 0x7fa2d0067630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40cc090 tx=0x7fa2e4007e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:45.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:45.896+0000 7fa2ea000640 1 -- 172.21.15.5:0/2846567201 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa2ec050d80 con 0x7fa2f4156cd0 2024-08-17T02:24:46.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.077+0000 7fa2f3200640 1 -- 172.21.15.5:0/2846567201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7fa2f40ad3c0 con 0x7fa2f4156cd0 2024-08-17T02:24:46.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.078+0000 7fa2ea000640 1 -- 172.21.15.5:0/2846567201 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v38) v1 ==== 97+0+8037 (secure 0 0 0) 0x7fa2ec0180a0 con 0x7fa2f4156cd0 2024-08-17T02:24:46.079 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:46.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.080+0000 7fa2f3200640 1 -- 172.21.15.5:0/2846567201 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa2d0065180 msgr2=0x7fa2d0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:46.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.080+0000 7fa2f3200640 1 --2- 172.21.15.5:0/2846567201 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa2d0065180 0x7fa2d0067630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40cc090 tx=0x7fa2e4007e40 comp rx=0 tx=0).stop 2024-08-17T02:24:46.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.080+0000 7fa2f3200640 1 -- 172.21.15.5:0/2846567201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f4156cd0 msgr2=0x7fa2f4154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:46.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.080+0000 7fa2f3200640 1 --2- 172.21.15.5:0/2846567201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f4156cd0 0x7fa2f4154710 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009df0 tx=0x7fa2ec00b040 comp rx=0 tx=0).stop 2024-08-17T02:24:46.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.080+0000 7fa2f3200640 1 -- 172.21.15.5:0/2846567201 shutdown_connections 2024-08-17T02:24:46.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.080+0000 7fa2f3200640 1 --2- 172.21.15.5:0/2846567201 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa2d0065180 0x7fa2d0067630 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.080+0000 7fa2f3200640 1 --2- 172.21.15.5:0/2846567201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2f4156900 0x7fa2f414f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.080+0000 7fa2f3200640 1 --2- 172.21.15.5:0/2846567201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f4156cd0 0x7fa2f4154710 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.080+0000 7fa2f3200640 1 --2- 172.21.15.5:0/2846567201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2f40ae7d0 0x7fa2f4169d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.080+0000 7fa2f3200640 1 -- 172.21.15.5:0/2846567201 >> 172.21.15.5:0/2846567201 conn(0x7fa2f4067930 msgr2=0x7fa2f4157190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:46.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.080+0000 7fa2f3200640 1 -- 172.21.15.5:0/2846567201 shutdown_connections 2024-08-17T02:24:46.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.080+0000 7fa2f3200640 1 -- 172.21.15.5:0/2846567201 wait complete. 2024-08-17T02:24:46.095 INFO:teuthology.orchestra.run.smithi005.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:29.724167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:30.637206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000001044363.meta","create_time":"2024-08-17T02:24:42.487826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001044363"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000001044363.data","create_time":"2024-08-17T02:24:43.336536+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001044363"}}}] 2024-08-17T02:24:46.096 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000001044363 --format=json 2024-08-17T02:24:46.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.248+0000 7fbbcae00640 1 Processor -- start 2024-08-17T02:24:46.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.248+0000 7fbbcae00640 1 -- start start 2024-08-17T02:24:46.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.250+0000 7fbbcae00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbbc40add30 0x7fbbc4156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:46.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.250+0000 7fbbcae00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc40cb160 con 0x7fbbc40ad960 2024-08-17T02:24:46.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.250+0000 7fbbcae00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc40b0d10 con 0x7fbbc40ca050 2024-08-17T02:24:46.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.250+0000 7fbbcae00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc40ca550 con 0x7fbbc40add30 2024-08-17T02:24:46.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.250+0000 7fbbc3e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbbc40ad960 0x7fbbc4156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39622/0 (socket says 172.21.15.5:39622) 2024-08-17T02:24:46.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.250+0000 7fbbc3e00640 1 -- 172.21.15.5:0/3618992609 learned_addr learned my addr 172.21.15.5:0/3618992609 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:24:46.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.250+0000 7fbbc8e00640 1 --2- 172.21.15.5:0/3618992609 >> v2:172.21.15.5:3300/0 conn(0x7fbbc40add30 0x7fbbc4156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:46.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.250+0000 7fbbc8e00640 1 -- 172.21.15.5:0/3618992609 >> v1:172.21.15.87:6789/0 conn(0x7fbbc40ca050 legacy=0x7fbbc40aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:46.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.250+0000 7fbbc8e00640 1 -- 172.21.15.5:0/3618992609 >> v1:172.21.15.5:6789/0 conn(0x7fbbc40ad960 legacy=0x7fbbc4156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:46.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.250+0000 7fbbc8e00640 1 -- 172.21.15.5:0/3618992609 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc40ca830 con 0x7fbbc40add30 2024-08-17T02:24:46.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.251+0000 7fbbc8e00640 1 --2- 172.21.15.5:0/3618992609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbc40add30 0x7fbbc4156b30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009e60 tx=0x7fbbbc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f303d1fc33927240 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:46.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.252+0000 7fbbc3400640 1 -- 172.21.15.5:0/3618992609 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc030560 con 0x7fbbc40add30 2024-08-17T02:24:46.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.252+0000 7fbbc3400640 1 -- 172.21.15.5:0/3618992609 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc0306c0 con 0x7fbbc40add30 2024-08-17T02:24:46.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.252+0000 7fbbc3400640 1 -- 172.21.15.5:0/3618992609 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc030aa0 con 0x7fbbc40add30 2024-08-17T02:24:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.252+0000 7fbbcae00640 1 -- 172.21.15.5:0/3618992609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbc40add30 msgr2=0x7fbbc4156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.252+0000 7fbbcae00640 1 --2- 172.21.15.5:0/3618992609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbc40add30 0x7fbbc4156b30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009e60 tx=0x7fbbbc009780 comp rx=0 tx=0).stop 2024-08-17T02:24:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.252+0000 7fbbcae00640 1 -- 172.21.15.5:0/3618992609 shutdown_connections 2024-08-17T02:24:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.252+0000 7fbbcae00640 1 --2- 172.21.15.5:0/3618992609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbc40add30 0x7fbbc4156b30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.252+0000 7fbbcae00640 1 -- 172.21.15.5:0/3618992609 >> 172.21.15.5:0/3618992609 conn(0x7fbbc4066e60 msgr2=0x7fbbc4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.252+0000 7fbbcae00640 1 -- 172.21.15.5:0/3618992609 shutdown_connections 2024-08-17T02:24:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.252+0000 7fbbcae00640 1 -- 172.21.15.5:0/3618992609 wait complete. 2024-08-17T02:24:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.254+0000 7fbbcae00640 1 Processor -- start 2024-08-17T02:24:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.254+0000 7fbbcae00640 1 -- start start 2024-08-17T02:24:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.254+0000 7fbbcae00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbc40ad960 0x7fbbc40a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.255+0000 7fbbcae00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbc40add30 0x7fbbc40a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.255+0000 7fbbcae00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbc40ca050 0x7fbbc40a83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.255+0000 7fbbcae00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc414d160 con 0x7fbbc40add30 2024-08-17T02:24:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.255+0000 7fbbcae00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc414d440 con 0x7fbbc40ca050 2024-08-17T02:24:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.255+0000 7fbbcae00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc414d720 con 0x7fbbc40ad960 2024-08-17T02:24:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.255+0000 7fbbbb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbc40add30 0x7fbbc40a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.255+0000 7fbbbb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbc40add30 0x7fbbc40a6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59972/0 (socket says 172.21.15.5:59972) 2024-08-17T02:24:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.255+0000 7fbbbb400640 1 -- 172.21.15.5:0/23212321 learned_addr learned my addr 172.21.15.5:0/23212321 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.255+0000 7fbbc3e00640 1 --2- 172.21.15.5:0/23212321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbc40ad960 0x7fbbc40a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.255+0000 7fbbc8e00640 1 --2- 172.21.15.5:0/23212321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbc40ca050 0x7fbbc40a83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.255+0000 7fbbbb400640 1 -- 172.21.15.5:0/23212321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbc40ad960 msgr2=0x7fbbc40a4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.255+0000 7fbbbb400640 1 --2- 172.21.15.5:0/23212321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbc40ad960 0x7fbbc40a4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.255+0000 7fbbbb400640 1 -- 172.21.15.5:0/23212321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbc40ca050 msgr2=0x7fbbc40a83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.255+0000 7fbbbb400640 1 --2- 172.21.15.5:0/23212321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbc40ca050 0x7fbbc40a83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.255+0000 7fbbbb400640 1 -- 172.21.15.5:0/23212321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbbc009a20 con 0x7fbbc40add30 2024-08-17T02:24:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.255+0000 7fbbc8e00640 1 --2- 172.21.15.5:0/23212321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbc40ca050 0x7fbbc40a83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.256+0000 7fbbbb400640 1 --2- 172.21.15.5:0/23212321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbc40add30 0x7fbbc40a6270 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00c4c0 tx=0x7fbbac007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.256+0000 7fbbbbe00640 1 -- 172.21.15.5:0/23212321 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac011590 con 0x7fbbc40add30 2024-08-17T02:24:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.256+0000 7fbbbbe00640 1 -- 172.21.15.5:0/23212321 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac011710 con 0x7fbbc40add30 2024-08-17T02:24:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.256+0000 7fbbcae00640 1 -- 172.21.15.5:0/23212321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc414da00 con 0x7fbbc40add30 2024-08-17T02:24:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.256+0000 7fbbbbe00640 1 -- 172.21.15.5:0/23212321 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac011ad0 con 0x7fbbc40add30 2024-08-17T02:24:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.256+0000 7fbbcae00640 1 -- 172.21.15.5:0/23212321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc40a67b0 con 0x7fbbc40add30 2024-08-17T02:24:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.257+0000 7fbbcae00640 1 -- 172.21.15.5:0/23212321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc414dbf0 con 0x7fbbc40add30 2024-08-17T02:24:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.258+0000 7fbbbbe00640 1 -- 172.21.15.5:0/23212321 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbbac01b3b0 con 0x7fbbc40add30 2024-08-17T02:24:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.259+0000 7fbbbbe00640 1 --2- 172.21.15.5:0/23212321 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fbba0065150 0x7fbba0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:46.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.259+0000 7fbbbbe00640 1 -- 172.21.15.5:0/23212321 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fbbac081c90 con 0x7fbbc40add30 2024-08-17T02:24:46.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.259+0000 7fbbc3e00640 1 --2- 172.21.15.5:0/23212321 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fbba0065150 0x7fbba0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:46.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.260+0000 7fbbc3e00640 1 --2- 172.21.15.5:0/23212321 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fbba0065150 0x7fbba0067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4007880 tx=0x7fbbb4007e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:46.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.264+0000 7fbbbbe00640 1 -- 172.21.15.5:0/23212321 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbbac04f9e0 con 0x7fbbc40add30 2024-08-17T02:24:46.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.491+0000 7fbbcae00640 1 -- 172.21.15.5:0/23212321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000001044363", "format": "json"} v 0) v1 -- 0x7fbbc414d2a0 con 0x7fbbc40add30 2024-08-17T02:24:46.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.492+0000 7fbbbbe00640 1 -- 172.21.15.5:0/23212321 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000001044363", "format": "json"}]=0 v20) v1 ==== 110+0+1844 (secure 0 0 0) 0x7fbbc414d2a0 con 0x7fbbc40add30 2024-08-17T02:24:46.492 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:24:46.492 INFO:teuthology.orchestra.run.smithi005.stdout:{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:44.295321+0000","modified":"2024-08-17T02:24:45.911915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4858},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4858":{"gid":4858,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.87:6835/1739323622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1739323622},{"type":"v1","addr":"172.21.15.87:6835","nonce":1739323622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001044363","balancer":"","standby_count_wanted":1},"id":3} 2024-08-17T02:24:46.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.493+0000 7fbbcae00640 1 -- 172.21.15.5:0/23212321 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fbba0065150 msgr2=0x7fbba0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.494+0000 7fbbcae00640 1 --2- 172.21.15.5:0/23212321 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fbba0065150 0x7fbba0067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4007880 tx=0x7fbbb4007e20 comp rx=0 tx=0).stop 2024-08-17T02:24:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.494+0000 7fbbcae00640 1 -- 172.21.15.5:0/23212321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbc40add30 msgr2=0x7fbbc40a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.494+0000 7fbbcae00640 1 --2- 172.21.15.5:0/23212321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbc40add30 0x7fbbc40a6270 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00c4c0 tx=0x7fbbac007ef0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.494+0000 7fbbcae00640 1 -- 172.21.15.5:0/23212321 shutdown_connections 2024-08-17T02:24:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.494+0000 7fbbcae00640 1 --2- 172.21.15.5:0/23212321 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fbba0065150 0x7fbba0067600 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.494+0000 7fbbcae00640 1 --2- 172.21.15.5:0/23212321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbc40ca050 0x7fbbc40a83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.494+0000 7fbbcae00640 1 --2- 172.21.15.5:0/23212321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbc40add30 0x7fbbc40a6270 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.494+0000 7fbbcae00640 1 --2- 172.21.15.5:0/23212321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbc40ad960 0x7fbbc40a4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.494+0000 7fbbcae00640 1 -- 172.21.15.5:0/23212321 >> 172.21.15.5:0/23212321 conn(0x7fbbc4066e60 msgr2=0x7fbbc406e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.494+0000 7fbbcae00640 1 -- 172.21.15.5:0/23212321 shutdown_connections 2024-08-17T02:24:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.494+0000 7fbbcae00640 1 -- 172.21.15.5:0/23212321 wait complete. 2024-08-17T02:24:46.509 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001044363 --yes-i-really-mean-it 2024-08-17T02:24:46.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.665+0000 7f2e58a00640 1 Processor -- start 2024-08-17T02:24:46.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.666+0000 7f2e58a00640 1 -- start start 2024-08-17T02:24:46.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.667+0000 7f2e58a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e54156900 0x7f2e540b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:46.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.667+0000 7f2e58a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2e540ae7d0 0x7f2e540ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:46.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.667+0000 7f2e58a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e54156cd0 0x7f2e540adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:46.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.667+0000 7f2e58a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e540b0b10 con 0x7f2e54156cd0 2024-08-17T02:24:46.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.667+0000 7f2e58a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e540b0df0 con 0x7f2e540ae7d0 2024-08-17T02:24:46.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.667+0000 7f2e58a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540b10d0 con 0x7f2e54156900 2024-08-17T02:24:46.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.667+0000 7f2e53e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e54156cd0 0x7f2e540adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:46.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.667+0000 7f2e53e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e54156cd0 0x7f2e540adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59974/0 (socket says 172.21.15.5:59974) 2024-08-17T02:24:46.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.667+0000 7f2e53e00640 1 -- 172.21.15.5:0/2612217438 learned_addr learned my addr 172.21.15.5:0/2612217438 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:46.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.667+0000 7f2e53e00640 1 -- 172.21.15.5:0/2612217438 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e54156900 msgr2=0x7f2e540b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:46.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.667+0000 7f2e53e00640 1 --2- 172.21.15.5:0/2612217438 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e54156900 0x7f2e540b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.667+0000 7f2e53e00640 1 -- 172.21.15.5:0/2612217438 >> v2:172.21.15.87:3300/0 conn(0x7f2e540ae7d0 msgr2=0x7f2e540ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:46.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.667+0000 7f2e53e00640 1 --2- 172.21.15.5:0/2612217438 >> v2:172.21.15.87:3300/0 conn(0x7f2e540ae7d0 0x7f2e540ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.667+0000 7f2e53e00640 1 -- 172.21.15.5:0/2612217438 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e540b13b0 con 0x7f2e54156cd0 2024-08-17T02:24:46.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.669+0000 7f2e53e00640 1 --2- 172.21.15.5:0/2612217438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e54156cd0 0x7f2e540adfb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2e5406cd10 tx=0x7f2e4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143b0d1810c56757 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:46.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.669+0000 7f2e52000640 1 -- 172.21.15.5:0/2612217438 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c031400 con 0x7f2e54156cd0 2024-08-17T02:24:46.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.669+0000 7f2e52000640 1 -- 172.21.15.5:0/2612217438 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c02d050 con 0x7f2e54156cd0 2024-08-17T02:24:46.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.669+0000 7f2e52000640 1 -- 172.21.15.5:0/2612217438 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0317d0 con 0x7f2e54156cd0 2024-08-17T02:24:46.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.669+0000 7f2e58a00640 1 -- 172.21.15.5:0/2612217438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e54156cd0 msgr2=0x7f2e540adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:46.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.669+0000 7f2e58a00640 1 --2- 172.21.15.5:0/2612217438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e54156cd0 0x7f2e540adfb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2e5406cd10 tx=0x7f2e4c009840 comp rx=0 tx=0).stop 2024-08-17T02:24:46.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.670+0000 7f2e58a00640 1 -- 172.21.15.5:0/2612217438 shutdown_connections 2024-08-17T02:24:46.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.670+0000 7f2e58a00640 1 --2- 172.21.15.5:0/2612217438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e54156cd0 0x7f2e540adfb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.670+0000 7f2e58a00640 1 --2- 172.21.15.5:0/2612217438 >> v2:172.21.15.87:3300/0 conn(0x7f2e540ae7d0 0x7f2e540ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.670+0000 7f2e58a00640 1 --2- 172.21.15.5:0/2612217438 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e54156900 0x7f2e540b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.670+0000 7f2e58a00640 1 -- 172.21.15.5:0/2612217438 >> 172.21.15.5:0/2612217438 conn(0x7f2e54067930 msgr2=0x7f2e540cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:46.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.670+0000 7f2e58a00640 1 -- 172.21.15.5:0/2612217438 shutdown_connections 2024-08-17T02:24:46.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.670+0000 7f2e58a00640 1 -- 172.21.15.5:0/2612217438 wait complete. 2024-08-17T02:24:46.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.671+0000 7f2e58a00640 1 Processor -- start 2024-08-17T02:24:46.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.671+0000 7f2e58a00640 1 -- start start 2024-08-17T02:24:46.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.672+0000 7f2e58a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e540ae7d0 0x7f2e54069870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:46.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.672+0000 7f2e58a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e54156900 0x7f2e5414cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:46.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.672+0000 7f2e58a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e54156cd0 0x7f2e5416a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:46.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.672+0000 7f2e58a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5416a520 con 0x7f2e540ae7d0 2024-08-17T02:24:46.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.672+0000 7f2e58a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5414da40 con 0x7f2e54156cd0 2024-08-17T02:24:46.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.672+0000 7f2e58a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5414dd20 con 0x7f2e54156900 2024-08-17T02:24:46.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.672+0000 7f2e53400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e540ae7d0 0x7f2e54069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:46.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.672+0000 7f2e53400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e540ae7d0 0x7f2e54069870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59978/0 (socket says 172.21.15.5:59978) 2024-08-17T02:24:46.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.672+0000 7f2e53400640 1 -- 172.21.15.5:0/3375448491 learned_addr learned my addr 172.21.15.5:0/3375448491 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:24:46.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.673+0000 7f2e53e00640 1 --2- 172.21.15.5:0/3375448491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e54156cd0 0x7f2e5416a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:46.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.673+0000 7f2e52a00640 1 --2- 172.21.15.5:0/3375448491 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e54156900 0x7f2e5414cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:46.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.673+0000 7f2e53400640 1 -- 172.21.15.5:0/3375448491 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e54156900 msgr2=0x7f2e5414cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:46.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.673+0000 7f2e53400640 1 --2- 172.21.15.5:0/3375448491 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e54156900 0x7f2e5414cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.673+0000 7f2e53400640 1 -- 172.21.15.5:0/3375448491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e54156cd0 msgr2=0x7f2e5416a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:46.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.673+0000 7f2e53400640 1 --2- 172.21.15.5:0/3375448491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e54156cd0 0x7f2e5416a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.673+0000 7f2e53400640 1 -- 172.21.15.5:0/3375448491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c009ae0 con 0x7f2e540ae7d0 2024-08-17T02:24:46.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.673+0000 7f2e52a00640 1 --2- 172.21.15.5:0/3375448491 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e54156900 0x7f2e5414cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:46.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.673+0000 7f2e53400640 1 --2- 172.21.15.5:0/3375448491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e540ae7d0 0x7f2e54069870 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400b500 tx=0x7f2e440090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:46.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.673+0000 7f2e4aa00640 1 -- 172.21.15.5:0/3375448491 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4400f510 con 0x7f2e540ae7d0 2024-08-17T02:24:46.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.673+0000 7f2e4aa00640 1 -- 172.21.15.5:0/3375448491 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4400f670 con 0x7f2e540ae7d0 2024-08-17T02:24:46.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.673+0000 7f2e4aa00640 1 -- 172.21.15.5:0/3375448491 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4400fa10 con 0x7f2e540ae7d0 2024-08-17T02:24:46.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.673+0000 7f2e58a00640 1 -- 172.21.15.5:0/3375448491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5414e000 con 0x7f2e540ae7d0 2024-08-17T02:24:46.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.673+0000 7f2e58a00640 1 -- 172.21.15.5:0/3375448491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e54159870 con 0x7f2e540ae7d0 2024-08-17T02:24:46.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.674+0000 7f2e58a00640 1 -- 172.21.15.5:0/3375448491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e54070720 con 0x7f2e540ae7d0 2024-08-17T02:24:46.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.675+0000 7f2e4aa00640 1 -- 172.21.15.5:0/3375448491 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2e4401a400 con 0x7f2e540ae7d0 2024-08-17T02:24:46.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.676+0000 7f2e4aa00640 1 --2- 172.21.15.5:0/3375448491 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2e34065180 0x7f2e34067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:46.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.676+0000 7f2e4aa00640 1 -- 172.21.15.5:0/3375448491 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f2e44082210 con 0x7f2e540ae7d0 2024-08-17T02:24:46.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.676+0000 7f2e52a00640 1 --2- 172.21.15.5:0/3375448491 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2e34065180 0x7f2e34067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:46.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.677+0000 7f2e52a00640 1 --2- 172.21.15.5:0/3375448491 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2e34065180 0x7f2e34067630 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2e40006fd0 tx=0x7f2e40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:46.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.680+0000 7f2e4aa00640 1 -- 172.21.15.5:0/3375448491 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2e4404ffd0 con 0x7f2e540ae7d0 2024-08-17T02:24:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:24:46.887+0000 7f2e58a00640 1 -- 172.21.15.5:0/3375448491 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000001044363", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e5416a660 con 0x7f2e34065180 2024-08-17T02:24:49.135 INFO:tasks.ceph.mds.b.smithi087.stderr:2024-08-17T02:24:49.135+0000 7f4a21200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:25:09.385 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:09.390 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:39.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:39.490 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:09.589 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:09.594 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:39.698 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:39.704 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:46.578 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:26:46.579 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:26:46.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:26:46.662 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:26:46.765 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:26:46.766 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:26:46.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:46.766 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:46.834 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:26:46.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:46.834 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:26:46.871 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:26:46.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:46.871 DEBUG:teuthology.orchestra.run.smithi087:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:46.936 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-08-17T02:26:46.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:46.936 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:26:46.972 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:47.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.125+0000 7ffa5b400640 1 Processor -- start 2024-08-17T02:26:47.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.125+0000 7ffa5b400640 1 -- start start 2024-08-17T02:26:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.126+0000 7ffa5b400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffa541590b0 0x7ffa540b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.126+0000 7ffa5b400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa540acf10 0x7ffa54159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.126+0000 7ffa5b400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5415a4e0 con 0x7ffa540afca0 2024-08-17T02:26:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.126+0000 7ffa5b400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa540b0980 con 0x7ffa541590b0 2024-08-17T02:26:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.126+0000 7ffa5b400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa540c92b0 con 0x7ffa540acf10 2024-08-17T02:26:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.127+0000 7ffa53e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffa541590b0 0x7ffa540b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.127+0000 7ffa59400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa540acf10 0x7ffa54159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.127+0000 7ffa58a00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ffa540afca0 0x7ffa541589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:55932/0 (socket says 172.21.15.5:55932) 2024-08-17T02:26:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.127+0000 7ffa58a00640 1 -- 172.21.15.5:0/3243528718 learned_addr learned my addr 172.21.15.5:0/3243528718 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:26:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.127+0000 7ffa53e00640 1 -- 172.21.15.5:0/3243528718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa540acf10 msgr2=0x7ffa54159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.127+0000 7ffa53e00640 1 --2- 172.21.15.5:0/3243528718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa540acf10 0x7ffa54159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.127+0000 7ffa53e00640 1 -- 172.21.15.5:0/3243528718 >> v1:172.21.15.87:6789/0 conn(0x7ffa540afca0 legacy=0x7ffa541589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.127+0000 7ffa53e00640 1 -- 172.21.15.5:0/3243528718 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa540ad480 con 0x7ffa541590b0 2024-08-17T02:26:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.128+0000 7ffa53e00640 1 --2- 172.21.15.5:0/3243528718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa541590b0 0x7ffa540b0070 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009850 tx=0x7ffa400090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a5266e486796aac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.129+0000 7ffa53400640 1 -- 172.21.15.5:0/3243528718 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4002ad90 con 0x7ffa541590b0 2024-08-17T02:26:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.129+0000 7ffa53400640 1 -- 172.21.15.5:0/3243528718 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa40032440 con 0x7ffa541590b0 2024-08-17T02:26:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.129+0000 7ffa53400640 1 -- 172.21.15.5:0/3243528718 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa40032820 con 0x7ffa541590b0 2024-08-17T02:26:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.129+0000 7ffa5b400640 1 -- 172.21.15.5:0/3243528718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa541590b0 msgr2=0x7ffa540b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.129+0000 7ffa5b400640 1 --2- 172.21.15.5:0/3243528718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa541590b0 0x7ffa540b0070 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009850 tx=0x7ffa400090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.129+0000 7ffa5b400640 1 -- 172.21.15.5:0/3243528718 shutdown_connections 2024-08-17T02:26:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.129+0000 7ffa5b400640 1 --2- 172.21.15.5:0/3243528718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa540acf10 0x7ffa54159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.129+0000 7ffa5b400640 1 --2- 172.21.15.5:0/3243528718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa541590b0 0x7ffa540b0070 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.129+0000 7ffa5b400640 1 -- 172.21.15.5:0/3243528718 >> 172.21.15.5:0/3243528718 conn(0x7ffa54066e60 msgr2=0x7ffa54067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.129+0000 7ffa5b400640 1 -- 172.21.15.5:0/3243528718 shutdown_connections 2024-08-17T02:26:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.129+0000 7ffa5b400640 1 -- 172.21.15.5:0/3243528718 wait complete. 2024-08-17T02:26:47.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.131+0000 7ffa5b400640 1 Processor -- start 2024-08-17T02:26:47.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.131+0000 7ffa5b400640 1 -- start start 2024-08-17T02:26:47.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.132+0000 7ffa5b400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa540acf10 0x7ffa540a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.132+0000 7ffa5b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa540afca0 0x7ffa5414a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.132+0000 7ffa5b400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa541590b0 0x7ffa5414a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.132+0000 7ffa5b400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5406af70 con 0x7ffa540afca0 2024-08-17T02:26:47.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.132+0000 7ffa5b400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa540c64e0 con 0x7ffa540acf10 2024-08-17T02:26:47.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.132+0000 7ffa5b400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa540c67c0 con 0x7ffa541590b0 2024-08-17T02:26:47.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.132+0000 7ffa53e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa540afca0 0x7ffa5414a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.132+0000 7ffa53e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa540afca0 0x7ffa5414a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35418/0 (socket says 172.21.15.5:35418) 2024-08-17T02:26:47.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.132+0000 7ffa53e00640 1 -- 172.21.15.5:0/1458470471 learned_addr learned my addr 172.21.15.5:0/1458470471 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:47.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.132+0000 7ffa58a00640 1 --2- 172.21.15.5:0/1458470471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa540acf10 0x7ffa540a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.132+0000 7ffa59400640 1 --2- 172.21.15.5:0/1458470471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa541590b0 0x7ffa5414a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.132+0000 7ffa53e00640 1 -- 172.21.15.5:0/1458470471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa541590b0 msgr2=0x7ffa5414a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.132+0000 7ffa53e00640 1 --2- 172.21.15.5:0/1458470471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa541590b0 0x7ffa5414a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.133+0000 7ffa53e00640 1 -- 172.21.15.5:0/1458470471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa540acf10 msgr2=0x7ffa540a51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.133+0000 7ffa53e00640 1 --2- 172.21.15.5:0/1458470471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa540acf10 0x7ffa540a51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.133+0000 7ffa53e00640 1 -- 172.21.15.5:0/1458470471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa40009390 con 0x7ffa540afca0 2024-08-17T02:26:47.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.133+0000 7ffa53e00640 1 --2- 172.21.15.5:0/1458470471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa540afca0 0x7ffa5414a3c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ffa40035040 tx=0x7ffa40032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.133+0000 7ffa47e00640 1 -- 172.21.15.5:0/1458470471 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa40000d10 con 0x7ffa540afca0 2024-08-17T02:26:47.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.133+0000 7ffa47e00640 1 -- 172.21.15.5:0/1458470471 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa40031e00 con 0x7ffa540afca0 2024-08-17T02:26:47.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.133+0000 7ffa47e00640 1 -- 172.21.15.5:0/1458470471 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4003e6a0 con 0x7ffa540afca0 2024-08-17T02:26:47.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.133+0000 7ffa5b400640 1 -- 172.21.15.5:0/1458470471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa540c6aa0 con 0x7ffa540afca0 2024-08-17T02:26:47.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.133+0000 7ffa5b400640 1 -- 172.21.15.5:0/1458470471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa540a5730 con 0x7ffa540afca0 2024-08-17T02:26:47.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.134+0000 7ffa5b400640 1 -- 172.21.15.5:0/1458470471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa540a5920 con 0x7ffa540afca0 2024-08-17T02:26:47.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.135+0000 7ffa47e00640 1 -- 172.21.15.5:0/1458470471 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffa4003c400 con 0x7ffa540afca0 2024-08-17T02:26:47.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.136+0000 7ffa47e00640 1 --2- 172.21.15.5:0/1458470471 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ffa34065150 0x7ffa34067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.136+0000 7ffa47e00640 1 -- 172.21.15.5:0/1458470471 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7ffa400a2d20 con 0x7ffa540afca0 2024-08-17T02:26:47.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.136+0000 7ffa58a00640 1 --2- 172.21.15.5:0/1458470471 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ffa34065150 0x7ffa34067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.137+0000 7ffa58a00640 1 --2- 172.21.15.5:0/1458470471 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ffa34065150 0x7ffa34067600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffa48007880 tx=0x7ffa48007e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.141+0000 7ffa47e00640 1 -- 172.21.15.5:0/1458470471 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffa40070a70 con 0x7ffa540afca0 2024-08-17T02:26:47.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.362+0000 7ffa5b400640 1 -- 172.21.15.5:0/1458470471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa540c6c90 con 0x7ffa540afca0 2024-08-17T02:26:47.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.362+0000 7ffa47e00640 1 -- 172.21.15.5:0/1458470471 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5678 (secure 0 0 0) 0x7ffa40043090 con 0x7ffa540afca0 2024-08-17T02:26:47.364 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:26:47.364 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1398504310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1398504310},{"type":"v1","addr":"172.21.15.5:6837","nonce":1398504310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/1045077639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1045077639},{"type":"v1","addr":"172.21.15.87:6833","nonce":1045077639}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:31.652483+0000","modified":"2024-08-17T02:24:35.247786+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6836/1918940200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1918940200},{"type":"v1","addr":"172.21.15.5:6836","nonce":1918940200}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:44.295321+0000","modified":"2024-08-17T02:24:45.911915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4858},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4858":{"gid":4858,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.87:6835/1739323622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1739323622},{"type":"v1","addr":"172.21.15.87:6835","nonce":1739323622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001044363","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:26:47.364 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 20 2024-08-17T02:26:47.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.364+0000 7ffa5b400640 1 -- 172.21.15.5:0/1458470471 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ffa34065150 msgr2=0x7ffa34067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.364+0000 7ffa5b400640 1 --2- 172.21.15.5:0/1458470471 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ffa34065150 0x7ffa34067600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffa48007880 tx=0x7ffa48007e20 comp rx=0 tx=0).stop 2024-08-17T02:26:47.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.364+0000 7ffa5b400640 1 -- 172.21.15.5:0/1458470471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa540afca0 msgr2=0x7ffa5414a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.364+0000 7ffa5b400640 1 --2- 172.21.15.5:0/1458470471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa540afca0 0x7ffa5414a3c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ffa40035040 tx=0x7ffa40032000 comp rx=0 tx=0).stop 2024-08-17T02:26:47.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.364+0000 7ffa5b400640 1 -- 172.21.15.5:0/1458470471 shutdown_connections 2024-08-17T02:26:47.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.364+0000 7ffa5b400640 1 --2- 172.21.15.5:0/1458470471 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ffa34065150 0x7ffa34067600 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.364+0000 7ffa5b400640 1 --2- 172.21.15.5:0/1458470471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa541590b0 0x7ffa5414a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.364+0000 7ffa5b400640 1 --2- 172.21.15.5:0/1458470471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa540afca0 0x7ffa5414a3c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.364+0000 7ffa5b400640 1 --2- 172.21.15.5:0/1458470471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa540acf10 0x7ffa540a51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.364+0000 7ffa5b400640 1 -- 172.21.15.5:0/1458470471 >> 172.21.15.5:0/1458470471 conn(0x7ffa54066e60 msgr2=0x7ffa540ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.364+0000 7ffa5b400640 1 -- 172.21.15.5:0/1458470471 shutdown_connections 2024-08-17T02:26:47.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.364+0000 7ffa5b400640 1 -- 172.21.15.5:0/1458470471 wait complete. 2024-08-17T02:26:47.381 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:47.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.530+0000 7fa181200640 1 Processor -- start 2024-08-17T02:26:47.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.530+0000 7fa181200640 1 -- start start 2024-08-17T02:26:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.531+0000 7fa181200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa17c158b50 0x7fa17c0b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.531+0000 7fa181200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa17c158f20 0x7fa17c0b2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.531+0000 7fa181200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa17c0b25b0 con 0x7fa17c0af440 2024-08-17T02:26:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.531+0000 7fa181200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17c0affd0 con 0x7fa17c158f20 2024-08-17T02:26:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.531+0000 7fa181200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c0cb0d0 con 0x7fa17c158b50 2024-08-17T02:26:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.531+0000 7fa179400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa17c158f20 0x7fa17c0b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.531+0000 7fa179400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa17c158f20 0x7fa17c0b2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35428/0 (socket says 172.21.15.5:35428) 2024-08-17T02:26:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.531+0000 7fa179400640 1 -- 172.21.15.5:0/510860327 learned_addr learned my addr 172.21.15.5:0/510860327 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.532+0000 7fa179e00640 1 --2- 172.21.15.5:0/510860327 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa17c158b50 0x7fa17c0b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.532+0000 7fa179400640 1 -- 172.21.15.5:0/510860327 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa17c158b50 msgr2=0x7fa17c0b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.532+0000 7fa179400640 1 --2- 172.21.15.5:0/510860327 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa17c158b50 0x7fa17c0b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.532+0000 7fa179400640 1 -- 172.21.15.5:0/510860327 >> v1:172.21.15.87:6789/0 conn(0x7fa17c0af440 legacy=0x7fa17c0af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.532+0000 7fa179400640 1 -- 172.21.15.5:0/510860327 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c0caaf0 con 0x7fa17c158f20 2024-08-17T02:26:47.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.533+0000 7fa179400640 1 --2- 172.21.15.5:0/510860327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17c158f20 0x7fa17c0b2070 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa168009910 tx=0x7fa1680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b0baea22be1530 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.533+0000 7fa178a00640 1 -- 172.21.15.5:0/510860327 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16802ae40 con 0x7fa17c158f20 2024-08-17T02:26:47.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.533+0000 7fa178a00640 1 -- 172.21.15.5:0/510860327 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa168032440 con 0x7fa17c158f20 2024-08-17T02:26:47.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.533+0000 7fa178a00640 1 -- 172.21.15.5:0/510860327 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa168032820 con 0x7fa17c158f20 2024-08-17T02:26:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.534+0000 7fa181200640 1 -- 172.21.15.5:0/510860327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17c158f20 msgr2=0x7fa17c0b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.534+0000 7fa181200640 1 --2- 172.21.15.5:0/510860327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17c158f20 0x7fa17c0b2070 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa168009910 tx=0x7fa1680091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.534+0000 7fa181200640 1 -- 172.21.15.5:0/510860327 shutdown_connections 2024-08-17T02:26:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.534+0000 7fa181200640 1 --2- 172.21.15.5:0/510860327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17c158f20 0x7fa17c0b2070 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.534+0000 7fa181200640 1 --2- 172.21.15.5:0/510860327 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa17c158b50 0x7fa17c0b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.534+0000 7fa181200640 1 -- 172.21.15.5:0/510860327 >> 172.21.15.5:0/510860327 conn(0x7fa17c06e590 msgr2=0x7fa17c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.534+0000 7fa181200640 1 -- 172.21.15.5:0/510860327 shutdown_connections 2024-08-17T02:26:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.534+0000 7fa181200640 1 -- 172.21.15.5:0/510860327 wait complete. 2024-08-17T02:26:47.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.535+0000 7fa181200640 1 Processor -- start 2024-08-17T02:26:47.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.535+0000 7fa181200640 1 -- start start 2024-08-17T02:26:47.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.536+0000 7fa181200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa17c0af440 0x7fa17c0c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.536+0000 7fa181200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17c158b50 0x7fa17c14f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.536+0000 7fa181200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa17c158f20 0x7fa17c157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.536+0000 7fa181200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c0c74b0 con 0x7fa17c158b50 2024-08-17T02:26:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.536+0000 7fa181200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c0c5660 con 0x7fa17c158f20 2024-08-17T02:26:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.536+0000 7fa181200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c0c6e60 con 0x7fa17c0af440 2024-08-17T02:26:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.536+0000 7fa179400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17c158b50 0x7fa17c14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.537+0000 7fa179400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17c158b50 0x7fa17c14f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35442/0 (socket says 172.21.15.5:35442) 2024-08-17T02:26:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.537+0000 7fa179400640 1 -- 172.21.15.5:0/3125514745 learned_addr learned my addr 172.21.15.5:0/3125514745 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.537+0000 7fa179e00640 1 --2- 172.21.15.5:0/3125514745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa17c0af440 0x7fa17c0c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.537+0000 7fa17a800640 1 --2- 172.21.15.5:0/3125514745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa17c158f20 0x7fa17c157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.537+0000 7fa179400640 1 -- 172.21.15.5:0/3125514745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa17c0af440 msgr2=0x7fa17c0c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.537+0000 7fa179400640 1 --2- 172.21.15.5:0/3125514745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa17c0af440 0x7fa17c0c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.537+0000 7fa179400640 1 -- 172.21.15.5:0/3125514745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa17c158f20 msgr2=0x7fa17c157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.537+0000 7fa179400640 1 --2- 172.21.15.5:0/3125514745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa17c158f20 0x7fa17c157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.537+0000 7fa179400640 1 -- 172.21.15.5:0/3125514745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa168009450 con 0x7fa17c158b50 2024-08-17T02:26:47.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.537+0000 7fa179400640 1 --2- 172.21.15.5:0/3125514745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17c158b50 0x7fa17c14f250 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa168035040 tx=0x7fa168032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.537+0000 7fa171600640 1 -- 172.21.15.5:0/3125514745 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa168031c80 con 0x7fa17c158b50 2024-08-17T02:26:47.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.538+0000 7fa171600640 1 -- 172.21.15.5:0/3125514745 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa168031e00 con 0x7fa17c158b50 2024-08-17T02:26:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.538+0000 7fa171600640 1 -- 172.21.15.5:0/3125514745 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16803d670 con 0x7fa17c158b50 2024-08-17T02:26:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.538+0000 7fa181200640 1 -- 172.21.15.5:0/3125514745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17c0c7140 con 0x7fa17c158b50 2024-08-17T02:26:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.538+0000 7fa181200640 1 -- 172.21.15.5:0/3125514745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17c14f790 con 0x7fa17c158b50 2024-08-17T02:26:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.539+0000 7fa181200640 1 -- 172.21.15.5:0/3125514745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17c063fb0 con 0x7fa17c158b50 2024-08-17T02:26:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.540+0000 7fa171600640 1 -- 172.21.15.5:0/3125514745 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa168039040 con 0x7fa17c158b50 2024-08-17T02:26:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.541+0000 7fa171600640 1 --2- 172.21.15.5:0/3125514745 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa15c065150 0x7fa15c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.541+0000 7fa171600640 1 -- 172.21.15.5:0/3125514745 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fa16802ae40 con 0x7fa17c158b50 2024-08-17T02:26:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.541+0000 7fa179e00640 1 --2- 172.21.15.5:0/3125514745 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa15c065150 0x7fa15c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.542+0000 7fa179e00640 1 --2- 172.21.15.5:0/3125514745 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa15c065150 0x7fa15c067600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa16c007ba0 tx=0x7fa16c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.545+0000 7fa171600640 1 -- 172.21.15.5:0/3125514745 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa1680704c0 con 0x7fa17c158b50 2024-08-17T02:26:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.729+0000 7fa181200640 1 -- 172.21.15.5:0/3125514745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa17c0b13f0 con 0x7fa17c158b50 2024-08-17T02:26:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.730+0000 7fa171600640 1 -- 172.21.15.5:0/3125514745 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18503 (secure 0 0 0) 0x7fa168073ae0 con 0x7fa17c158b50 2024-08-17T02:26:47.732 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:26:47.732 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":39,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:24:46.313823+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:29.724167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:30.637206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000001044363.meta","create_time":"2024-08-17T02:24:42.487826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001044363"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001044363.data","create_time":"2024-08-17T02:24:43.336536+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001044363"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:47.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.732+0000 7fa181200640 1 -- 172.21.15.5:0/3125514745 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa15c065150 msgr2=0x7fa15c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.732+0000 7fa181200640 1 --2- 172.21.15.5:0/3125514745 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa15c065150 0x7fa15c067600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa16c007ba0 tx=0x7fa16c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:47.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.732+0000 7fa181200640 1 -- 172.21.15.5:0/3125514745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17c158b50 msgr2=0x7fa17c14f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.732+0000 7fa181200640 1 --2- 172.21.15.5:0/3125514745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17c158b50 0x7fa17c14f250 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa168035040 tx=0x7fa168032000 comp rx=0 tx=0).stop 2024-08-17T02:26:47.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.732+0000 7fa181200640 1 -- 172.21.15.5:0/3125514745 shutdown_connections 2024-08-17T02:26:47.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.732+0000 7fa181200640 1 --2- 172.21.15.5:0/3125514745 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fa15c065150 0x7fa15c067600 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.732+0000 7fa181200640 1 --2- 172.21.15.5:0/3125514745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa17c158f20 0x7fa17c157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.732+0000 7fa181200640 1 --2- 172.21.15.5:0/3125514745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17c158b50 0x7fa17c14f250 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.732+0000 7fa181200640 1 --2- 172.21.15.5:0/3125514745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa17c0af440 0x7fa17c0c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.732+0000 7fa181200640 1 -- 172.21.15.5:0/3125514745 >> 172.21.15.5:0/3125514745 conn(0x7fa17c06e590 msgr2=0x7fa17c1501c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.732+0000 7fa181200640 1 -- 172.21.15.5:0/3125514745 shutdown_connections 2024-08-17T02:26:47.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.732+0000 7fa181200640 1 -- 172.21.15.5:0/3125514745 wait complete. 2024-08-17T02:26:47.749 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:28.773677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:24:29.724167+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:24:30.637206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000001044363.meta', 'create_time': '2024-08-17T02:24:42.487826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000001044363'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000001044363.data', 'create_time': '2024-08-17T02:24:43.336536+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000001044363'}}}] 2024-08-17T02:26:47.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.902+0000 7f967aa00640 1 Processor -- start 2024-08-17T02:26:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.902+0000 7f967aa00640 1 -- start start 2024-08-17T02:26:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.903+0000 7f967aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9674158e60 0x7f96740add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.903+0000 7f967aa00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96740b0ac0 0x7f96740ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.903+0000 7f967aa00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96740ad8a0 con 0x7f96740ae860 2024-08-17T02:26:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.903+0000 7f967aa00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967406edf0 con 0x7f9674158e60 2024-08-17T02:26:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.903+0000 7f967aa00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96740acc90 con 0x7f96740b0ac0 2024-08-17T02:26:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.903+0000 7f9673e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9674158e60 0x7f96740add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.903+0000 7f9673e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9674158e60 0x7f96740add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35454/0 (socket says 172.21.15.5:35454) 2024-08-17T02:26:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.903+0000 7f9673e00640 1 -- 172.21.15.5:0/3995646330 learned_addr learned my addr 172.21.15.5:0/3995646330 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.904+0000 7f9678a00640 1 --2- 172.21.15.5:0/3995646330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96740b0ac0 0x7f96740ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.904+0000 7f9673e00640 1 -- 172.21.15.5:0/3995646330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96740b0ac0 msgr2=0x7f96740ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.904+0000 7f9673e00640 1 --2- 172.21.15.5:0/3995646330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96740b0ac0 0x7f96740ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.904+0000 7f9673e00640 1 -- 172.21.15.5:0/3995646330 >> v1:172.21.15.5:6789/0 conn(0x7f96740ae860 legacy=0x7f96740b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.904+0000 7f9673e00640 1 -- 172.21.15.5:0/3995646330 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96740acf70 con 0x7f9674158e60 2024-08-17T02:26:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.904+0000 7f9678a00640 1 --2- 172.21.15.5:0/3995646330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96740b0ac0 0x7f96740ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.905+0000 7f9673e00640 1 --2- 172.21.15.5:0/3995646330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9674158e60 0x7f96740add30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9664009910 tx=0x7f96640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f45bafe590a7b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.905+0000 7f9672a00640 1 -- 172.21.15.5:0/3995646330 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966402ae40 con 0x7f9674158e60 2024-08-17T02:26:47.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.905+0000 7f9672a00640 1 -- 172.21.15.5:0/3995646330 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9664032440 con 0x7f9674158e60 2024-08-17T02:26:47.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.905+0000 7f9672a00640 1 -- 172.21.15.5:0/3995646330 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9664032820 con 0x7f9674158e60 2024-08-17T02:26:47.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.906+0000 7f967aa00640 1 -- 172.21.15.5:0/3995646330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9674158e60 msgr2=0x7f96740add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.906+0000 7f967aa00640 1 --2- 172.21.15.5:0/3995646330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9674158e60 0x7f96740add30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9664009910 tx=0x7f96640091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.906+0000 7f967aa00640 1 -- 172.21.15.5:0/3995646330 shutdown_connections 2024-08-17T02:26:47.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.906+0000 7f967aa00640 1 --2- 172.21.15.5:0/3995646330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96740b0ac0 0x7f96740ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.906+0000 7f967aa00640 1 --2- 172.21.15.5:0/3995646330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9674158e60 0x7f96740add30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.906+0000 7f967aa00640 1 -- 172.21.15.5:0/3995646330 >> 172.21.15.5:0/3995646330 conn(0x7f96740cc390 msgr2=0x7f9674066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.906+0000 7f967aa00640 1 -- 172.21.15.5:0/3995646330 shutdown_connections 2024-08-17T02:26:47.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.906+0000 7f967aa00640 1 -- 172.21.15.5:0/3995646330 wait complete. 2024-08-17T02:26:47.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.907+0000 7f967aa00640 1 Processor -- start 2024-08-17T02:26:47.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.907+0000 7f967aa00640 1 -- start start 2024-08-17T02:26:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.908+0000 7f967aa00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96740ae860 0x7f96740c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.908+0000 7f967aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96740b0ac0 0x7f9674168cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.908+0000 7f967aa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9674158e60 0x7f96740c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.908+0000 7f967aa00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96740a8c50 con 0x7f96740b0ac0 2024-08-17T02:26:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.908+0000 7f967aa00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96741695c0 con 0x7f9674158e60 2024-08-17T02:26:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.908+0000 7f967aa00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96741698a0 con 0x7f96740ae860 2024-08-17T02:26:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.909+0000 7f9673400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96740b0ac0 0x7f9674168cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.909+0000 7f9673400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96740b0ac0 0x7f9674168cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35458/0 (socket says 172.21.15.5:35458) 2024-08-17T02:26:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.909+0000 7f9673400640 1 -- 172.21.15.5:0/1148110844 learned_addr learned my addr 172.21.15.5:0/1148110844 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.909+0000 7f9678a00640 1 --2- 172.21.15.5:0/1148110844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9674158e60 0x7f96740c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.909+0000 7f9673e00640 1 --2- 172.21.15.5:0/1148110844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96740ae860 0x7f96740c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.909+0000 7f9673400640 1 -- 172.21.15.5:0/1148110844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96740ae860 msgr2=0x7f96740c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.909+0000 7f9673400640 1 --2- 172.21.15.5:0/1148110844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96740ae860 0x7f96740c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.909+0000 7f9673400640 1 -- 172.21.15.5:0/1148110844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9674158e60 msgr2=0x7f96740c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.909+0000 7f9673400640 1 --2- 172.21.15.5:0/1148110844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9674158e60 0x7f96740c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.909+0000 7f9673400640 1 -- 172.21.15.5:0/1148110844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9664009450 con 0x7f96740b0ac0 2024-08-17T02:26:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.909+0000 7f9673400640 1 --2- 172.21.15.5:0/1148110844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96740b0ac0 0x7f9674168cb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f966000c560 tx=0x7f9660007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.910+0000 7f966b400640 1 -- 172.21.15.5:0/1148110844 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9660011590 con 0x7f96740b0ac0 2024-08-17T02:26:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.910+0000 7f966b400640 1 -- 172.21.15.5:0/1148110844 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9660011710 con 0x7f96740b0ac0 2024-08-17T02:26:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.910+0000 7f966b400640 1 -- 172.21.15.5:0/1148110844 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9660011ad0 con 0x7f96740b0ac0 2024-08-17T02:26:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.910+0000 7f967aa00640 1 -- 172.21.15.5:0/1148110844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9674169b80 con 0x7f96740b0ac0 2024-08-17T02:26:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.910+0000 7f967aa00640 1 -- 172.21.15.5:0/1148110844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96740c72e0 con 0x7f96740b0ac0 2024-08-17T02:26:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.911+0000 7f967aa00640 1 -- 172.21.15.5:0/1148110844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96740a8dc0 con 0x7f96740b0ac0 2024-08-17T02:26:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.911+0000 7f966b400640 1 -- 172.21.15.5:0/1148110844 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f966001b3b0 con 0x7f96740b0ac0 2024-08-17T02:26:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.912+0000 7f966b400640 1 --2- 172.21.15.5:0/1148110844 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9654065150 0x7f9654067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.912+0000 7f966b400640 1 -- 172.21.15.5:0/1148110844 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f9660081cc0 con 0x7f96740b0ac0 2024-08-17T02:26:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.913+0000 7f9673e00640 1 --2- 172.21.15.5:0/1148110844 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9654065150 0x7f9654067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.913+0000 7f9673e00640 1 --2- 172.21.15.5:0/1148110844 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9654065150 0x7f9654067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9664034000 tx=0x7f9664032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:47.916+0000 7f966b400640 1 -- 172.21.15.5:0/1148110844 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f966004fab0 con 0x7f96740b0ac0 2024-08-17T02:26:48.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.099+0000 7f967aa00640 1 -- 172.21.15.5:0/1148110844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9674063f90 con 0x7f96740b0ac0 2024-08-17T02:26:48.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.099+0000 7f966b400640 1 -- 172.21.15.5:0/1148110844 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9660017070 con 0x7f96740b0ac0 2024-08-17T02:26:48.101 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:26:48.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.101+0000 7f967aa00640 1 -- 172.21.15.5:0/1148110844 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9654065150 msgr2=0x7f9654067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.101+0000 7f967aa00640 1 --2- 172.21.15.5:0/1148110844 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9654065150 0x7f9654067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9664034000 tx=0x7f9664032000 comp rx=0 tx=0).stop 2024-08-17T02:26:48.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.101+0000 7f967aa00640 1 -- 172.21.15.5:0/1148110844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96740b0ac0 msgr2=0x7f9674168cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.101+0000 7f967aa00640 1 --2- 172.21.15.5:0/1148110844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96740b0ac0 0x7f9674168cb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f966000c560 tx=0x7f9660007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.102+0000 7f967aa00640 1 -- 172.21.15.5:0/1148110844 shutdown_connections 2024-08-17T02:26:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.102+0000 7f967aa00640 1 --2- 172.21.15.5:0/1148110844 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9654065150 0x7f9654067600 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.102+0000 7f967aa00640 1 --2- 172.21.15.5:0/1148110844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9674158e60 0x7f96740c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.102+0000 7f967aa00640 1 --2- 172.21.15.5:0/1148110844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96740b0ac0 0x7f9674168cb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.102+0000 7f967aa00640 1 --2- 172.21.15.5:0/1148110844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96740ae860 0x7f96740c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.102+0000 7f967aa00640 1 -- 172.21.15.5:0/1148110844 >> 172.21.15.5:0/1148110844 conn(0x7f96740cc390 msgr2=0x7f96741584c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.102+0000 7f967aa00640 1 -- 172.21.15.5:0/1148110844 shutdown_connections 2024-08-17T02:26:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.102+0000 7f967aa00640 1 -- 172.21.15.5:0/1148110844 wait complete. 2024-08-17T02:26:48.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:48.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.275+0000 7fcd0d200640 1 Processor -- start 2024-08-17T02:26:48.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.275+0000 7fcd0d200640 1 -- start start 2024-08-17T02:26:48.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.276+0000 7fcd0d200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcd080ae860 0x7fcd0806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.276+0000 7fcd0d200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcd08158df0 0x7fcd0806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.276+0000 7fcd0d200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd080aed90 con 0x7fcd08158a20 2024-08-17T02:26:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.277+0000 7fcd0d200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd080af070 con 0x7fcd080ae860 2024-08-17T02:26:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.277+0000 7fcd0d200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd080af350 con 0x7fcd08158df0 2024-08-17T02:26:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.277+0000 7fcd05e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcd08158a20 0x7fcd080a89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35580/0 (socket says 172.21.15.5:35580) 2024-08-17T02:26:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.277+0000 7fcd05e00640 1 -- 172.21.15.5:0/3886913470 learned_addr learned my addr 172.21.15.5:0/3886913470 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:26:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.277+0000 7fccffe00640 1 --2- 172.21.15.5:0/3886913470 >> v2:172.21.15.5:3300/0 conn(0x7fcd080ae860 0x7fcd0806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.277+0000 7fcd06800640 1 --2- 172.21.15.5:0/3886913470 >> v2:172.21.15.87:3300/0 conn(0x7fcd08158df0 0x7fcd0806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.277+0000 7fccffe00640 1 -- 172.21.15.5:0/3886913470 >> v2:172.21.15.87:3300/0 conn(0x7fcd08158df0 msgr2=0x7fcd0806dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.277+0000 7fccffe00640 1 --2- 172.21.15.5:0/3886913470 >> v2:172.21.15.87:3300/0 conn(0x7fcd08158df0 0x7fcd0806dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.277+0000 7fccffe00640 1 -- 172.21.15.5:0/3886913470 >> v1:172.21.15.5:6789/0 conn(0x7fcd08158a20 legacy=0x7fcd080a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.277+0000 7fccffe00640 1 -- 172.21.15.5:0/3886913470 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd080af630 con 0x7fcd080ae860 2024-08-17T02:26:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.278+0000 7fccffe00640 1 --2- 172.21.15.5:0/3886913470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd080ae860 0x7fcd0806d7d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcd0806eba0 tx=0x7fccf00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69809f52d0b6f9cf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.278+0000 7fcd05400640 1 -- 172.21.15.5:0/3886913470 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf002adb0 con 0x7fcd080ae860 2024-08-17T02:26:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.279+0000 7fcd05400640 1 -- 172.21.15.5:0/3886913470 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf0032440 con 0x7fcd080ae860 2024-08-17T02:26:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.279+0000 7fcd05400640 1 -- 172.21.15.5:0/3886913470 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf0032820 con 0x7fcd080ae860 2024-08-17T02:26:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.279+0000 7fcd0d200640 1 -- 172.21.15.5:0/3886913470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd080ae860 msgr2=0x7fcd0806d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.279+0000 7fcd0d200640 1 --2- 172.21.15.5:0/3886913470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd080ae860 0x7fcd0806d7d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcd0806eba0 tx=0x7fccf00090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.279+0000 7fcd0d200640 1 -- 172.21.15.5:0/3886913470 shutdown_connections 2024-08-17T02:26:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.279+0000 7fcd0d200640 1 --2- 172.21.15.5:0/3886913470 >> v2:172.21.15.87:3300/0 conn(0x7fcd08158df0 0x7fcd0806dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.279+0000 7fcd0d200640 1 --2- 172.21.15.5:0/3886913470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd080ae860 0x7fcd0806d7d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.279+0000 7fcd0d200640 1 -- 172.21.15.5:0/3886913470 >> 172.21.15.5:0/3886913470 conn(0x7fcd08066e60 msgr2=0x7fcd08067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.279+0000 7fcd0d200640 1 -- 172.21.15.5:0/3886913470 shutdown_connections 2024-08-17T02:26:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.279+0000 7fcd0d200640 1 -- 172.21.15.5:0/3886913470 wait complete. 2024-08-17T02:26:48.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.281+0000 7fcd0d200640 1 Processor -- start 2024-08-17T02:26:48.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.281+0000 7fcd0d200640 1 -- start start 2024-08-17T02:26:48.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.282+0000 7fcd0d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd080ae860 0x7fcd080c1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.282+0000 7fcd0d200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd08158a20 0x7fcd08146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.282+0000 7fcd0d200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd08158df0 0x7fcd0806ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.282+0000 7fcd0d200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0815c200 con 0x7fcd080ae860 2024-08-17T02:26:48.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.282+0000 7fcd0d200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080c0880 con 0x7fcd08158a20 2024-08-17T02:26:48.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.282+0000 7fcd0d200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080c0b60 con 0x7fcd08158df0 2024-08-17T02:26:48.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.282+0000 7fcd05e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd080ae860 0x7fcd080c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.282+0000 7fcd05e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd080ae860 0x7fcd080c1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35474/0 (socket says 172.21.15.5:35474) 2024-08-17T02:26:48.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.282+0000 7fcd05e00640 1 -- 172.21.15.5:0/3910875533 learned_addr learned my addr 172.21.15.5:0/3910875533 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:48.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.282+0000 7fcd06800640 1 --2- 172.21.15.5:0/3910875533 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd08158df0 0x7fcd0806ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.282+0000 7fccffe00640 1 --2- 172.21.15.5:0/3910875533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd08158a20 0x7fcd08146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.282+0000 7fcd05e00640 1 -- 172.21.15.5:0/3910875533 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd08158df0 msgr2=0x7fcd0806ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.282+0000 7fcd05e00640 1 --2- 172.21.15.5:0/3910875533 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd08158df0 0x7fcd0806ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.282+0000 7fcd05e00640 1 -- 172.21.15.5:0/3910875533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd08158a20 msgr2=0x7fcd08146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.282+0000 7fcd05e00640 1 --2- 172.21.15.5:0/3910875533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd08158a20 0x7fcd08146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.282+0000 7fcd05e00640 1 -- 172.21.15.5:0/3910875533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf0009390 con 0x7fcd080ae860 2024-08-17T02:26:48.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.282+0000 7fccffe00640 1 --2- 172.21.15.5:0/3910875533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd08158a20 0x7fcd08146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:48.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.283+0000 7fcd05e00640 1 --2- 172.21.15.5:0/3910875533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd080ae860 0x7fcd080c1640 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fccf800c590 tx=0x7fccf8007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.283+0000 7fccfd600640 1 -- 172.21.15.5:0/3910875533 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8005aa0 con 0x7fcd080ae860 2024-08-17T02:26:48.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.283+0000 7fccfd600640 1 -- 172.21.15.5:0/3910875533 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf8005c20 con 0x7fcd080ae860 2024-08-17T02:26:48.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.283+0000 7fccfd600640 1 -- 172.21.15.5:0/3910875533 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf80070f0 con 0x7fcd080ae860 2024-08-17T02:26:48.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.283+0000 7fcd0d200640 1 -- 172.21.15.5:0/3910875533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd080c0e40 con 0x7fcd080ae860 2024-08-17T02:26:48.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.283+0000 7fcd0d200640 1 -- 172.21.15.5:0/3910875533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd08146860 con 0x7fcd080ae860 2024-08-17T02:26:48.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.284+0000 7fcd0d200640 1 -- 172.21.15.5:0/3910875533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd08063fb0 con 0x7fcd080ae860 2024-08-17T02:26:48.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.285+0000 7fccfd600640 1 -- 172.21.15.5:0/3910875533 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fccf8007540 con 0x7fcd080ae860 2024-08-17T02:26:48.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.286+0000 7fccfd600640 1 --2- 172.21.15.5:0/3910875533 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcce4065150 0x7fcce4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.286+0000 7fccfd600640 1 -- 172.21.15.5:0/3910875533 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fccf8081910 con 0x7fcd080ae860 2024-08-17T02:26:48.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.286+0000 7fccffe00640 1 --2- 172.21.15.5:0/3910875533 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcce4065150 0x7fcce4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.287+0000 7fccffe00640 1 --2- 172.21.15.5:0/3910875533 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcce4065150 0x7fcce4067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fccf0034000 tx=0x7fccf0032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.289+0000 7fccfd600640 1 -- 172.21.15.5:0/3910875533 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fccf804f630 con 0x7fcd080ae860 2024-08-17T02:26:48.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.474+0000 7fcd0d200640 1 -- 172.21.15.5:0/3910875533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd0815c440 con 0x7fcd080ae860 2024-08-17T02:26:48.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.475+0000 7fccfd600640 1 -- 172.21.15.5:0/3910875533 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7fccf8052c50 con 0x7fcd080ae860 2024-08-17T02:26:48.477 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:26:48.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.477+0000 7fcd0d200640 1 -- 172.21.15.5:0/3910875533 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcce4065150 msgr2=0x7fcce4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.477+0000 7fcd0d200640 1 --2- 172.21.15.5:0/3910875533 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcce4065150 0x7fcce4067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fccf0034000 tx=0x7fccf0032000 comp rx=0 tx=0).stop 2024-08-17T02:26:48.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.477+0000 7fcd0d200640 1 -- 172.21.15.5:0/3910875533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd080ae860 msgr2=0x7fcd080c1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.477+0000 7fcd0d200640 1 --2- 172.21.15.5:0/3910875533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd080ae860 0x7fcd080c1640 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fccf800c590 tx=0x7fccf8007ee0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.477+0000 7fcd0d200640 1 -- 172.21.15.5:0/3910875533 shutdown_connections 2024-08-17T02:26:48.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.477+0000 7fcd0d200640 1 --2- 172.21.15.5:0/3910875533 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fcce4065150 0x7fcce4067600 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.477+0000 7fcd0d200640 1 --2- 172.21.15.5:0/3910875533 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd08158df0 0x7fcd0806ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.477+0000 7fcd0d200640 1 --2- 172.21.15.5:0/3910875533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd08158a20 0x7fcd08146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.477+0000 7fcd0d200640 1 --2- 172.21.15.5:0/3910875533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd080ae860 0x7fcd080c1640 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.478+0000 7fcd0d200640 1 -- 172.21.15.5:0/3910875533 >> 172.21.15.5:0/3910875533 conn(0x7fcd08066e60 msgr2=0x7fcd080a88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.478+0000 7fcd0d200640 1 -- 172.21.15.5:0/3910875533 shutdown_connections 2024-08-17T02:26:48.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.478+0000 7fcd0d200640 1 -- 172.21.15.5:0/3910875533 wait complete. 2024-08-17T02:26:48.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:48.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.647+0000 7f3923200640 1 Processor -- start 2024-08-17T02:26:48.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.647+0000 7f3923200640 1 -- start start 2024-08-17T02:26:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.649+0000 7f3923200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3924158b80 0x7f392406c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.649+0000 7f3923200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3924158f50 0x7f392406b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.649+0000 7f3923200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392406b6e0 con 0x7f39240ae930 2024-08-17T02:26:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.649+0000 7f3923200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39240b00c0 con 0x7f3924158f50 2024-08-17T02:26:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.649+0000 7f3923200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39240af7d0 con 0x7f3924158b80 2024-08-17T02:26:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.649+0000 7f3922800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f39240ae930 0x7f3924066e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35596/0 (socket says 172.21.15.5:35596) 2024-08-17T02:26:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.649+0000 7f3922800640 1 -- 172.21.15.5:0/778583590 learned_addr learned my addr 172.21.15.5:0/778583590 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:26:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.649+0000 7f3921e00640 1 --2- 172.21.15.5:0/778583590 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3924158b80 0x7f392406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.649+0000 7f391be00640 1 --2- 172.21.15.5:0/778583590 >> v2:172.21.15.87:3300/0 conn(0x7f3924158f50 0x7f392406b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.649+0000 7f3921400640 1 -- 172.21.15.5:0/778583590 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593368136 0 0) 0x7f392406b6e0 con 0x7f39240ae930 2024-08-17T02:26:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.650+0000 7f3921400640 1 -- 172.21.15.5:0/778583590 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39080034e0 con 0x7f39240ae930 2024-08-17T02:26:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.650+0000 7f3921e00640 1 -- 172.21.15.5:0/778583590 >> v2:172.21.15.87:3300/0 conn(0x7f3924158f50 msgr2=0x7f392406b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.650+0000 7f3921e00640 1 --2- 172.21.15.5:0/778583590 >> v2:172.21.15.87:3300/0 conn(0x7f3924158f50 0x7f392406b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.650+0000 7f3921e00640 1 -- 172.21.15.5:0/778583590 >> v1:172.21.15.5:6789/0 conn(0x7f39240ae930 legacy=0x7f3924066e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.650+0000 7f3921e00640 1 -- 172.21.15.5:0/778583590 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39240afa70 con 0x7f3924158b80 2024-08-17T02:26:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.651+0000 7f3921e00640 1 --2- 172.21.15.5:0/778583590 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3924158b80 0x7f392406c400 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3914009850 tx=0x7f39140090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7cc6b88dc214c63 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.651+0000 7f3921400640 1 -- 172.21.15.5:0/778583590 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391402ad00 con 0x7f3924158b80 2024-08-17T02:26:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.651+0000 7f3921400640 1 -- 172.21.15.5:0/778583590 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391402ae60 con 0x7f3924158b80 2024-08-17T02:26:48.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.651+0000 7f3921400640 1 -- 172.21.15.5:0/778583590 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914032650 con 0x7f3924158b80 2024-08-17T02:26:48.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.652+0000 7f3923200640 1 -- 172.21.15.5:0/778583590 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3924158b80 msgr2=0x7f392406c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.652+0000 7f3923200640 1 --2- 172.21.15.5:0/778583590 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3924158b80 0x7f392406c400 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3914009850 tx=0x7f39140090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.652+0000 7f3923200640 1 -- 172.21.15.5:0/778583590 shutdown_connections 2024-08-17T02:26:48.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.652+0000 7f3923200640 1 --2- 172.21.15.5:0/778583590 >> v2:172.21.15.87:3300/0 conn(0x7f3924158f50 0x7f392406b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.652+0000 7f3923200640 1 --2- 172.21.15.5:0/778583590 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3924158b80 0x7f392406c400 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.652+0000 7f3923200640 1 -- 172.21.15.5:0/778583590 >> 172.21.15.5:0/778583590 conn(0x7f3924095a70 msgr2=0x7f3924095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.652+0000 7f3923200640 1 -- 172.21.15.5:0/778583590 shutdown_connections 2024-08-17T02:26:48.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.652+0000 7f3923200640 1 -- 172.21.15.5:0/778583590 wait complete. 2024-08-17T02:26:48.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.653+0000 7f3923200640 1 Processor -- start 2024-08-17T02:26:48.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.653+0000 7f3923200640 1 -- start start 2024-08-17T02:26:48.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.654+0000 7f3923200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39240ae930 0x7f39240ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.654+0000 7f3923200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3924158b80 0x7f3924157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.654+0000 7f3923200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3924158f50 0x7f3924158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.654+0000 7f3923200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392415e3c0 con 0x7f39240ae930 2024-08-17T02:26:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.654+0000 7f3923200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392415f360 con 0x7f3924158f50 2024-08-17T02:26:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.654+0000 7f3923200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39240aba00 con 0x7f3924158b80 2024-08-17T02:26:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.654+0000 7f3921e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39240ae930 0x7f39240ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.655+0000 7f3921e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39240ae930 0x7f39240ab4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35486/0 (socket says 172.21.15.5:35486) 2024-08-17T02:26:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.655+0000 7f3921e00640 1 -- 172.21.15.5:0/3387156708 learned_addr learned my addr 172.21.15.5:0/3387156708 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.655+0000 7f3922800640 1 --2- 172.21.15.5:0/3387156708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3924158f50 0x7f3924158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.655+0000 7f391be00640 1 --2- 172.21.15.5:0/3387156708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3924158b80 0x7f3924157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.655+0000 7f3921e00640 1 -- 172.21.15.5:0/3387156708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3924158b80 msgr2=0x7f3924157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.655+0000 7f3921e00640 1 --2- 172.21.15.5:0/3387156708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3924158b80 0x7f3924157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.655+0000 7f3921e00640 1 -- 172.21.15.5:0/3387156708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3924158f50 msgr2=0x7f3924158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.655+0000 7f3921e00640 1 --2- 172.21.15.5:0/3387156708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3924158f50 0x7f3924158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.655+0000 7f3921e00640 1 -- 172.21.15.5:0/3387156708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3914009390 con 0x7f39240ae930 2024-08-17T02:26:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.655+0000 7f3921e00640 1 --2- 172.21.15.5:0/3387156708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39240ae930 0x7f39240ab4c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f39140098b0 tx=0x7f3914032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.656+0000 7f3919600640 1 -- 172.21.15.5:0/3387156708 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391403e660 con 0x7f39240ae930 2024-08-17T02:26:48.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.656+0000 7f3919600640 1 -- 172.21.15.5:0/3387156708 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391403e7e0 con 0x7f39240ae930 2024-08-17T02:26:48.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.656+0000 7f3919600640 1 -- 172.21.15.5:0/3387156708 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391403eba0 con 0x7f39240ae930 2024-08-17T02:26:48.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.656+0000 7f3923200640 1 -- 172.21.15.5:0/3387156708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392415eed0 con 0x7f39240ae930 2024-08-17T02:26:48.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.656+0000 7f3923200640 1 -- 172.21.15.5:0/3387156708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392415e5a0 con 0x7f39240ae930 2024-08-17T02:26:48.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.657+0000 7f3923200640 1 -- 172.21.15.5:0/3387156708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3924070720 con 0x7f39240ae930 2024-08-17T02:26:48.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.658+0000 7f3919600640 1 -- 172.21.15.5:0/3387156708 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3914031420 con 0x7f39240ae930 2024-08-17T02:26:48.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.658+0000 7f3919600640 1 --2- 172.21.15.5:0/3387156708 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3900065150 0x7f3900067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.658+0000 7f3919600640 1 -- 172.21.15.5:0/3387156708 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f39140a2a40 con 0x7f39240ae930 2024-08-17T02:26:48.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.659+0000 7f391be00640 1 --2- 172.21.15.5:0/3387156708 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3900065150 0x7f3900067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.659+0000 7f391be00640 1 --2- 172.21.15.5:0/3387156708 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3900065150 0x7f3900067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f39240ca280 tx=0x7f390c0090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.662+0000 7f3919600640 1 -- 172.21.15.5:0/3387156708 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3914070850 con 0x7f39240ae930 2024-08-17T02:26:48.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.847+0000 7f3923200640 1 -- 172.21.15.5:0/3387156708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f392415bb90 con 0x7f39240ae930 2024-08-17T02:26:48.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.848+0000 7f3919600640 1 -- 172.21.15.5:0/3387156708 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3914073e70 con 0x7f39240ae930 2024-08-17T02:26:48.850 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-17T02:26:48.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.850+0000 7f3923200640 1 -- 172.21.15.5:0/3387156708 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3900065150 msgr2=0x7f3900067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.850+0000 7f3923200640 1 --2- 172.21.15.5:0/3387156708 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3900065150 0x7f3900067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f39240ca280 tx=0x7f390c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.850+0000 7f3923200640 1 -- 172.21.15.5:0/3387156708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39240ae930 msgr2=0x7f39240ab4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.850+0000 7f3923200640 1 --2- 172.21.15.5:0/3387156708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39240ae930 0x7f39240ab4c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f39140098b0 tx=0x7f3914032000 comp rx=0 tx=0).stop 2024-08-17T02:26:48.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.850+0000 7f3923200640 1 -- 172.21.15.5:0/3387156708 shutdown_connections 2024-08-17T02:26:48.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.850+0000 7f3923200640 1 --2- 172.21.15.5:0/3387156708 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3900065150 0x7f3900067600 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.850+0000 7f3923200640 1 --2- 172.21.15.5:0/3387156708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3924158b80 0x7f3924157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.850+0000 7f3923200640 1 --2- 172.21.15.5:0/3387156708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3924158f50 0x7f3924158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.850+0000 7f3923200640 1 --2- 172.21.15.5:0/3387156708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39240ae930 0x7f39240ab4c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.850+0000 7f3923200640 1 -- 172.21.15.5:0/3387156708 >> 172.21.15.5:0/3387156708 conn(0x7f3924095a70 msgr2=0x7f39240cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.850+0000 7f3923200640 1 -- 172.21.15.5:0/3387156708 shutdown_connections 2024-08-17T02:26:48.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:48.850+0000 7f3923200640 1 -- 172.21.15.5:0/3387156708 wait complete. 2024-08-17T02:26:48.866 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001044363.meta pg_num 2024-08-17T02:26:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.019+0000 7f6289e00640 1 Processor -- start 2024-08-17T02:26:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.019+0000 7f6289e00640 1 -- start start 2024-08-17T02:26:49.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.020+0000 7f6289e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6284158a00 0x7f6284158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.020+0000 7f6289e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62840cb190 0x7f62840cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.020+0000 7f6289e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f628406e590 0x7f628406e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.020+0000 7f6289e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628406ef10 con 0x7f6284158a00 2024-08-17T02:26:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.020+0000 7f6289e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62840cbc50 con 0x7f628406e590 2024-08-17T02:26:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.020+0000 7f6289e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62840cbf30 con 0x7f62840cb190 2024-08-17T02:26:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.020+0000 7f6288a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6284158a00 0x7f6284158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.020+0000 7f6288a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6284158a00 0x7f6284158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35494/0 (socket says 172.21.15.5:35494) 2024-08-17T02:26:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.020+0000 7f6288a00640 1 -- 172.21.15.5:0/1121138610 learned_addr learned my addr 172.21.15.5:0/1121138610 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.020+0000 7f6289400640 1 --2- 172.21.15.5:0/1121138610 >> v2:172.21.15.87:3300/0 conn(0x7f628406e590 0x7f628406e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.021+0000 7f6283e00640 1 --2- 172.21.15.5:0/1121138610 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62840cb190 0x7f62840cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.021+0000 7f6288a00640 1 -- 172.21.15.5:0/1121138610 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62840cb190 msgr2=0x7f62840cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.021+0000 7f6288a00640 1 --2- 172.21.15.5:0/1121138610 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62840cb190 0x7f62840cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.021+0000 7f6288a00640 1 -- 172.21.15.5:0/1121138610 >> v2:172.21.15.87:3300/0 conn(0x7f628406e590 msgr2=0x7f628406e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:49.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.021+0000 7f6288a00640 1 --2- 172.21.15.5:0/1121138610 >> v2:172.21.15.87:3300/0 conn(0x7f628406e590 0x7f628406e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.021+0000 7f6288a00640 1 -- 172.21.15.5:0/1121138610 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62840cc210 con 0x7f6284158a00 2024-08-17T02:26:49.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.021+0000 7f6283e00640 1 --2- 172.21.15.5:0/1121138610 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62840cb190 0x7f62840cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:49.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.022+0000 7f6288a00640 1 --2- 172.21.15.5:0/1121138610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6284158a00 0x7f6284158dd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f62840d0bd0 tx=0x7f62780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b945aa03b425fc64 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.022+0000 7f6283400640 1 -- 172.21.15.5:0/1121138610 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627802add0 con 0x7f6284158a00 2024-08-17T02:26:49.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.022+0000 7f6283400640 1 -- 172.21.15.5:0/1121138610 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6278032440 con 0x7f6284158a00 2024-08-17T02:26:49.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.022+0000 7f6283400640 1 -- 172.21.15.5:0/1121138610 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278032820 con 0x7f6284158a00 2024-08-17T02:26:49.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.022+0000 7f6289e00640 1 -- 172.21.15.5:0/1121138610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6284158a00 msgr2=0x7f6284158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.022+0000 7f6289e00640 1 --2- 172.21.15.5:0/1121138610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6284158a00 0x7f6284158dd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f62840d0bd0 tx=0x7f62780091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.023+0000 7f6289e00640 1 -- 172.21.15.5:0/1121138610 shutdown_connections 2024-08-17T02:26:49.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.023+0000 7f6289e00640 1 --2- 172.21.15.5:0/1121138610 >> v2:172.21.15.87:3300/0 conn(0x7f628406e590 0x7f628406e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.023+0000 7f6289e00640 1 --2- 172.21.15.5:0/1121138610 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62840cb190 0x7f62840cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.023+0000 7f6289e00640 1 --2- 172.21.15.5:0/1121138610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6284158a00 0x7f6284158dd0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.023+0000 7f6289e00640 1 -- 172.21.15.5:0/1121138610 >> 172.21.15.5:0/1121138610 conn(0x7f62840cfb80 msgr2=0x7f62840cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.023+0000 7f6289e00640 1 -- 172.21.15.5:0/1121138610 shutdown_connections 2024-08-17T02:26:49.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.023+0000 7f6289e00640 1 -- 172.21.15.5:0/1121138610 wait complete. 2024-08-17T02:26:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.024+0000 7f6289e00640 1 Processor -- start 2024-08-17T02:26:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.024+0000 7f6289e00640 1 -- start start 2024-08-17T02:26:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.025+0000 7f6289e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f628406e590 0x7f628416b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.025+0000 7f6289e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62840cb190 0x7f62840c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.025+0000 7f6289e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6284158a00 0x7f62840a64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.025+0000 7f6289e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628416a0f0 con 0x7f628406e590 2024-08-17T02:26:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.025+0000 7f6289e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628415da30 con 0x7f6284158a00 2024-08-17T02:26:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.025+0000 7f6289e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62841697e0 con 0x7f62840cb190 2024-08-17T02:26:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.025+0000 7f6288a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f628406e590 0x7f628416b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.025+0000 7f6288a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f628406e590 0x7f628416b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35500/0 (socket says 172.21.15.5:35500) 2024-08-17T02:26:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.025+0000 7f6288a00640 1 -- 172.21.15.5:0/168123239 learned_addr learned my addr 172.21.15.5:0/168123239 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.026+0000 7f6283e00640 1 --2- 172.21.15.5:0/168123239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62840cb190 0x7f62840c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.026+0000 7f6288a00640 1 -- 172.21.15.5:0/168123239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62840cb190 msgr2=0x7f62840c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.026+0000 7f6288a00640 1 --2- 172.21.15.5:0/168123239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62840cb190 0x7f62840c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.026+0000 7f6289400640 1 --2- 172.21.15.5:0/168123239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6284158a00 0x7f62840a64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.026+0000 7f6288a00640 1 -- 172.21.15.5:0/168123239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6284158a00 msgr2=0x7f62840a64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.026+0000 7f6288a00640 1 --2- 172.21.15.5:0/168123239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6284158a00 0x7f62840a64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.026+0000 7f6288a00640 1 -- 172.21.15.5:0/168123239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6278009450 con 0x7f628406e590 2024-08-17T02:26:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.026+0000 7f6289400640 1 --2- 172.21.15.5:0/168123239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6284158a00 0x7f62840a64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.026+0000 7f6288a00640 1 --2- 172.21.15.5:0/168123239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f628406e590 0x7f628416b9c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6278009210 tx=0x7f6278032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.026+0000 7f6277e00640 1 -- 172.21.15.5:0/168123239 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278000d10 con 0x7f628406e590 2024-08-17T02:26:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.026+0000 7f6277e00640 1 -- 172.21.15.5:0/168123239 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6278031de0 con 0x7f628406e590 2024-08-17T02:26:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.026+0000 7f6289e00640 1 -- 172.21.15.5:0/168123239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6284169ac0 con 0x7f628406e590 2024-08-17T02:26:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.027+0000 7f6277e00640 1 -- 172.21.15.5:0/168123239 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627803d650 con 0x7f628406e590 2024-08-17T02:26:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.027+0000 7f6289e00640 1 -- 172.21.15.5:0/168123239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6284169da0 con 0x7f628406e590 2024-08-17T02:26:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.028+0000 7f6289e00640 1 -- 172.21.15.5:0/168123239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6284070720 con 0x7f628406e590 2024-08-17T02:26:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.028+0000 7f6277e00640 1 -- 172.21.15.5:0/168123239 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6278039040 con 0x7f628406e590 2024-08-17T02:26:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.030+0000 7f6277e00640 1 --2- 172.21.15.5:0/168123239 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6264065150 0x7f6264067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.030+0000 7f6277e00640 1 -- 172.21.15.5:0/168123239 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f62780a2b10 con 0x7f628406e590 2024-08-17T02:26:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.030+0000 7f6283e00640 1 --2- 172.21.15.5:0/168123239 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6264065150 0x7f6264067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.030+0000 7f6283e00640 1 --2- 172.21.15.5:0/168123239 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6264065150 0x7f6264067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6284157f20 tx=0x7f6270008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.034+0000 7f6277e00640 1 -- 172.21.15.5:0/168123239 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f62780707b0 con 0x7f628406e590 2024-08-17T02:26:49.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.214+0000 7f6289e00640 1 -- 172.21.15.5:0/168123239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001044363.meta", "var": "pg_num"} v 0) v1 -- 0x7f62840ca330 con 0x7f628406e590 2024-08-17T02:26:49.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.215+0000 7f6277e00640 1 -- 172.21.15.5:0/168123239 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001044363.meta", "var": "pg_num"}]=0 v39) v1 ==== 124+0+11 (secure 0 0 0) 0x7f62780370c0 con 0x7f628406e590 2024-08-17T02:26:49.216 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:26:49.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.216+0000 7f6289e00640 1 -- 172.21.15.5:0/168123239 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6264065150 msgr2=0x7f6264067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.216+0000 7f6289e00640 1 --2- 172.21.15.5:0/168123239 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6264065150 0x7f6264067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6284157f20 tx=0x7f6270008040 comp rx=0 tx=0).stop 2024-08-17T02:26:49.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.216+0000 7f6289e00640 1 -- 172.21.15.5:0/168123239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f628406e590 msgr2=0x7f628416b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.216+0000 7f6289e00640 1 --2- 172.21.15.5:0/168123239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f628406e590 0x7f628416b9c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6278009210 tx=0x7f6278032000 comp rx=0 tx=0).stop 2024-08-17T02:26:49.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.217+0000 7f6289e00640 1 -- 172.21.15.5:0/168123239 shutdown_connections 2024-08-17T02:26:49.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.217+0000 7f6289e00640 1 --2- 172.21.15.5:0/168123239 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6264065150 0x7f6264067600 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.217+0000 7f6289e00640 1 --2- 172.21.15.5:0/168123239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62840cb190 0x7f62840c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.217+0000 7f6289e00640 1 --2- 172.21.15.5:0/168123239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6284158a00 0x7f62840a64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.217+0000 7f6289e00640 1 --2- 172.21.15.5:0/168123239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f628406e590 0x7f628416b9c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.217+0000 7f6289e00640 1 -- 172.21.15.5:0/168123239 >> 172.21.15.5:0/168123239 conn(0x7f62840cfb80 msgr2=0x7f6284158080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.217+0000 7f6289e00640 1 -- 172.21.15.5:0/168123239 shutdown_connections 2024-08-17T02:26:49.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.217+0000 7f6289e00640 1 -- 172.21.15.5:0/168123239 wait complete. 2024-08-17T02:26:49.232 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001044363.data pg_num 2024-08-17T02:26:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.386+0000 7f9b52800640 1 Processor -- start 2024-08-17T02:26:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.386+0000 7f9b52800640 1 -- start start 2024-08-17T02:26:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.387+0000 7f9b52800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9b4c158b90 0x7f9b4c0b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.387+0000 7f9b52800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9b4c0b2370 0x7f9b4c0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.387+0000 7f9b52800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4c0afd20 con 0x7f9b4c0aef60 2024-08-17T02:26:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.387+0000 7f9b52800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c0af330 con 0x7f9b4c158b90 2024-08-17T02:26:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.387+0000 7f9b52800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c0affe0 con 0x7f9b4c0b2370 2024-08-17T02:26:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.387+0000 7f9b4b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9b4c158b90 0x7f9b4c0b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.387+0000 7f9b4b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9b4c158b90 0x7f9b4c0b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35502/0 (socket says 172.21.15.5:35502) 2024-08-17T02:26:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.387+0000 7f9b4b400640 1 -- 172.21.15.5:0/3299235622 learned_addr learned my addr 172.21.15.5:0/3299235622 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.388+0000 7f9b4aa00640 1 --2- 172.21.15.5:0/3299235622 >> v2:172.21.15.87:3300/0 conn(0x7f9b4c0b2370 0x7f9b4c0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.388+0000 7f9b4b400640 1 -- 172.21.15.5:0/3299235622 >> v2:172.21.15.87:3300/0 conn(0x7f9b4c0b2370 msgr2=0x7f9b4c0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.388+0000 7f9b4b400640 1 --2- 172.21.15.5:0/3299235622 >> v2:172.21.15.87:3300/0 conn(0x7f9b4c0b2370 0x7f9b4c0aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.388+0000 7f9b4b400640 1 -- 172.21.15.5:0/3299235622 >> v1:172.21.15.87:6789/0 conn(0x7f9b4c0aef60 legacy=0x7f9b4c068630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.388+0000 7f9b4b400640 1 -- 172.21.15.5:0/3299235622 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c0b02c0 con 0x7f9b4c158b90 2024-08-17T02:26:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.389+0000 7f9b4b400640 1 --2- 172.21.15.5:0/3299235622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b4c158b90 0x7f9b4c0b1e30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0b56c0 tx=0x7f9b3c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f6305a5deb95e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.389+0000 7f9b4a000640 1 -- 172.21.15.5:0/3299235622 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c02ae80 con 0x7f9b4c158b90 2024-08-17T02:26:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.389+0000 7f9b4a000640 1 -- 172.21.15.5:0/3299235622 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c032440 con 0x7f9b4c158b90 2024-08-17T02:26:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.389+0000 7f9b4a000640 1 -- 172.21.15.5:0/3299235622 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c032800 con 0x7f9b4c158b90 2024-08-17T02:26:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.390+0000 7f9b52800640 1 -- 172.21.15.5:0/3299235622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b4c158b90 msgr2=0x7f9b4c0b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.390+0000 7f9b52800640 1 --2- 172.21.15.5:0/3299235622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b4c158b90 0x7f9b4c0b1e30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0b56c0 tx=0x7f9b3c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.390+0000 7f9b52800640 1 -- 172.21.15.5:0/3299235622 shutdown_connections 2024-08-17T02:26:49.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.390+0000 7f9b52800640 1 --2- 172.21.15.5:0/3299235622 >> v2:172.21.15.87:3300/0 conn(0x7f9b4c0b2370 0x7f9b4c0aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.390+0000 7f9b52800640 1 --2- 172.21.15.5:0/3299235622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b4c158b90 0x7f9b4c0b1e30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.390+0000 7f9b52800640 1 -- 172.21.15.5:0/3299235622 >> 172.21.15.5:0/3299235622 conn(0x7f9b4c06e590 msgr2=0x7f9b4c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.390+0000 7f9b52800640 1 -- 172.21.15.5:0/3299235622 shutdown_connections 2024-08-17T02:26:49.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.390+0000 7f9b52800640 1 -- 172.21.15.5:0/3299235622 wait complete. 2024-08-17T02:26:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.391+0000 7f9b52800640 1 Processor -- start 2024-08-17T02:26:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.391+0000 7f9b52800640 1 -- start start 2024-08-17T02:26:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.392+0000 7f9b52800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b4c0aef60 0x7f9b4c15e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.392+0000 7f9b52800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b4c0b2370 0x7f9b4c1581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.392+0000 7f9b52800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b4c158b90 0x7f9b4c0c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.392+0000 7f9b52800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c168d60 con 0x7f9b4c0aef60 2024-08-17T02:26:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.392+0000 7f9b52800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c0c7070 con 0x7f9b4c0b2370 2024-08-17T02:26:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.392+0000 7f9b52800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c0c6d20 con 0x7f9b4c158b90 2024-08-17T02:26:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.392+0000 7f9b4b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b4c0aef60 0x7f9b4c15e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.393+0000 7f9b4b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b4c0aef60 0x7f9b4c15e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35518/0 (socket says 172.21.15.5:35518) 2024-08-17T02:26:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.393+0000 7f9b4b400640 1 -- 172.21.15.5:0/1342196451 learned_addr learned my addr 172.21.15.5:0/1342196451 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.393+0000 7f9b4aa00640 1 --2- 172.21.15.5:0/1342196451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b4c0b2370 0x7f9b4c1581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.393+0000 7f9b4be00640 1 --2- 172.21.15.5:0/1342196451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b4c158b90 0x7f9b4c0c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.393+0000 7f9b4b400640 1 -- 172.21.15.5:0/1342196451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b4c158b90 msgr2=0x7f9b4c0c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.393+0000 7f9b4b400640 1 --2- 172.21.15.5:0/1342196451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b4c158b90 0x7f9b4c0c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.393+0000 7f9b4b400640 1 -- 172.21.15.5:0/1342196451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b4c0b2370 msgr2=0x7f9b4c1581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.393+0000 7f9b4b400640 1 --2- 172.21.15.5:0/1342196451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b4c0b2370 0x7f9b4c1581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.393+0000 7f9b4b400640 1 -- 172.21.15.5:0/1342196451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c009450 con 0x7f9b4c0aef60 2024-08-17T02:26:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.393+0000 7f9b4b400640 1 --2- 172.21.15.5:0/1342196451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b4c0aef60 0x7f9b4c15e760 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009210 tx=0x7f9b3c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.394+0000 7f9b42a00640 1 -- 172.21.15.5:0/1342196451 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c031c80 con 0x7f9b4c0aef60 2024-08-17T02:26:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.394+0000 7f9b42a00640 1 -- 172.21.15.5:0/1342196451 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c031e00 con 0x7f9b4c0aef60 2024-08-17T02:26:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.394+0000 7f9b42a00640 1 -- 172.21.15.5:0/1342196451 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c03d670 con 0x7f9b4c0aef60 2024-08-17T02:26:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.394+0000 7f9b52800640 1 -- 172.21.15.5:0/1342196451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c15d760 con 0x7f9b4c0aef60 2024-08-17T02:26:49.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.394+0000 7f9b52800640 1 -- 172.21.15.5:0/1342196451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4c15dd20 con 0x7f9b4c0aef60 2024-08-17T02:26:49.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.395+0000 7f9b52800640 1 -- 172.21.15.5:0/1342196451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4c15c620 con 0x7f9b4c0aef60 2024-08-17T02:26:49.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.396+0000 7f9b42a00640 1 -- 172.21.15.5:0/1342196451 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9b3c039040 con 0x7f9b4c0aef60 2024-08-17T02:26:49.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.396+0000 7f9b42a00640 1 --2- 172.21.15.5:0/1342196451 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9b2c065150 0x7f9b2c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.397+0000 7f9b42a00640 1 -- 172.21.15.5:0/1342196451 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f9b3c0a2930 con 0x7f9b4c0aef60 2024-08-17T02:26:49.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.397+0000 7f9b4aa00640 1 --2- 172.21.15.5:0/1342196451 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9b2c065150 0x7f9b2c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.398+0000 7f9b4aa00640 1 --2- 172.21.15.5:0/1342196451 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9b2c065150 0x7f9b2c067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c15b610 tx=0x7f9b380090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.401+0000 7f9b42a00640 1 -- 172.21.15.5:0/1342196451 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9b4c15c620 con 0x7f9b4c0aef60 2024-08-17T02:26:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.583+0000 7f9b52800640 1 -- 172.21.15.5:0/1342196451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001044363.data", "var": "pg_num"} v 0) v1 -- 0x7f9b4c15c620 con 0x7f9b4c0aef60 2024-08-17T02:26:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.584+0000 7f9b42a00640 1 -- 172.21.15.5:0/1342196451 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001044363.data", "var": "pg_num"}]=0 v39) v1 ==== 124+0+11 (secure 0 0 0) 0x7f9b3c042020 con 0x7f9b4c0aef60 2024-08-17T02:26:49.585 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:26:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.586+0000 7f9b52800640 1 -- 172.21.15.5:0/1342196451 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9b2c065150 msgr2=0x7f9b2c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.586+0000 7f9b52800640 1 --2- 172.21.15.5:0/1342196451 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9b2c065150 0x7f9b2c067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c15b610 tx=0x7f9b380090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.586+0000 7f9b52800640 1 -- 172.21.15.5:0/1342196451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b4c0aef60 msgr2=0x7f9b4c15e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.586+0000 7f9b52800640 1 --2- 172.21.15.5:0/1342196451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b4c0aef60 0x7f9b4c15e760 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009210 tx=0x7f9b3c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.586+0000 7f9b52800640 1 -- 172.21.15.5:0/1342196451 shutdown_connections 2024-08-17T02:26:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.586+0000 7f9b52800640 1 --2- 172.21.15.5:0/1342196451 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9b2c065150 0x7f9b2c067600 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.586+0000 7f9b52800640 1 --2- 172.21.15.5:0/1342196451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b4c158b90 0x7f9b4c0c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.586+0000 7f9b52800640 1 --2- 172.21.15.5:0/1342196451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b4c0b2370 0x7f9b4c1581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.586+0000 7f9b52800640 1 --2- 172.21.15.5:0/1342196451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b4c0aef60 0x7f9b4c15e760 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.586+0000 7f9b52800640 1 -- 172.21.15.5:0/1342196451 >> 172.21.15.5:0/1342196451 conn(0x7f9b4c06e590 msgr2=0x7f9b4c0cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.586+0000 7f9b52800640 1 -- 172.21.15.5:0/1342196451 shutdown_connections 2024-08-17T02:26:49.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.586+0000 7f9b52800640 1 -- 172.21.15.5:0/1342196451 wait complete. 2024-08-17T02:26:49.602 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.751+0000 7f4981200640 1 Processor -- start 2024-08-17T02:26:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.752+0000 7f4981200640 1 -- start start 2024-08-17T02:26:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.753+0000 7f4981200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f497c0aa4e0 0x7f497c0aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.753+0000 7f4981200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f497c06ed30 0x7f497c0afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.753+0000 7f4981200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497c06dba0 con 0x7f497c06e8b0 2024-08-17T02:26:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.753+0000 7f4981200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c15d580 con 0x7f497c0aa4e0 2024-08-17T02:26:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.753+0000 7f4981200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c06ddf0 con 0x7f497c06ed30 2024-08-17T02:26:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.753+0000 7f497b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f497c0aa4e0 0x7f497c0aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.753+0000 7f497b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f497c0aa4e0 0x7f497c0aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35526/0 (socket says 172.21.15.5:35526) 2024-08-17T02:26:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.753+0000 7f497b400640 1 -- 172.21.15.5:0/3321113921 learned_addr learned my addr 172.21.15.5:0/3321113921 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.753+0000 7f497be00640 1 --2- 172.21.15.5:0/3321113921 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f497c06ed30 0x7f497c0afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.754+0000 7f497b400640 1 -- 172.21.15.5:0/3321113921 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f497c06ed30 msgr2=0x7f497c0afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.754+0000 7f497b400640 1 --2- 172.21.15.5:0/3321113921 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f497c06ed30 0x7f497c0afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.754+0000 7f497b400640 1 -- 172.21.15.5:0/3321113921 >> v1:172.21.15.5:6789/0 conn(0x7f497c06e8b0 legacy=0x7f497c0af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.754+0000 7f497b400640 1 -- 172.21.15.5:0/3321113921 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c06e0d0 con 0x7f497c0aa4e0 2024-08-17T02:26:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.755+0000 7f497b400640 1 --2- 172.21.15.5:0/3321113921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f497c0aa4e0 0x7f497c0aa8b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f496c009940 tx=0x7f496c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b96cb1ea3c4fa4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.755+0000 7f497aa00640 1 -- 172.21.15.5:0/3321113921 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c02adb0 con 0x7f497c0aa4e0 2024-08-17T02:26:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.755+0000 7f497aa00640 1 -- 172.21.15.5:0/3321113921 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496c032440 con 0x7f497c0aa4e0 2024-08-17T02:26:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.755+0000 7f497aa00640 1 -- 172.21.15.5:0/3321113921 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c032820 con 0x7f497c0aa4e0 2024-08-17T02:26:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.755+0000 7f4981200640 1 -- 172.21.15.5:0/3321113921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f497c0aa4e0 msgr2=0x7f497c0aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.755+0000 7f4981200640 1 --2- 172.21.15.5:0/3321113921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f497c0aa4e0 0x7f497c0aa8b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f496c009940 tx=0x7f496c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.755+0000 7f4981200640 1 -- 172.21.15.5:0/3321113921 shutdown_connections 2024-08-17T02:26:49.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.756+0000 7f4981200640 1 --2- 172.21.15.5:0/3321113921 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f497c06ed30 0x7f497c0afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.756+0000 7f4981200640 1 --2- 172.21.15.5:0/3321113921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f497c0aa4e0 0x7f497c0aa8b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.756+0000 7f4981200640 1 -- 172.21.15.5:0/3321113921 >> 172.21.15.5:0/3321113921 conn(0x7f497c066e60 msgr2=0x7f497c067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.756+0000 7f4981200640 1 -- 172.21.15.5:0/3321113921 shutdown_connections 2024-08-17T02:26:49.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.756+0000 7f4981200640 1 -- 172.21.15.5:0/3321113921 wait complete. 2024-08-17T02:26:49.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.757+0000 7f4981200640 1 Processor -- start 2024-08-17T02:26:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.757+0000 7f4981200640 1 -- start start 2024-08-17T02:26:49.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.758+0000 7f4981200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f497c06e8b0 0x7f497c138500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.758+0000 7f4981200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f497c06ed30 0x7f497c0ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.758+0000 7f4981200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f497c0aa4e0 0x7f497c1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.758+0000 7f4981200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c0adcb0 con 0x7f497c0aa4e0 2024-08-17T02:26:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.758+0000 7f4981200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c0adf90 con 0x7f497c06e8b0 2024-08-17T02:26:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.758+0000 7f4981200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c0ae270 con 0x7f497c06ed30 2024-08-17T02:26:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.758+0000 7f497be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f497c0aa4e0 0x7f497c1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.758+0000 7f497be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f497c0aa4e0 0x7f497c1581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35532/0 (socket says 172.21.15.5:35532) 2024-08-17T02:26:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.758+0000 7f497be00640 1 -- 172.21.15.5:0/3068883774 learned_addr learned my addr 172.21.15.5:0/3068883774 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.758+0000 7f497b400640 1 --2- 172.21.15.5:0/3068883774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f497c06e8b0 0x7f497c138500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.759+0000 7f497be00640 1 -- 172.21.15.5:0/3068883774 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f497c06ed30 msgr2=0x7f497c0ad260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.759+0000 7f4973e00640 1 --2- 172.21.15.5:0/3068883774 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f497c06ed30 0x7f497c0ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.759+0000 7f497be00640 1 --2- 172.21.15.5:0/3068883774 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f497c06ed30 0x7f497c0ad260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.759+0000 7f497be00640 1 -- 172.21.15.5:0/3068883774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f497c06e8b0 msgr2=0x7f497c138500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.759+0000 7f497be00640 1 --2- 172.21.15.5:0/3068883774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f497c06e8b0 0x7f497c138500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.759+0000 7f497be00640 1 -- 172.21.15.5:0/3068883774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c009450 con 0x7f497c0aa4e0 2024-08-17T02:26:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.759+0000 7f497b400640 1 --2- 172.21.15.5:0/3068883774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f497c06e8b0 0x7f497c138500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.759+0000 7f4973e00640 1 --2- 172.21.15.5:0/3068883774 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f497c06ed30 0x7f497c0ad260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.759+0000 7f497be00640 1 --2- 172.21.15.5:0/3068883774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f497c0aa4e0 0x7f497c1581c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4974009fa0 tx=0x7f4974009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.759+0000 7f4972a00640 1 -- 172.21.15.5:0/3068883774 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497400ee60 con 0x7f497c0aa4e0 2024-08-17T02:26:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.759+0000 7f4972a00640 1 -- 172.21.15.5:0/3068883774 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4974014420 con 0x7f497c0aa4e0 2024-08-17T02:26:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.759+0000 7f4972a00640 1 -- 172.21.15.5:0/3068883774 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49740147e0 con 0x7f497c0aa4e0 2024-08-17T02:26:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.759+0000 7f4981200640 1 -- 172.21.15.5:0/3068883774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497c0ae550 con 0x7f497c0aa4e0 2024-08-17T02:26:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.759+0000 7f4981200640 1 -- 172.21.15.5:0/3068883774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497c159510 con 0x7f497c0aa4e0 2024-08-17T02:26:49.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.760+0000 7f4981200640 1 -- 172.21.15.5:0/3068883774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497c070720 con 0x7f497c0aa4e0 2024-08-17T02:26:49.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.761+0000 7f4972a00640 1 -- 172.21.15.5:0/3068883774 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4974014b50 con 0x7f497c0aa4e0 2024-08-17T02:26:49.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.762+0000 7f4972a00640 1 --2- 172.21.15.5:0/3068883774 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4958065150 0x7f4958067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.762+0000 7f4972a00640 1 -- 172.21.15.5:0/3068883774 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f4974083040 con 0x7f497c0aa4e0 2024-08-17T02:26:49.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.762+0000 7f497b400640 1 --2- 172.21.15.5:0/3068883774 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4958065150 0x7f4958067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.763+0000 7f497b400640 1 --2- 172.21.15.5:0/3068883774 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4958065150 0x7f4958067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f496c034000 tx=0x7f496c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.766+0000 7f4972a00640 1 -- 172.21.15.5:0/3068883774 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4974050d80 con 0x7f497c0aa4e0 2024-08-17T02:26:49.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.984+0000 7f4981200640 1 -- 172.21.15.5:0/3068883774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f497c06b1f0 con 0x7f497c0aa4e0 2024-08-17T02:26:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.984+0000 7f4972a00640 1 -- 172.21.15.5:0/3068883774 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5678 (secure 0 0 0) 0x7f49740543a0 con 0x7f497c0aa4e0 2024-08-17T02:26:49.986 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:26:49.986 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1398504310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1398504310},{"type":"v1","addr":"172.21.15.5:6837","nonce":1398504310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/1045077639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1045077639},{"type":"v1","addr":"172.21.15.87:6833","nonce":1045077639}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:31.652483+0000","modified":"2024-08-17T02:24:35.247786+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6836/1918940200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1918940200},{"type":"v1","addr":"172.21.15.5:6836","nonce":1918940200}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:44.295321+0000","modified":"2024-08-17T02:24:45.911915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4858},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4858":{"gid":4858,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.87:6835/1739323622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1739323622},{"type":"v1","addr":"172.21.15.87:6835","nonce":1739323622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001044363","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:26:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 20 2024-08-17T02:26:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.986+0000 7f4981200640 1 -- 172.21.15.5:0/3068883774 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4958065150 msgr2=0x7f4958067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.986+0000 7f4981200640 1 --2- 172.21.15.5:0/3068883774 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4958065150 0x7f4958067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f496c034000 tx=0x7f496c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.986+0000 7f4981200640 1 -- 172.21.15.5:0/3068883774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f497c0aa4e0 msgr2=0x7f497c1581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.986+0000 7f4981200640 1 --2- 172.21.15.5:0/3068883774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f497c0aa4e0 0x7f497c1581c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4974009fa0 tx=0x7f4974009900 comp rx=0 tx=0).stop 2024-08-17T02:26:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.986+0000 7f4981200640 1 -- 172.21.15.5:0/3068883774 shutdown_connections 2024-08-17T02:26:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.986+0000 7f4981200640 1 --2- 172.21.15.5:0/3068883774 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4958065150 0x7f4958067600 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.986+0000 7f4981200640 1 --2- 172.21.15.5:0/3068883774 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f497c06ed30 0x7f497c0ad260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.986+0000 7f4981200640 1 --2- 172.21.15.5:0/3068883774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f497c0aa4e0 0x7f497c1581c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.986+0000 7f4981200640 1 --2- 172.21.15.5:0/3068883774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f497c06e8b0 0x7f497c138500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.986+0000 7f4981200640 1 -- 172.21.15.5:0/3068883774 >> 172.21.15.5:0/3068883774 conn(0x7f497c066e60 msgr2=0x7f497c141370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.987+0000 7f4981200640 1 -- 172.21.15.5:0/3068883774 shutdown_connections 2024-08-17T02:26:49.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:49.987+0000 7f4981200640 1 -- 172.21.15.5:0/3068883774 wait complete. 2024-08-17T02:26:50.003 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.153+0000 7fc2dd800640 1 Processor -- start 2024-08-17T02:26:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.153+0000 7fc2dd800640 1 -- start start 2024-08-17T02:26:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.155+0000 7fc2dd800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc2d80ca050 0x7fc2d8156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.155+0000 7fc2dd800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d80cb160 con 0x7fc2d80add30 2024-08-17T02:26:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.155+0000 7fc2dd800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d80b0d10 con 0x7fc2d80ad960 2024-08-17T02:26:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.155+0000 7fc2dd800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d80ca550 con 0x7fc2d80ca050 2024-08-17T02:26:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.155+0000 7fc2d7400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc2d80add30 0x7fc2d80aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48260/0 (socket says 172.21.15.5:48260) 2024-08-17T02:26:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.155+0000 7fc2d7400640 1 -- 172.21.15.5:0/1749886231 learned_addr learned my addr 172.21.15.5:0/1749886231 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:26:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.155+0000 7fc2cfe00640 1 --2- 172.21.15.5:0/1749886231 >> v2:172.21.15.87:3300/0 conn(0x7fc2d80ca050 0x7fc2d8156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.155+0000 7fc2d6000640 1 -- 172.21.15.5:0/1749886231 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840288637 0 0) 0x7fc2d80cb160 con 0x7fc2d80add30 2024-08-17T02:26:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.155+0000 7fc2d6000640 1 -- 172.21.15.5:0/1749886231 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2bc0034e0 con 0x7fc2d80add30 2024-08-17T02:26:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2d6000640 1 -- 172.21.15.5:0/1749886231 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 587264140 0 0) 0x7fc2bc0034e0 con 0x7fc2d80add30 2024-08-17T02:26:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2d6000640 1 -- 172.21.15.5:0/1749886231 >> v2:172.21.15.87:3300/0 conn(0x7fc2d80ca050 msgr2=0x7fc2d8156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2d6000640 1 --2- 172.21.15.5:0/1749886231 >> v2:172.21.15.87:3300/0 conn(0x7fc2d80ca050 0x7fc2d8156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2d6000640 1 -- 172.21.15.5:0/1749886231 >> v1:172.21.15.87:6789/0 conn(0x7fc2d80ad960 legacy=0x7fc2d8156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2d6000640 1 -- 172.21.15.5:0/1749886231 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d80ca830 con 0x7fc2d80add30 2024-08-17T02:26:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2d6000640 1 -- 172.21.15.5:0/1749886231 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2658686246 0 0) 0x7fc2d00017f0 con 0x7fc2d80add30 2024-08-17T02:26:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2d6000640 1 -- 172.21.15.5:0/1749886231 >> v1:172.21.15.5:6789/0 conn(0x7fc2d80add30 legacy=0x7fc2d80aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2d6000640 1 --2- 172.21.15.5:0/1749886231 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2bc003a20 0x7fc2bc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2d6000640 1 --2- 172.21.15.5:0/1749886231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc004780 0x7fc2bc004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2d6000640 1 --2- 172.21.15.5:0/1749886231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2bc005180 0x7fc2bc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2d6000640 1 -- 172.21.15.5:0/1749886231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80ca550 con 0x7fc2bc004780 2024-08-17T02:26:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2d6000640 1 -- 172.21.15.5:0/1749886231 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc00c0a0 con 0x7fc2bc005180 2024-08-17T02:26:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2d6000640 1 -- 172.21.15.5:0/1749886231 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc00c260 con 0x7fc2bc003a20 2024-08-17T02:26:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2cfe00640 1 --2- 172.21.15.5:0/1749886231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc004780 0x7fc2bc004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2d7400640 1 --2- 172.21.15.5:0/1749886231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2bc005180 0x7fc2bc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2d6a00640 1 --2- 172.21.15.5:0/1749886231 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2bc003a20 0x7fc2bc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2cfe00640 1 -- 172.21.15.5:0/1749886231 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2bc003a20 msgr2=0x7fc2bc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2cfe00640 1 --2- 172.21.15.5:0/1749886231 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2bc003a20 0x7fc2bc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2cfe00640 1 -- 172.21.15.5:0/1749886231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2bc005180 msgr2=0x7fc2bc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2cfe00640 1 --2- 172.21.15.5:0/1749886231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2bc005180 0x7fc2bc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.156+0000 7fc2cfe00640 1 -- 172.21.15.5:0/1749886231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2bc0034e0 con 0x7fc2bc004780 2024-08-17T02:26:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.157+0000 7fc2d7400640 1 --2- 172.21.15.5:0/1749886231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2bc005180 0x7fc2bc00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.157+0000 7fc2d7400640 1 -- 172.21.15.5:0/1749886231 reap_dead start 2024-08-17T02:26:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.157+0000 7fc2cfe00640 1 --2- 172.21.15.5:0/1749886231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc004780 0x7fc2bc004bf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0009b70 tx=0x7fc2c00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e241f8a4295185a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.158+0000 7fc2d6000640 1 -- 172.21.15.5:0/1749886231 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0031400 con 0x7fc2bc004780 2024-08-17T02:26:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.158+0000 7fc2d6000640 1 -- 172.21.15.5:0/1749886231 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c002d050 con 0x7fc2bc004780 2024-08-17T02:26:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.158+0000 7fc2d6000640 1 -- 172.21.15.5:0/1749886231 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0031790 con 0x7fc2bc004780 2024-08-17T02:26:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.158+0000 7fc2dd800640 1 -- 172.21.15.5:0/1749886231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc004780 msgr2=0x7fc2bc004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.158+0000 7fc2dd800640 1 --2- 172.21.15.5:0/1749886231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc004780 0x7fc2bc004bf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0009b70 tx=0x7fc2c00090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.158+0000 7fc2dd800640 1 -- 172.21.15.5:0/1749886231 shutdown_connections 2024-08-17T02:26:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.158+0000 7fc2dd800640 1 --2- 172.21.15.5:0/1749886231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc004780 0x7fc2bc004bf0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.158+0000 7fc2dd800640 1 -- 172.21.15.5:0/1749886231 >> 172.21.15.5:0/1749886231 conn(0x7fc2d8066e60 msgr2=0x7fc2d8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.158+0000 7fc2dd800640 1 -- 172.21.15.5:0/1749886231 shutdown_connections 2024-08-17T02:26:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.158+0000 7fc2dd800640 1 -- 172.21.15.5:0/1749886231 wait complete. 2024-08-17T02:26:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.160+0000 7fc2dd800640 1 Processor -- start 2024-08-17T02:26:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.160+0000 7fc2dd800640 1 -- start start 2024-08-17T02:26:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.161+0000 7fc2dd800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc004780 0x7fc2d80a8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.161+0000 7fc2dd800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d80a8ea0 0x7fc2d8168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.161+0000 7fc2dd800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2d81692c0 0x7fc2d8169760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.161+0000 7fc2dd800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d8169ca0 con 0x7fc2bc004780 2024-08-17T02:26:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.161+0000 7fc2dd800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80a92f0 con 0x7fc2d80a8ea0 2024-08-17T02:26:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.161+0000 7fc2dd800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80a59b0 con 0x7fc2d81692c0 2024-08-17T02:26:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.161+0000 7fc2d6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc004780 0x7fc2d80a8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.161+0000 7fc2d6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc004780 0x7fc2d80a8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40506/0 (socket says 172.21.15.5:40506) 2024-08-17T02:26:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.161+0000 7fc2d6a00640 1 -- 172.21.15.5:0/193638794 learned_addr learned my addr 172.21.15.5:0/193638794 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.161+0000 7fc2cfe00640 1 --2- 172.21.15.5:0/193638794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d80a8ea0 0x7fc2d8168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.161+0000 7fc2d7400640 1 --2- 172.21.15.5:0/193638794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2d81692c0 0x7fc2d8169760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.161+0000 7fc2d6a00640 1 -- 172.21.15.5:0/193638794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2d81692c0 msgr2=0x7fc2d8169760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.161+0000 7fc2d6a00640 1 --2- 172.21.15.5:0/193638794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2d81692c0 0x7fc2d8169760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.161+0000 7fc2d6a00640 1 -- 172.21.15.5:0/193638794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d80a8ea0 msgr2=0x7fc2d8168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.161+0000 7fc2d6a00640 1 --2- 172.21.15.5:0/193638794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d80a8ea0 0x7fc2d8168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.161+0000 7fc2d6a00640 1 -- 172.21.15.5:0/193638794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d80a82d0 con 0x7fc2bc004780 2024-08-17T02:26:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.161+0000 7fc2cfe00640 1 --2- 172.21.15.5:0/193638794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d80a8ea0 0x7fc2d8168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.161+0000 7fc2d7400640 1 --2- 172.21.15.5:0/193638794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2d81692c0 0x7fc2d8169760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.162+0000 7fc2d6a00640 1 --2- 172.21.15.5:0/193638794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc004780 0x7fc2d80a8960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800e840 tx=0x7fc2c8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.162+0000 7fc2ce000640 1 -- 172.21.15.5:0/193638794 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c800c6c0 con 0x7fc2bc004780 2024-08-17T02:26:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.162+0000 7fc2ce000640 1 -- 172.21.15.5:0/193638794 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c800c820 con 0x7fc2bc004780 2024-08-17T02:26:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.162+0000 7fc2ce000640 1 -- 172.21.15.5:0/193638794 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c800cbe0 con 0x7fc2bc004780 2024-08-17T02:26:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.162+0000 7fc2dd800640 1 -- 172.21.15.5:0/193638794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d80a9520 con 0x7fc2bc004780 2024-08-17T02:26:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.162+0000 7fc2dd800640 1 -- 172.21.15.5:0/193638794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d80a9ae0 con 0x7fc2bc004780 2024-08-17T02:26:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.163+0000 7fc2dd800640 1 -- 172.21.15.5:0/193638794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d8063fb0 con 0x7fc2bc004780 2024-08-17T02:26:50.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.164+0000 7fc2ce000640 1 -- 172.21.15.5:0/193638794 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc2c8013420 con 0x7fc2bc004780 2024-08-17T02:26:50.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.165+0000 7fc2ce000640 1 --2- 172.21.15.5:0/193638794 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc2b4065180 0x7fc2b4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.165+0000 7fc2ce000640 1 -- 172.21.15.5:0/193638794 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fc2c8082cf0 con 0x7fc2bc004780 2024-08-17T02:26:50.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.165+0000 7fc2cfe00640 1 --2- 172.21.15.5:0/193638794 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc2b4065180 0x7fc2b4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.166+0000 7fc2cfe00640 1 --2- 172.21.15.5:0/193638794 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc2b4065180 0x7fc2b4067630 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0034000 tx=0x7fc2c0035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.169+0000 7fc2ce000640 1 -- 172.21.15.5:0/193638794 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc2c8050a50 con 0x7fc2bc004780 2024-08-17T02:26:50.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.353+0000 7fc2dd800640 1 -- 172.21.15.5:0/193638794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2d8153c60 con 0x7fc2bc004780 2024-08-17T02:26:50.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.354+0000 7fc2ce000640 1 -- 172.21.15.5:0/193638794 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18503 (secure 0 0 0) 0x7fc2c8054070 con 0x7fc2bc004780 2024-08-17T02:26:50.356 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:26:50.356 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":39,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:24:46.313823+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:29.724167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:30.637206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000001044363.meta","create_time":"2024-08-17T02:24:42.487826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001044363"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001044363.data","create_time":"2024-08-17T02:24:43.336536+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001044363"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.356+0000 7fc2dd800640 1 -- 172.21.15.5:0/193638794 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc2b4065180 msgr2=0x7fc2b4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.356+0000 7fc2dd800640 1 --2- 172.21.15.5:0/193638794 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc2b4065180 0x7fc2b4067630 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0034000 tx=0x7fc2c0035000 comp rx=0 tx=0).stop 2024-08-17T02:26:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.356+0000 7fc2dd800640 1 -- 172.21.15.5:0/193638794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc004780 msgr2=0x7fc2d80a8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.356+0000 7fc2dd800640 1 --2- 172.21.15.5:0/193638794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc004780 0x7fc2d80a8960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800e840 tx=0x7fc2c8009040 comp rx=0 tx=0).stop 2024-08-17T02:26:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.356+0000 7fc2dd800640 1 -- 172.21.15.5:0/193638794 shutdown_connections 2024-08-17T02:26:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.356+0000 7fc2dd800640 1 --2- 172.21.15.5:0/193638794 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc2b4065180 0x7fc2b4067630 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.356+0000 7fc2dd800640 1 --2- 172.21.15.5:0/193638794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2d81692c0 0x7fc2d8169760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.356+0000 7fc2dd800640 1 --2- 172.21.15.5:0/193638794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d80a8ea0 0x7fc2d8168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.356+0000 7fc2dd800640 1 --2- 172.21.15.5:0/193638794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc004780 0x7fc2d80a8960 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.356+0000 7fc2dd800640 1 -- 172.21.15.5:0/193638794 >> 172.21.15.5:0/193638794 conn(0x7fc2d8066e60 msgr2=0x7fc2d80ab550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.356+0000 7fc2dd800640 1 -- 172.21.15.5:0/193638794 shutdown_connections 2024-08-17T02:26:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.356+0000 7fc2dd800640 1 -- 172.21.15.5:0/193638794 wait complete. 2024-08-17T02:26:50.373 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:26:50.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.522+0000 7f9289000640 1 Processor -- start 2024-08-17T02:26:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.522+0000 7f9289000640 1 -- start start 2024-08-17T02:26:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.523+0000 7f9289000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92840ca050 0x7f9284156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.523+0000 7f9289000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92840cb160 con 0x7f92840add30 2024-08-17T02:26:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.523+0000 7f9289000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92840b0d10 con 0x7f92840ad960 2024-08-17T02:26:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.523+0000 7f9289000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92840ca550 con 0x7f92840ca050 2024-08-17T02:26:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.523+0000 7f9282800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f92840add30 0x7f92840aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48268/0 (socket says 172.21.15.5:48268) 2024-08-17T02:26:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.523+0000 7f9282800640 1 -- 172.21.15.5:0/3425952842 learned_addr learned my addr 172.21.15.5:0/3425952842 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:26:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.524+0000 7f927be00640 1 --2- 172.21.15.5:0/3425952842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92840ca050 0x7f9284156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.524+0000 7f9281400640 1 -- 172.21.15.5:0/3425952842 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613358618 0 0) 0x7f92840cb160 con 0x7f92840add30 2024-08-17T02:26:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.524+0000 7f9281400640 1 -- 172.21.15.5:0/3425952842 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92680034e0 con 0x7f92840add30 2024-08-17T02:26:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.524+0000 7f9281400640 1 -- 172.21.15.5:0/3425952842 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3651676178 0 0) 0x7f92680034e0 con 0x7f92840add30 2024-08-17T02:26:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.524+0000 7f9281400640 1 -- 172.21.15.5:0/3425952842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92840ca050 msgr2=0x7f9284156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.524+0000 7f9281400640 1 --2- 172.21.15.5:0/3425952842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92840ca050 0x7f9284156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.524+0000 7f9281400640 1 -- 172.21.15.5:0/3425952842 >> v1:172.21.15.87:6789/0 conn(0x7f92840ad960 legacy=0x7f9284156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.524+0000 7f9281400640 1 -- 172.21.15.5:0/3425952842 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92840ca830 con 0x7f92840add30 2024-08-17T02:26:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.524+0000 7f9281400640 1 -- 172.21.15.5:0/3425952842 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2658686246 0 0) 0x7f927c0017f0 con 0x7f92840add30 2024-08-17T02:26:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.524+0000 7f9281400640 1 -- 172.21.15.5:0/3425952842 >> v1:172.21.15.5:6789/0 conn(0x7f92840add30 legacy=0x7f92840aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.524+0000 7f9281400640 1 --2- 172.21.15.5:0/3425952842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9268003a00 0x7f9268003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.524+0000 7f9281400640 1 --2- 172.21.15.5:0/3425952842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92840ca050 0x7f9268004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.524+0000 7f9281400640 1 --2- 172.21.15.5:0/3425952842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9268004cc0 0x7f9268005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.524+0000 7f9281400640 1 -- 172.21.15.5:0/3425952842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92840ca550 con 0x7f9268003a00 2024-08-17T02:26:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.524+0000 7f9281400640 1 -- 172.21.15.5:0/3425952842 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926800ba80 con 0x7f9268004cc0 2024-08-17T02:26:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.524+0000 7f9281400640 1 -- 172.21.15.5:0/3425952842 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926800bc40 con 0x7f92840ca050 2024-08-17T02:26:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.525+0000 7f9281e00640 1 --2- 172.21.15.5:0/3425952842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9268003a00 0x7f9268003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.525+0000 7f9282800640 1 --2- 172.21.15.5:0/3425952842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9268004cc0 0x7f9268005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.525+0000 7f927be00640 1 --2- 172.21.15.5:0/3425952842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92840ca050 0x7f9268004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.525+0000 7f9281e00640 1 -- 172.21.15.5:0/3425952842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92840ca050 msgr2=0x7f9268004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.525+0000 7f9281e00640 1 --2- 172.21.15.5:0/3425952842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92840ca050 0x7f9268004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.525+0000 7f9281e00640 1 -- 172.21.15.5:0/3425952842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9268004cc0 msgr2=0x7f9268005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.525+0000 7f9281e00640 1 --2- 172.21.15.5:0/3425952842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9268004cc0 0x7f9268005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.525+0000 7f9281e00640 1 -- 172.21.15.5:0/3425952842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92680034e0 con 0x7f9268003a00 2024-08-17T02:26:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.525+0000 7f927be00640 1 --2- 172.21.15.5:0/3425952842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92840ca050 0x7f9268004780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:50.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.526+0000 7f9281e00640 1 --2- 172.21.15.5:0/3425952842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9268003a00 0x7f9268003dd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9274001920 tx=0x7f9274007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e56a04e794ab9f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.526+0000 7f9281400640 1 -- 172.21.15.5:0/3425952842 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927402ab00 con 0x7f9268003a00 2024-08-17T02:26:50.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.526+0000 7f9281400640 1 -- 172.21.15.5:0/3425952842 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927402ac80 con 0x7f9268003a00 2024-08-17T02:26:50.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.526+0000 7f9281400640 1 -- 172.21.15.5:0/3425952842 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92740323f0 con 0x7f9268003a00 2024-08-17T02:26:50.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.527+0000 7f9289000640 1 -- 172.21.15.5:0/3425952842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9268003a00 msgr2=0x7f9268003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.527+0000 7f9289000640 1 --2- 172.21.15.5:0/3425952842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9268003a00 0x7f9268003dd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9274001920 tx=0x7f9274007c80 comp rx=0 tx=0).stop 2024-08-17T02:26:50.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.527+0000 7f9282800640 1 -- 172.21.15.5:0/3425952842 reap_dead start 2024-08-17T02:26:50.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.527+0000 7f9289000640 1 -- 172.21.15.5:0/3425952842 shutdown_connections 2024-08-17T02:26:50.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.527+0000 7f9289000640 1 -- 172.21.15.5:0/3425952842 >> 172.21.15.5:0/3425952842 conn(0x7f9284066e60 msgr2=0x7f9284067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:50.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.527+0000 7f9289000640 1 -- 172.21.15.5:0/3425952842 shutdown_connections 2024-08-17T02:26:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.527+0000 7f9289000640 1 -- 172.21.15.5:0/3425952842 wait complete. 2024-08-17T02:26:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.528+0000 7f9289000640 1 Processor -- start 2024-08-17T02:26:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.528+0000 7f9289000640 1 -- start start 2024-08-17T02:26:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.529+0000 7f9289000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9268003a00 0x7f9284156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.529+0000 7f9289000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9284153360 0x7f928415dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.529+0000 7f9289000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92841570f0 0x7f928415e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.529+0000 7f9289000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9284158210 con 0x7f9268003a00 2024-08-17T02:26:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.529+0000 7f9289000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92841586a0 con 0x7f92841570f0 2024-08-17T02:26:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.529+0000 7f9289000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9284157600 con 0x7f9284153360 2024-08-17T02:26:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.530+0000 7f9281e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9268003a00 0x7f9284156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.530+0000 7f9281e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9268003a00 0x7f9284156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40520/0 (socket says 172.21.15.5:40520) 2024-08-17T02:26:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.530+0000 7f9281e00640 1 -- 172.21.15.5:0/1439501094 learned_addr learned my addr 172.21.15.5:0/1439501094 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.530+0000 7f927be00640 1 --2- 172.21.15.5:0/1439501094 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9284153360 0x7f928415dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.530+0000 7f9282800640 1 --2- 172.21.15.5:0/1439501094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92841570f0 0x7f928415e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.530+0000 7f9281e00640 1 -- 172.21.15.5:0/1439501094 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9284153360 msgr2=0x7f928415dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.530+0000 7f9281e00640 1 --2- 172.21.15.5:0/1439501094 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9284153360 0x7f928415dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.530+0000 7f9281e00640 1 -- 172.21.15.5:0/1439501094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92841570f0 msgr2=0x7f928415e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.530+0000 7f9281e00640 1 --2- 172.21.15.5:0/1439501094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92841570f0 0x7f928415e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.530+0000 7f9281e00640 1 -- 172.21.15.5:0/1439501094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92841578e0 con 0x7f9268003a00 2024-08-17T02:26:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.530+0000 7f9281e00640 1 --2- 172.21.15.5:0/1439501094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9268003a00 0x7f9284156bb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9274001920 tx=0x7f9274003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.531+0000 7f9279600640 1 -- 172.21.15.5:0/1439501094 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9274040070 con 0x7f9268003a00 2024-08-17T02:26:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.531+0000 7f9279600640 1 -- 172.21.15.5:0/1439501094 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92740339c0 con 0x7f9268003a00 2024-08-17T02:26:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.531+0000 7f9279600640 1 -- 172.21.15.5:0/1439501094 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9274033d40 con 0x7f9268003a00 2024-08-17T02:26:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.531+0000 7f9289000640 1 -- 172.21.15.5:0/1439501094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9284157bc0 con 0x7f9268003a00 2024-08-17T02:26:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.531+0000 7f9289000640 1 -- 172.21.15.5:0/1439501094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9284153930 con 0x7f9268003a00 2024-08-17T02:26:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.532+0000 7f9289000640 1 -- 172.21.15.5:0/1439501094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9284063fb0 con 0x7f9268003a00 2024-08-17T02:26:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.533+0000 7f9279600640 1 -- 172.21.15.5:0/1439501094 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9274007260 con 0x7f9268003a00 2024-08-17T02:26:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.533+0000 7f9279600640 1 --2- 172.21.15.5:0/1439501094 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9260065180 0x7f9260067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.533+0000 7f9279600640 1 -- 172.21.15.5:0/1439501094 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f92740a22b0 con 0x7f9268003a00 2024-08-17T02:26:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.534+0000 7f927be00640 1 --2- 172.21.15.5:0/1439501094 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9260065180 0x7f9260067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.534+0000 7f927be00640 1 --2- 172.21.15.5:0/1439501094 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9260065180 0x7f9260067630 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f926c006d30 tx=0x7f926c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.537+0000 7f9279600640 1 -- 172.21.15.5:0/1439501094 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f927406ff50 con 0x7f9268003a00 2024-08-17T02:26:50.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.763+0000 7f9289000640 1 -- 172.21.15.5:0/1439501094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9284063fb0 con 0x7f9268003a00 2024-08-17T02:26:50.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.763+0000 7f9279600640 1 -- 172.21.15.5:0/1439501094 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5678 (secure 0 0 0) 0x7f9274073570 con 0x7f9268003a00 2024-08-17T02:26:50.765 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:26:50.765 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1398504310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1398504310},{"type":"v1","addr":"172.21.15.5:6837","nonce":1398504310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/1045077639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1045077639},{"type":"v1","addr":"172.21.15.87:6833","nonce":1045077639}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:31.652483+0000","modified":"2024-08-17T02:24:35.247786+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6836/1918940200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1918940200},{"type":"v1","addr":"172.21.15.5:6836","nonce":1918940200}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:44.295321+0000","modified":"2024-08-17T02:24:45.911915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4858},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4858":{"gid":4858,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.87:6835/1739323622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1739323622},{"type":"v1","addr":"172.21.15.87:6835","nonce":1739323622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001044363","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:26:50.765 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 20 2024-08-17T02:26:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.765+0000 7f9289000640 1 -- 172.21.15.5:0/1439501094 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9260065180 msgr2=0x7f9260067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.765+0000 7f9289000640 1 --2- 172.21.15.5:0/1439501094 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9260065180 0x7f9260067630 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f926c006d30 tx=0x7f926c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.765+0000 7f9289000640 1 -- 172.21.15.5:0/1439501094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9268003a00 msgr2=0x7f9284156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.765+0000 7f9289000640 1 --2- 172.21.15.5:0/1439501094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9268003a00 0x7f9284156bb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9274001920 tx=0x7f9274003000 comp rx=0 tx=0).stop 2024-08-17T02:26:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.766+0000 7f9289000640 1 -- 172.21.15.5:0/1439501094 shutdown_connections 2024-08-17T02:26:50.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.766+0000 7f9289000640 1 --2- 172.21.15.5:0/1439501094 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9260065180 0x7f9260067630 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.766+0000 7f9289000640 1 --2- 172.21.15.5:0/1439501094 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9284153360 0x7f928415dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.766+0000 7f9289000640 1 --2- 172.21.15.5:0/1439501094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92841570f0 0x7f928415e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.766+0000 7f9289000640 1 --2- 172.21.15.5:0/1439501094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9268003a00 0x7f9284156bb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.766+0000 7f9289000640 1 -- 172.21.15.5:0/1439501094 >> 172.21.15.5:0/1439501094 conn(0x7f9284066e60 msgr2=0x7f9284155720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:50.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.766+0000 7f9289000640 1 -- 172.21.15.5:0/1439501094 shutdown_connections 2024-08-17T02:26:50.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.766+0000 7f9289000640 1 -- 172.21.15.5:0/1439501094 wait complete. 2024-08-17T02:26:50.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:50.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.932+0000 7f3587e00640 1 Processor -- start 2024-08-17T02:26:50.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.932+0000 7f3587e00640 1 -- start start 2024-08-17T02:26:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.933+0000 7f3587e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3588069840 0x7f35880cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.933+0000 7f3587e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358815c9d0 con 0x7f35880cd550 2024-08-17T02:26:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.933+0000 7f3587e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358815a200 con 0x7f35880cbe10 2024-08-17T02:26:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.933+0000 7f3587e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35880b0830 con 0x7f3588069840 2024-08-17T02:26:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.933+0000 7f3586a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3588069840 0x7f35880cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.933+0000 7f3586a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3588069840 0x7f35880cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40528/0 (socket says 172.21.15.5:40528) 2024-08-17T02:26:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.933+0000 7f3586a00640 1 -- 172.21.15.5:0/312067275 learned_addr learned my addr 172.21.15.5:0/312067275 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.934+0000 7f3586a00640 1 -- 172.21.15.5:0/312067275 >> v1:172.21.15.87:6789/0 conn(0x7f35880cbe10 legacy=0x7f35880ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.934+0000 7f3586a00640 1 -- 172.21.15.5:0/312067275 >> v1:172.21.15.5:6789/0 conn(0x7f35880cd550 legacy=0x7f358815ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.934+0000 7f3586a00640 1 -- 172.21.15.5:0/312067275 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35880b0b10 con 0x7f3588069840 2024-08-17T02:26:50.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.935+0000 7f3586a00640 1 --2- 172.21.15.5:0/312067275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3588069840 0x7f35880cb8d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3578009910 tx=0x7f35780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11061c3f8c38fbf8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.935+0000 7f3586000640 1 -- 172.21.15.5:0/312067275 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3578032440 con 0x7f3588069840 2024-08-17T02:26:50.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.935+0000 7f3586000640 1 -- 172.21.15.5:0/312067275 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35780325a0 con 0x7f3588069840 2024-08-17T02:26:50.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.935+0000 7f3586000640 1 -- 172.21.15.5:0/312067275 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3578032980 con 0x7f3588069840 2024-08-17T02:26:50.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.935+0000 7f3587e00640 1 -- 172.21.15.5:0/312067275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3588069840 msgr2=0x7f35880cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.935+0000 7f3587e00640 1 --2- 172.21.15.5:0/312067275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3588069840 0x7f35880cb8d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3578009910 tx=0x7f35780091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.936+0000 7f3587e00640 1 -- 172.21.15.5:0/312067275 shutdown_connections 2024-08-17T02:26:50.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.936+0000 7f3587e00640 1 --2- 172.21.15.5:0/312067275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3588069840 0x7f35880cb8d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.936+0000 7f3587e00640 1 -- 172.21.15.5:0/312067275 >> 172.21.15.5:0/312067275 conn(0x7f3588066e60 msgr2=0x7f3588067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:50.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.936+0000 7f3587e00640 1 -- 172.21.15.5:0/312067275 shutdown_connections 2024-08-17T02:26:50.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.936+0000 7f3587e00640 1 -- 172.21.15.5:0/312067275 wait complete. 2024-08-17T02:26:50.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.937+0000 7f3587e00640 1 Processor -- start 2024-08-17T02:26:50.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.937+0000 7f3587e00640 1 -- start start 2024-08-17T02:26:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.938+0000 7f3587e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3588069840 0x7f3588140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.938+0000 7f3587e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35880cbe10 0x7f35881413b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.938+0000 7f3587e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3588140960 0x7f3588156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.938+0000 7f3587e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3588144390 con 0x7f3588069840 2024-08-17T02:26:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.938+0000 7f3587e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35881418f0 con 0x7f3588140960 2024-08-17T02:26:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.938+0000 7f3587e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3588141ba0 con 0x7f35880cbe10 2024-08-17T02:26:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.938+0000 7f3586a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3588069840 0x7f3588140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.938+0000 7f3586a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3588069840 0x7f3588140e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40532/0 (socket says 172.21.15.5:40532) 2024-08-17T02:26:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.938+0000 7f3586a00640 1 -- 172.21.15.5:0/680425504 learned_addr learned my addr 172.21.15.5:0/680425504 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.938+0000 7f3587400640 1 --2- 172.21.15.5:0/680425504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3588140960 0x7f3588156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.939+0000 7f357fe00640 1 --2- 172.21.15.5:0/680425504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35880cbe10 0x7f35881413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.939+0000 7f3586a00640 1 -- 172.21.15.5:0/680425504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35880cbe10 msgr2=0x7f35881413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.939+0000 7f3586a00640 1 --2- 172.21.15.5:0/680425504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35880cbe10 0x7f35881413b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.939+0000 7f3586a00640 1 -- 172.21.15.5:0/680425504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3588140960 msgr2=0x7f3588156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.939+0000 7f3586a00640 1 --2- 172.21.15.5:0/680425504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3588140960 0x7f3588156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.939+0000 7f3586a00640 1 -- 172.21.15.5:0/680425504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3578009450 con 0x7f3588069840 2024-08-17T02:26:50.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.939+0000 7f3586a00640 1 --2- 172.21.15.5:0/680425504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3588069840 0x7f3588140e70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3578035040 tx=0x7f3578032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.939+0000 7f357e000640 1 -- 172.21.15.5:0/680425504 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3578031c80 con 0x7f3588069840 2024-08-17T02:26:50.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.939+0000 7f357e000640 1 -- 172.21.15.5:0/680425504 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3578031e00 con 0x7f3588069840 2024-08-17T02:26:50.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.939+0000 7f357e000640 1 -- 172.21.15.5:0/680425504 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357803d670 con 0x7f3588069840 2024-08-17T02:26:50.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.939+0000 7f3587e00640 1 -- 172.21.15.5:0/680425504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3588141e80 con 0x7f3588069840 2024-08-17T02:26:50.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.940+0000 7f3587e00640 1 -- 172.21.15.5:0/680425504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3588142440 con 0x7f3588069840 2024-08-17T02:26:50.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.941+0000 7f3587e00640 1 -- 172.21.15.5:0/680425504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3588070720 con 0x7f3588069840 2024-08-17T02:26:50.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.941+0000 7f357e000640 1 -- 172.21.15.5:0/680425504 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3578039040 con 0x7f3588069840 2024-08-17T02:26:50.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.942+0000 7f357e000640 1 --2- 172.21.15.5:0/680425504 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3564065180 0x7f3564067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.943+0000 7f357e000640 1 -- 172.21.15.5:0/680425504 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f35780a2660 con 0x7f3588069840 2024-08-17T02:26:50.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.943+0000 7f357fe00640 1 --2- 172.21.15.5:0/680425504 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3564065180 0x7f3564067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.943+0000 7f357fe00640 1 --2- 172.21.15.5:0/680425504 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3564065180 0x7f3564067630 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3588156960 tx=0x7f3570009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:50.947+0000 7f357e000640 1 -- 172.21.15.5:0/680425504 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3578070300 con 0x7f3588069840 2024-08-17T02:26:51.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.171+0000 7f3587e00640 1 -- 172.21.15.5:0/680425504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f358809b470 con 0x7f3588069840 2024-08-17T02:26:51.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.172+0000 7f357e000640 1 -- 172.21.15.5:0/680425504 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5678 (secure 0 0 0) 0x7f3578073920 con 0x7f3588069840 2024-08-17T02:26:51.174 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:26:51.174 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1398504310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1398504310},{"type":"v1","addr":"172.21.15.5:6837","nonce":1398504310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/1045077639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1045077639},{"type":"v1","addr":"172.21.15.87:6833","nonce":1045077639}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:31.652483+0000","modified":"2024-08-17T02:24:35.247786+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6836/1918940200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1918940200},{"type":"v1","addr":"172.21.15.5:6836","nonce":1918940200}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:44.295321+0000","modified":"2024-08-17T02:24:45.911915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4858},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4858":{"gid":4858,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.87:6835/1739323622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1739323622},{"type":"v1","addr":"172.21.15.87:6835","nonce":1739323622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001044363","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:26:51.174 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 20 2024-08-17T02:26:51.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.174+0000 7f3587e00640 1 -- 172.21.15.5:0/680425504 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3564065180 msgr2=0x7f3564067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.174+0000 7f3587e00640 1 --2- 172.21.15.5:0/680425504 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3564065180 0x7f3564067630 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3588156960 tx=0x7f3570009040 comp rx=0 tx=0).stop 2024-08-17T02:26:51.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.174+0000 7f3587e00640 1 -- 172.21.15.5:0/680425504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3588069840 msgr2=0x7f3588140e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.174+0000 7f3587e00640 1 --2- 172.21.15.5:0/680425504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3588069840 0x7f3588140e70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3578035040 tx=0x7f3578032000 comp rx=0 tx=0).stop 2024-08-17T02:26:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.174+0000 7f3587e00640 1 -- 172.21.15.5:0/680425504 shutdown_connections 2024-08-17T02:26:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.174+0000 7f3587e00640 1 --2- 172.21.15.5:0/680425504 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3564065180 0x7f3564067630 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.174+0000 7f3587e00640 1 --2- 172.21.15.5:0/680425504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35880cbe10 0x7f35881413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.174+0000 7f3587e00640 1 --2- 172.21.15.5:0/680425504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3588140960 0x7f3588156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.174+0000 7f3587e00640 1 --2- 172.21.15.5:0/680425504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3588069840 0x7f3588140e70 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.174+0000 7f3587e00640 1 -- 172.21.15.5:0/680425504 >> 172.21.15.5:0/680425504 conn(0x7f3588066e60 msgr2=0x7f358806baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.175+0000 7f3587e00640 1 -- 172.21.15.5:0/680425504 shutdown_connections 2024-08-17T02:26:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.175+0000 7f3587e00640 1 -- 172.21.15.5:0/680425504 wait complete. 2024-08-17T02:26:51.191 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:51.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.342+0000 7f4627e00640 1 Processor -- start 2024-08-17T02:26:51.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.342+0000 7f4627e00640 1 -- start start 2024-08-17T02:26:51.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.343+0000 7f4627e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4628158c60 0x7f462815a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.343+0000 7f4627e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4628159030 0x7f46280ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.343+0000 7f4627e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46280b1920 0x7f46280b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.343+0000 7f4627e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46280b0540 con 0x7f4628159030 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.343+0000 7f4627e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462815b6b0 con 0x7f4628158c60 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.343+0000 7f4627e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462815aac0 con 0x7f46280b1920 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.343+0000 7f461fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4628159030 0x7f46280ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.343+0000 7f461fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4628159030 0x7f46280ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40544/0 (socket says 172.21.15.5:40544) 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.343+0000 7f461fe00640 1 -- 172.21.15.5:0/1773014774 learned_addr learned my addr 172.21.15.5:0/1773014774 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.343+0000 7f4627400640 1 --2- 172.21.15.5:0/1773014774 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46280b1920 0x7f46280b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.344+0000 7f4626a00640 1 --2- 172.21.15.5:0/1773014774 >> v2:172.21.15.87:3300/0 conn(0x7f4628158c60 0x7f462815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.344+0000 7f461fe00640 1 -- 172.21.15.5:0/1773014774 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46280b1920 msgr2=0x7f46280b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.344+0000 7f461fe00640 1 --2- 172.21.15.5:0/1773014774 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46280b1920 0x7f46280b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.344+0000 7f461fe00640 1 -- 172.21.15.5:0/1773014774 >> v2:172.21.15.87:3300/0 conn(0x7f4628158c60 msgr2=0x7f462815a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:51.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.344+0000 7f461fe00640 1 --2- 172.21.15.5:0/1773014774 >> v2:172.21.15.87:3300/0 conn(0x7f4628158c60 0x7f462815a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.344+0000 7f461fe00640 1 -- 172.21.15.5:0/1773014774 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462815ad80 con 0x7f4628159030 2024-08-17T02:26:51.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.344+0000 7f4626a00640 1 --2- 172.21.15.5:0/1773014774 >> v2:172.21.15.87:3300/0 conn(0x7f4628158c60 0x7f462815a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:51.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.345+0000 7f461fe00640 1 --2- 172.21.15.5:0/1773014774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4628159030 0x7f46280ca8b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f46280889c0 tx=0x7f46100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dddfe51e34fa4a65 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.345+0000 7f4626000640 1 -- 172.21.15.5:0/1773014774 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461002ad40 con 0x7f4628159030 2024-08-17T02:26:51.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.345+0000 7f4626000640 1 -- 172.21.15.5:0/1773014774 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4610032440 con 0x7f4628159030 2024-08-17T02:26:51.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.345+0000 7f4626000640 1 -- 172.21.15.5:0/1773014774 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461002aea0 con 0x7f4628159030 2024-08-17T02:26:51.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.346+0000 7f4627e00640 1 -- 172.21.15.5:0/1773014774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4628159030 msgr2=0x7f46280ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.346+0000 7f4627e00640 1 --2- 172.21.15.5:0/1773014774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4628159030 0x7f46280ca8b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f46280889c0 tx=0x7f46100091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.346+0000 7f4627e00640 1 -- 172.21.15.5:0/1773014774 shutdown_connections 2024-08-17T02:26:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.346+0000 7f4627e00640 1 --2- 172.21.15.5:0/1773014774 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46280b1920 0x7f46280b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.346+0000 7f4627e00640 1 --2- 172.21.15.5:0/1773014774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4628159030 0x7f46280ca8b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.346+0000 7f4627e00640 1 --2- 172.21.15.5:0/1773014774 >> v2:172.21.15.87:3300/0 conn(0x7f4628158c60 0x7f462815a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.346+0000 7f4627e00640 1 -- 172.21.15.5:0/1773014774 >> 172.21.15.5:0/1773014774 conn(0x7f462806e590 msgr2=0x7f462806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.346+0000 7f4627e00640 1 -- 172.21.15.5:0/1773014774 shutdown_connections 2024-08-17T02:26:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.346+0000 7f4627e00640 1 -- 172.21.15.5:0/1773014774 wait complete. 2024-08-17T02:26:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.347+0000 7f4627e00640 1 Processor -- start 2024-08-17T02:26:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.347+0000 7f4627e00640 1 -- start start 2024-08-17T02:26:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.348+0000 7f4627e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46280b1920 0x7f462816c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.348+0000 7f4627e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4628158c60 0x7f46280c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.348+0000 7f4627e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4628159030 0x7f4628151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.348+0000 7f4627e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46280c5b60 con 0x7f46280b1920 2024-08-17T02:26:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.348+0000 7f4627e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462816cfa0 con 0x7f4628159030 2024-08-17T02:26:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.348+0000 7f4627e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462816d280 con 0x7f4628158c60 2024-08-17T02:26:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.349+0000 7f4626a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46280b1920 0x7f462816c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.349+0000 7f4626a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46280b1920 0x7f462816c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40550/0 (socket says 172.21.15.5:40550) 2024-08-17T02:26:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.349+0000 7f4626a00640 1 -- 172.21.15.5:0/1705352871 learned_addr learned my addr 172.21.15.5:0/1705352871 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:51.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.349+0000 7f461fe00640 1 --2- 172.21.15.5:0/1705352871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4628158c60 0x7f46280c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.349+0000 7f4627400640 1 --2- 172.21.15.5:0/1705352871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4628159030 0x7f4628151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.349+0000 7f4626a00640 1 -- 172.21.15.5:0/1705352871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4628158c60 msgr2=0x7f46280c5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.349+0000 7f4626a00640 1 --2- 172.21.15.5:0/1705352871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4628158c60 0x7f46280c5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.349+0000 7f4626a00640 1 -- 172.21.15.5:0/1705352871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4628159030 msgr2=0x7f4628151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.349+0000 7f4626a00640 1 --2- 172.21.15.5:0/1705352871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4628159030 0x7f4628151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.349+0000 7f4626a00640 1 -- 172.21.15.5:0/1705352871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4610009450 con 0x7f46280b1920 2024-08-17T02:26:51.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.349+0000 7f4627400640 1 --2- 172.21.15.5:0/1705352871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4628159030 0x7f4628151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:51.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.349+0000 7f4626a00640 1 --2- 172.21.15.5:0/1705352871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46280b1920 0x7f462816c980 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f461800d890 tx=0x7f4618008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.350+0000 7f461e000640 1 -- 172.21.15.5:0/1705352871 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461800de80 con 0x7f46280b1920 2024-08-17T02:26:51.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.350+0000 7f461e000640 1 -- 172.21.15.5:0/1705352871 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461800b8d0 con 0x7f46280b1920 2024-08-17T02:26:51.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.350+0000 7f461e000640 1 -- 172.21.15.5:0/1705352871 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461800bc90 con 0x7f46280b1920 2024-08-17T02:26:51.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.350+0000 7f4627e00640 1 -- 172.21.15.5:0/1705352871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462816d560 con 0x7f46280b1920 2024-08-17T02:26:51.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.350+0000 7f4627e00640 1 -- 172.21.15.5:0/1705352871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4628152520 con 0x7f46280b1920 2024-08-17T02:26:51.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.351+0000 7f4627e00640 1 -- 172.21.15.5:0/1705352871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46280cdd80 con 0x7f46280b1920 2024-08-17T02:26:51.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.352+0000 7f461e000640 1 -- 172.21.15.5:0/1705352871 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f461801e460 con 0x7f46280b1920 2024-08-17T02:26:51.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.353+0000 7f461e000640 1 --2- 172.21.15.5:0/1705352871 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4604065150 0x7f4604067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.353+0000 7f461e000640 1 -- 172.21.15.5:0/1705352871 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f4618082e40 con 0x7f46280b1920 2024-08-17T02:26:51.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.353+0000 7f461fe00640 1 --2- 172.21.15.5:0/1705352871 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4604065150 0x7f4604067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.354+0000 7f461fe00640 1 --2- 172.21.15.5:0/1705352871 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4604065150 0x7f4604067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4610034000 tx=0x7f4610032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.357+0000 7f461e000640 1 -- 172.21.15.5:0/1705352871 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4618054610 con 0x7f46280b1920 2024-08-17T02:26:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.538+0000 7f4627e00640 1 -- 172.21.15.5:0/1705352871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4628153580 con 0x7f46280b1920 2024-08-17T02:26:51.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.539+0000 7f461e000640 1 -- 172.21.15.5:0/1705352871 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18503 (secure 0 0 0) 0x7f46180541a0 con 0x7f46280b1920 2024-08-17T02:26:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:26:51.541 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":39,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:24:46.313823+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:29.724167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:30.637206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000001044363.meta","create_time":"2024-08-17T02:24:42.487826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001044363"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001044363.data","create_time":"2024-08-17T02:24:43.336536+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001044363"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:51.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.541+0000 7f4627e00640 1 -- 172.21.15.5:0/1705352871 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4604065150 msgr2=0x7f4604067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.541+0000 7f4627e00640 1 --2- 172.21.15.5:0/1705352871 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4604065150 0x7f4604067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4610034000 tx=0x7f4610032000 comp rx=0 tx=0).stop 2024-08-17T02:26:51.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.541+0000 7f4627e00640 1 -- 172.21.15.5:0/1705352871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46280b1920 msgr2=0x7f462816c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.541+0000 7f4627e00640 1 --2- 172.21.15.5:0/1705352871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46280b1920 0x7f462816c980 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f461800d890 tx=0x7f4618008040 comp rx=0 tx=0).stop 2024-08-17T02:26:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.541+0000 7f4627e00640 1 -- 172.21.15.5:0/1705352871 shutdown_connections 2024-08-17T02:26:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.541+0000 7f4627e00640 1 --2- 172.21.15.5:0/1705352871 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4604065150 0x7f4604067600 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.541+0000 7f4627e00640 1 --2- 172.21.15.5:0/1705352871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4628158c60 0x7f46280c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.541+0000 7f4627e00640 1 --2- 172.21.15.5:0/1705352871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4628159030 0x7f4628151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.541+0000 7f4627e00640 1 --2- 172.21.15.5:0/1705352871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46280b1920 0x7f462816c980 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.541+0000 7f4627e00640 1 -- 172.21.15.5:0/1705352871 >> 172.21.15.5:0/1705352871 conn(0x7f462806e590 msgr2=0x7f46280b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.541+0000 7f4627e00640 1 -- 172.21.15.5:0/1705352871 shutdown_connections 2024-08-17T02:26:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.542+0000 7f4627e00640 1 -- 172.21.15.5:0/1705352871 wait complete. 2024-08-17T02:26:51.559 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:26:51.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.709+0000 7f247f800640 1 Processor -- start 2024-08-17T02:26:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.709+0000 7f247f800640 1 -- start start 2024-08-17T02:26:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.710+0000 7f247f800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f24781590b0 0x7f24780b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.710+0000 7f247f800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24780c92b0 con 0x7f24780acf10 2024-08-17T02:26:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.710+0000 7f247f800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24780ad480 con 0x7f24780afca0 2024-08-17T02:26:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.710+0000 7f247f800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24780b0980 con 0x7f24781590b0 2024-08-17T02:26:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.711+0000 7f247d800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f24780acf10 0x7f24780c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48294/0 (socket says 172.21.15.5:48294) 2024-08-17T02:26:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.711+0000 7f247d800640 1 -- 172.21.15.5:0/981906267 learned_addr learned my addr 172.21.15.5:0/981906267 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:26:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.711+0000 7f2477e00640 1 --2- 172.21.15.5:0/981906267 >> v2:172.21.15.87:3300/0 conn(0x7f24781590b0 0x7f24780b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.711+0000 7f2477400640 1 -- 172.21.15.5:0/981906267 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874070871 0 0) 0x7f24780c92b0 con 0x7f24780acf10 2024-08-17T02:26:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.711+0000 7f2477400640 1 -- 172.21.15.5:0/981906267 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24600034e0 con 0x7f24780acf10 2024-08-17T02:26:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.711+0000 7f2477400640 1 -- 172.21.15.5:0/981906267 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366896703 0 0) 0x7f24780ad480 con 0x7f24780afca0 2024-08-17T02:26:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.711+0000 7f2477400640 1 -- 172.21.15.5:0/981906267 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24780c92b0 con 0x7f24780afca0 2024-08-17T02:26:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.711+0000 7f2477e00640 1 -- 172.21.15.5:0/981906267 >> v1:172.21.15.87:6789/0 conn(0x7f24780afca0 legacy=0x7f24781589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.711+0000 7f2477e00640 1 -- 172.21.15.5:0/981906267 >> v1:172.21.15.5:6789/0 conn(0x7f24780acf10 legacy=0x7f24780c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.711+0000 7f2477e00640 1 -- 172.21.15.5:0/981906267 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24780ad760 con 0x7f24781590b0 2024-08-17T02:26:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.712+0000 7f2477e00640 1 --2- 172.21.15.5:0/981906267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24781590b0 0x7f24780b0070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2464009850 tx=0x7f24640090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f256db30ff4939e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.713+0000 7f2477400640 1 -- 172.21.15.5:0/981906267 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246402ae20 con 0x7f24781590b0 2024-08-17T02:26:51.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.713+0000 7f2477400640 1 -- 172.21.15.5:0/981906267 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2464032440 con 0x7f24781590b0 2024-08-17T02:26:51.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.713+0000 7f2477400640 1 -- 172.21.15.5:0/981906267 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24640327e0 con 0x7f24781590b0 2024-08-17T02:26:51.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.713+0000 7f247f800640 1 -- 172.21.15.5:0/981906267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24781590b0 msgr2=0x7f24780b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.713+0000 7f247f800640 1 --2- 172.21.15.5:0/981906267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24781590b0 0x7f24780b0070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2464009850 tx=0x7f24640090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.713+0000 7f247f800640 1 -- 172.21.15.5:0/981906267 shutdown_connections 2024-08-17T02:26:51.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.713+0000 7f247f800640 1 --2- 172.21.15.5:0/981906267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24781590b0 0x7f24780b0070 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.713+0000 7f247f800640 1 -- 172.21.15.5:0/981906267 >> 172.21.15.5:0/981906267 conn(0x7f2478066e60 msgr2=0x7f2478067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:51.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.713+0000 7f247f800640 1 -- 172.21.15.5:0/981906267 shutdown_connections 2024-08-17T02:26:51.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.713+0000 7f247f800640 1 -- 172.21.15.5:0/981906267 wait complete. 2024-08-17T02:26:51.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.715+0000 7f247f800640 1 Processor -- start 2024-08-17T02:26:51.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.715+0000 7f247f800640 1 -- start start 2024-08-17T02:26:51.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.716+0000 7f247f800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24780acf10 0x7f24780cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.716+0000 7f247f800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24780afca0 0x7f247813ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.716+0000 7f247f800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24781590b0 0x7f24781404c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.716+0000 7f247f800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247814df70 con 0x7f24781590b0 2024-08-17T02:26:51.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.716+0000 7f247f800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2478167260 con 0x7f24780acf10 2024-08-17T02:26:51.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.716+0000 7f247f800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2478167540 con 0x7f24780afca0 2024-08-17T02:26:51.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.716+0000 7f247d800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24781590b0 0x7f24781404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.716+0000 7f247d800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24781590b0 0x7f24781404c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40564/0 (socket says 172.21.15.5:40564) 2024-08-17T02:26:51.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.716+0000 7f247d800640 1 -- 172.21.15.5:0/996068877 learned_addr learned my addr 172.21.15.5:0/996068877 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:51.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.716+0000 7f2477e00640 1 --2- 172.21.15.5:0/996068877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24780afca0 0x7f247813ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.716+0000 7f247ce00640 1 --2- 172.21.15.5:0/996068877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24780acf10 0x7f24780cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.717+0000 7f247d800640 1 -- 172.21.15.5:0/996068877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24780afca0 msgr2=0x7f247813ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.717+0000 7f247d800640 1 --2- 172.21.15.5:0/996068877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24780afca0 0x7f247813ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.717+0000 7f247d800640 1 -- 172.21.15.5:0/996068877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24780acf10 msgr2=0x7f24780cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.717+0000 7f247d800640 1 --2- 172.21.15.5:0/996068877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24780acf10 0x7f24780cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.717+0000 7f247d800640 1 -- 172.21.15.5:0/996068877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2464009390 con 0x7f24781590b0 2024-08-17T02:26:51.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.717+0000 7f247ce00640 1 --2- 172.21.15.5:0/996068877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24780acf10 0x7f24780cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:51.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.717+0000 7f247d800640 1 --2- 172.21.15.5:0/996068877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24781590b0 0x7f24781404c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f247000cc60 tx=0x7f2470001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.717+0000 7f246be00640 1 -- 172.21.15.5:0/996068877 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247000ce80 con 0x7f24781590b0 2024-08-17T02:26:51.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.717+0000 7f246be00640 1 -- 172.21.15.5:0/996068877 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247000a850 con 0x7f24781590b0 2024-08-17T02:26:51.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.717+0000 7f246be00640 1 -- 172.21.15.5:0/996068877 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247000ac10 con 0x7f24781590b0 2024-08-17T02:26:51.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.717+0000 7f247f800640 1 -- 172.21.15.5:0/996068877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2478167820 con 0x7f24781590b0 2024-08-17T02:26:51.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.717+0000 7f247f800640 1 -- 172.21.15.5:0/996068877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2478167d40 con 0x7f24781590b0 2024-08-17T02:26:51.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.718+0000 7f247f800640 1 -- 172.21.15.5:0/996068877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2478167a10 con 0x7f24781590b0 2024-08-17T02:26:51.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.719+0000 7f246be00640 1 -- 172.21.15.5:0/996068877 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2470007300 con 0x7f24781590b0 2024-08-17T02:26:51.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.720+0000 7f246be00640 1 --2- 172.21.15.5:0/996068877 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2458065150 0x7f2458067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.720+0000 7f246be00640 1 -- 172.21.15.5:0/996068877 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f2470082980 con 0x7f24781590b0 2024-08-17T02:26:51.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.720+0000 7f247ce00640 1 --2- 172.21.15.5:0/996068877 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2458065150 0x7f2458067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.721+0000 7f247ce00640 1 --2- 172.21.15.5:0/996068877 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2458065150 0x7f2458067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f246c003900 tx=0x7f246c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.724+0000 7f246be00640 1 -- 172.21.15.5:0/996068877 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f24700506a0 con 0x7f24781590b0 2024-08-17T02:26:51.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.944+0000 7f247f800640 1 -- 172.21.15.5:0/996068877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2478063fb0 con 0x7f24781590b0 2024-08-17T02:26:51.945 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-17T02:26:51.944+0000 7f09ca200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:26:51.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.949+0000 7f246be00640 1 -- 172.21.15.5:0/996068877 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2470053cc0 con 0x7f24781590b0 2024-08-17T02:26:51.951 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:26:51.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.952+0000 7f247f800640 1 -- 172.21.15.5:0/996068877 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2458065150 msgr2=0x7f2458067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.952+0000 7f247f800640 1 --2- 172.21.15.5:0/996068877 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2458065150 0x7f2458067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f246c003900 tx=0x7f246c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.952+0000 7f247f800640 1 -- 172.21.15.5:0/996068877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24781590b0 msgr2=0x7f24781404c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.952+0000 7f247f800640 1 --2- 172.21.15.5:0/996068877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24781590b0 0x7f24781404c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f247000cc60 tx=0x7f2470001ae0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.952+0000 7f247f800640 1 -- 172.21.15.5:0/996068877 shutdown_connections 2024-08-17T02:26:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.952+0000 7f247f800640 1 --2- 172.21.15.5:0/996068877 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2458065150 0x7f2458067600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.952+0000 7f247f800640 1 --2- 172.21.15.5:0/996068877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24780afca0 0x7f247813ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.952+0000 7f247f800640 1 --2- 172.21.15.5:0/996068877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24781590b0 0x7f24781404c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.952+0000 7f247f800640 1 --2- 172.21.15.5:0/996068877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24780acf10 0x7f24780cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.952+0000 7f247f800640 1 -- 172.21.15.5:0/996068877 >> 172.21.15.5:0/996068877 conn(0x7f2478066e60 msgr2=0x7f24780c9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.952+0000 7f247f800640 1 -- 172.21.15.5:0/996068877 shutdown_connections 2024-08-17T02:26:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:51.952+0000 7f247f800640 1 -- 172.21.15.5:0/996068877 wait complete. 2024-08-17T02:26:51.960 INFO:tasks.ceph.mds.a.smithi005.stderr: -8391> 2024-08-17T02:24:17.311+0000 7f5f17e00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-08-17T02:26:51.962 INFO:tasks.ceph.mds.a.smithi005.stderr: -7278> 2024-08-17T02:24:34.120+0000 7f5f10600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:26:51.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:26:52.009 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-17T02:26:52.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.127+0000 7fca5e600640 1 Processor -- start 2024-08-17T02:26:52.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.127+0000 7fca5e600640 1 -- start start 2024-08-17T02:26:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.128+0000 7fca5e600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca580acf10 0x7fca580b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.128+0000 7fca5e600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca580c92b0 con 0x7fca581590b0 2024-08-17T02:26:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.128+0000 7fca5e600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca580ad480 con 0x7fca580afca0 2024-08-17T02:26:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.128+0000 7fca5e600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca580b0980 con 0x7fca580acf10 2024-08-17T02:26:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.129+0000 7fca4fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fca581590b0 0x7fca580c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48310/0 (socket says 172.21.15.5:48310) 2024-08-17T02:26:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.129+0000 7fca4fe00640 1 -- 172.21.15.5:0/3022005910 learned_addr learned my addr 172.21.15.5:0/3022005910 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:26:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.129+0000 7fca57e00640 1 --2- 172.21.15.5:0/3022005910 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca580acf10 0x7fca580b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.129+0000 7fca56a00640 1 -- 172.21.15.5:0/3022005910 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684060250 0 0) 0x7fca580c92b0 con 0x7fca581590b0 2024-08-17T02:26:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.129+0000 7fca56a00640 1 -- 172.21.15.5:0/3022005910 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca3c0034e0 con 0x7fca581590b0 2024-08-17T02:26:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.129+0000 7fca56a00640 1 -- 172.21.15.5:0/3022005910 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206730892 0 0) 0x7fca580ad480 con 0x7fca580afca0 2024-08-17T02:26:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.129+0000 7fca56a00640 1 -- 172.21.15.5:0/3022005910 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca580c92b0 con 0x7fca580afca0 2024-08-17T02:26:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.129+0000 7fca56a00640 1 -- 172.21.15.5:0/3022005910 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3372476721 0 0) 0x7fca3c0034e0 con 0x7fca581590b0 2024-08-17T02:26:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.130+0000 7fca57e00640 1 -- 172.21.15.5:0/3022005910 >> v1:172.21.15.87:6789/0 conn(0x7fca580afca0 legacy=0x7fca581589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.130+0000 7fca57e00640 1 -- 172.21.15.5:0/3022005910 >> v1:172.21.15.5:6789/0 conn(0x7fca581590b0 legacy=0x7fca580c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.130+0000 7fca57e00640 1 -- 172.21.15.5:0/3022005910 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca580ad760 con 0x7fca580acf10 2024-08-17T02:26:52.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.131+0000 7fca57e00640 1 --2- 172.21.15.5:0/3022005910 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca580acf10 0x7fca580b0070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fca50009e90 tx=0x7fca50009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37eb62d51d9e4d3a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.131+0000 7fca56a00640 1 -- 172.21.15.5:0/3022005910 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40001470 con 0x7fca580acf10 2024-08-17T02:26:52.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.131+0000 7fca56a00640 1 -- 172.21.15.5:0/3022005910 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5002d050 con 0x7fca580acf10 2024-08-17T02:26:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.131+0000 7fca56a00640 1 -- 172.21.15.5:0/3022005910 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50031630 con 0x7fca580acf10 2024-08-17T02:26:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.132+0000 7fca5e600640 1 -- 172.21.15.5:0/3022005910 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca580acf10 msgr2=0x7fca580b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.132+0000 7fca5e600640 1 --2- 172.21.15.5:0/3022005910 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca580acf10 0x7fca580b0070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fca50009e90 tx=0x7fca50009780 comp rx=0 tx=0).stop 2024-08-17T02:26:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.132+0000 7fca5e600640 1 -- 172.21.15.5:0/3022005910 shutdown_connections 2024-08-17T02:26:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.132+0000 7fca5e600640 1 --2- 172.21.15.5:0/3022005910 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca580acf10 0x7fca580b0070 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.132+0000 7fca5e600640 1 -- 172.21.15.5:0/3022005910 >> 172.21.15.5:0/3022005910 conn(0x7fca58066e60 msgr2=0x7fca58067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.132+0000 7fca5e600640 1 -- 172.21.15.5:0/3022005910 shutdown_connections 2024-08-17T02:26:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.132+0000 7fca5e600640 1 -- 172.21.15.5:0/3022005910 wait complete. 2024-08-17T02:26:52.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.133+0000 7fca5e600640 1 Processor -- start 2024-08-17T02:26:52.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.134+0000 7fca5e600640 1 -- start start 2024-08-17T02:26:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.134+0000 7fca5e600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca580acf10 0x7fca580c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.134+0000 7fca5e600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca580afca0 0x7fca580c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.134+0000 7fca5e600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca581590b0 0x7fca58156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.134+0000 7fca5e600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca580c6710 con 0x7fca580afca0 2024-08-17T02:26:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.134+0000 7fca5e600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca580c69f0 con 0x7fca581590b0 2024-08-17T02:26:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.134+0000 7fca5e600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca580c6cd0 con 0x7fca580acf10 2024-08-17T02:26:52.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.135+0000 7fca4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca580afca0 0x7fca580c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.135+0000 7fca57400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca580acf10 0x7fca580c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.135+0000 7fca57e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca581590b0 0x7fca58156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.135+0000 7fca4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca580afca0 0x7fca580c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40586/0 (socket says 172.21.15.5:40586) 2024-08-17T02:26:52.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.135+0000 7fca4fe00640 1 -- 172.21.15.5:0/4271744501 learned_addr learned my addr 172.21.15.5:0/4271744501 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.135+0000 7fca4fe00640 1 -- 172.21.15.5:0/4271744501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca580acf10 msgr2=0x7fca580c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.135+0000 7fca4fe00640 1 --2- 172.21.15.5:0/4271744501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca580acf10 0x7fca580c5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.135+0000 7fca4fe00640 1 -- 172.21.15.5:0/4271744501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca581590b0 msgr2=0x7fca58156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.135+0000 7fca4fe00640 1 --2- 172.21.15.5:0/4271744501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca581590b0 0x7fca58156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.135+0000 7fca4fe00640 1 -- 172.21.15.5:0/4271744501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca50009a20 con 0x7fca580afca0 2024-08-17T02:26:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.136+0000 7fca4fe00640 1 --2- 172.21.15.5:0/4271744501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca580afca0 0x7fca580c6100 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fca4000cb60 tx=0x7fca40001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.136+0000 7fca4ea00640 1 -- 172.21.15.5:0/4271744501 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40005aa0 con 0x7fca580afca0 2024-08-17T02:26:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.136+0000 7fca4ea00640 1 -- 172.21.15.5:0/4271744501 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca40005c00 con 0x7fca580afca0 2024-08-17T02:26:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.136+0000 7fca5e600640 1 -- 172.21.15.5:0/4271744501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca580c6fb0 con 0x7fca580afca0 2024-08-17T02:26:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.136+0000 7fca4ea00640 1 -- 172.21.15.5:0/4271744501 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca400070f0 con 0x7fca580afca0 2024-08-17T02:26:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.136+0000 7fca5e600640 1 -- 172.21.15.5:0/4271744501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca58154bf0 con 0x7fca580afca0 2024-08-17T02:26:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.137+0000 7fca5e600640 1 -- 172.21.15.5:0/4271744501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca58063fb0 con 0x7fca580afca0 2024-08-17T02:26:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.138+0000 7fca4ea00640 1 -- 172.21.15.5:0/4271744501 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fca400074a0 con 0x7fca580afca0 2024-08-17T02:26:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.139+0000 7fca4ea00640 1 --2- 172.21.15.5:0/4271744501 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fca34065150 0x7fca34067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.139+0000 7fca4ea00640 1 -- 172.21.15.5:0/4271744501 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6689+0+0 (secure 0 0 0) 0x7fca40082510 con 0x7fca580afca0 2024-08-17T02:26:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.139+0000 7fca57400640 1 --2- 172.21.15.5:0/4271744501 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fca34065150 0x7fca34067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.140+0000 7fca57400640 1 --2- 172.21.15.5:0/4271744501 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fca34065150 0x7fca34067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fca48003a10 tx=0x7fca48007cc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.143+0000 7fca4ea00640 1 -- 172.21.15.5:0/4271744501 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fca40050280 con 0x7fca580afca0 2024-08-17T02:26:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.364+0000 7fca5e600640 1 -- 172.21.15.5:0/4271744501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fca580b02c0 con 0x7fca580afca0 2024-08-17T02:26:52.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.950+0000 7fca4ea00640 1 -- 172.21.15.5:0/4271744501 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7fca400538a0 con 0x7fca580afca0 2024-08-17T02:26:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.953+0000 7fca5e600640 1 -- 172.21.15.5:0/4271744501 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fca34065150 msgr2=0x7fca34067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.953+0000 7fca5e600640 1 --2- 172.21.15.5:0/4271744501 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fca34065150 0x7fca34067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fca48003a10 tx=0x7fca48007cc0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.953+0000 7fca5e600640 1 -- 172.21.15.5:0/4271744501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca580afca0 msgr2=0x7fca580c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.953+0000 7fca5e600640 1 --2- 172.21.15.5:0/4271744501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca580afca0 0x7fca580c6100 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fca4000cb60 tx=0x7fca40001a30 comp rx=0 tx=0).stop 2024-08-17T02:26:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.953+0000 7fca5e600640 1 -- 172.21.15.5:0/4271744501 shutdown_connections 2024-08-17T02:26:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.953+0000 7fca5e600640 1 --2- 172.21.15.5:0/4271744501 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fca34065150 0x7fca34067600 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.953+0000 7fca5e600640 1 --2- 172.21.15.5:0/4271744501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca581590b0 0x7fca58156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.953+0000 7fca5e600640 1 --2- 172.21.15.5:0/4271744501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca580afca0 0x7fca580c6100 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.953+0000 7fca5e600640 1 --2- 172.21.15.5:0/4271744501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca580acf10 0x7fca580c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.953+0000 7fca5e600640 1 -- 172.21.15.5:0/4271744501 >> 172.21.15.5:0/4271744501 conn(0x7fca58066e60 msgr2=0x7fca580c9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.953+0000 7fca5e600640 1 -- 172.21.15.5:0/4271744501 shutdown_connections 2024-08-17T02:26:52.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:52.953+0000 7fca5e600640 1 -- 172.21.15.5:0/4271744501 wait complete. 2024-08-17T02:26:52.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:26:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.169+0000 7f150b200640 1 Processor -- start 2024-08-17T02:26:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.169+0000 7f150b200640 1 -- start start 2024-08-17T02:26:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f150b200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f150c068590 0x7f150c068a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f150b200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150c0b5b20 con 0x7f150c15a2e0 2024-08-17T02:26:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f150b200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150c15b400 con 0x7f150c1588d0 2024-08-17T02:26:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f150b200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c068f70 con 0x7f150c068590 2024-08-17T02:26:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1503e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f150c15a2e0 0x7f150c158ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48316/0 (socket says 172.21.15.5:48316) 2024-08-17T02:26:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1503e00640 1 -- 172.21.15.5:0/3711312031 learned_addr learned my addr 172.21.15.5:0/3711312031 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:26:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f150a800640 1 --2- 172.21.15.5:0/3711312031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f150c068590 0x7f150c068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1509400640 1 -- 172.21.15.5:0/3711312031 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574368826 0 0) 0x7f150c0b5b20 con 0x7f150c15a2e0 2024-08-17T02:26:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1509400640 1 -- 172.21.15.5:0/3711312031 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14f00034e0 con 0x7f150c15a2e0 2024-08-17T02:26:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1509400640 1 -- 172.21.15.5:0/3711312031 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076075625 0 0) 0x7f150c15b400 con 0x7f150c1588d0 2024-08-17T02:26:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1509400640 1 -- 172.21.15.5:0/3711312031 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f150c0b5b20 con 0x7f150c1588d0 2024-08-17T02:26:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1509400640 1 -- 172.21.15.5:0/3711312031 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3629615109 0 0) 0x7f14f00034e0 con 0x7f150c15a2e0 2024-08-17T02:26:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1509400640 1 -- 172.21.15.5:0/3711312031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f150c068590 msgr2=0x7f150c068a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1509400640 1 --2- 172.21.15.5:0/3711312031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f150c068590 0x7f150c068a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1509400640 1 -- 172.21.15.5:0/3711312031 >> v1:172.21.15.87:6789/0 conn(0x7f150c1588d0 legacy=0x7f150c156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1509400640 1 -- 172.21.15.5:0/3711312031 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c15a7f0 con 0x7f150c15a2e0 2024-08-17T02:26:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1509400640 1 -- 172.21.15.5:0/3711312031 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2658686246 0 0) 0x7f14f4001470 con 0x7f150c15a2e0 2024-08-17T02:26:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1509400640 1 -- 172.21.15.5:0/3711312031 >> v1:172.21.15.5:6789/0 conn(0x7f150c15a2e0 legacy=0x7f150c158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1509400640 1 --2- 172.21.15.5:0/3711312031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14f0003b90 0x7f14f0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1509400640 1 --2- 172.21.15.5:0/3711312031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14f0004780 0x7f14f0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1509400640 1 --2- 172.21.15.5:0/3711312031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f150c068590 0x7f14f0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1509400640 1 -- 172.21.15.5:0/3711312031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c068f70 con 0x7f14f0003b90 2024-08-17T02:26:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1509400640 1 -- 172.21.15.5:0/3711312031 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f000bb60 con 0x7f14f0004780 2024-08-17T02:26:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1509400640 1 -- 172.21.15.5:0/3711312031 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f000bd20 con 0x7f150c068590 2024-08-17T02:26:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.171+0000 7f1509e00640 1 --2- 172.21.15.5:0/3711312031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14f0003b90 0x7f14f0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.172+0000 7f1503e00640 1 --2- 172.21.15.5:0/3711312031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14f0004780 0x7f14f0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.172+0000 7f150a800640 1 --2- 172.21.15.5:0/3711312031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f150c068590 0x7f14f0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.172+0000 7f1509e00640 1 -- 172.21.15.5:0/3711312031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f150c068590 msgr2=0x7f14f0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.172+0000 7f1509e00640 1 --2- 172.21.15.5:0/3711312031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f150c068590 0x7f14f0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.172+0000 7f1509e00640 1 -- 172.21.15.5:0/3711312031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14f0004780 msgr2=0x7f14f0004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.172+0000 7f1509e00640 1 --2- 172.21.15.5:0/3711312031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14f0004780 0x7f14f0004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.172+0000 7f1509e00640 1 -- 172.21.15.5:0/3711312031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f00034e0 con 0x7f14f0003b90 2024-08-17T02:26:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.173+0000 7f1509e00640 1 --2- 172.21.15.5:0/3711312031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14f0003b90 0x7f14f0003f80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f14fc001960 tx=0x7f14fc007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3d47f45b8ba704 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.173+0000 7f1509400640 1 -- 172.21.15.5:0/3711312031 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc02aa70 con 0x7f14f0003b90 2024-08-17T02:26:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.173+0000 7f1509400640 1 -- 172.21.15.5:0/3711312031 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14fc02abd0 con 0x7f14f0003b90 2024-08-17T02:26:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.173+0000 7f1509400640 1 -- 172.21.15.5:0/3711312031 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0323f0 con 0x7f14f0003b90 2024-08-17T02:26:53.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.174+0000 7f150b200640 1 -- 172.21.15.5:0/3711312031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14f0003b90 msgr2=0x7f14f0003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.174+0000 7f150b200640 1 --2- 172.21.15.5:0/3711312031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14f0003b90 0x7f14f0003f80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f14fc001960 tx=0x7f14fc007ca0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.174+0000 7f150a800640 1 -- 172.21.15.5:0/3711312031 reap_dead start 2024-08-17T02:26:53.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.174+0000 7f150b200640 1 -- 172.21.15.5:0/3711312031 shutdown_connections 2024-08-17T02:26:53.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.174+0000 7f150b200640 1 -- 172.21.15.5:0/3711312031 >> 172.21.15.5:0/3711312031 conn(0x7f150c087a70 msgr2=0x7f150c06e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.174+0000 7f150b200640 1 -- 172.21.15.5:0/3711312031 shutdown_connections 2024-08-17T02:26:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.174+0000 7f150b200640 1 -- 172.21.15.5:0/3711312031 wait complete. 2024-08-17T02:26:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.175+0000 7f150b200640 1 Processor -- start 2024-08-17T02:26:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.175+0000 7f150b200640 1 -- start start 2024-08-17T02:26:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.176+0000 7f150b200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14f0003b90 0x7f150c0c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.176+0000 7f150b200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f150c0b4510 0x7f150c16d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.176+0000 7f150b200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f150c0cab70 0x7f150c0c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.176+0000 7f150b200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c0c57e0 con 0x7f150c0b4510 2024-08-17T02:26:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.176+0000 7f150b200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c16d7b0 con 0x7f150c0cab70 2024-08-17T02:26:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.176+0000 7f150b200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c0ca6e0 con 0x7f14f0003b90 2024-08-17T02:26:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.176+0000 7f1503e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f150c0b4510 0x7f150c16d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.176+0000 7f1503e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f150c0b4510 0x7f150c16d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40602/0 (socket says 172.21.15.5:40602) 2024-08-17T02:26:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.176+0000 7f1503e00640 1 -- 172.21.15.5:0/1847636940 learned_addr learned my addr 172.21.15.5:0/1847636940 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.177+0000 7f1509e00640 1 --2- 172.21.15.5:0/1847636940 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14f0003b90 0x7f150c0c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.177+0000 7f150a800640 1 --2- 172.21.15.5:0/1847636940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f150c0cab70 0x7f150c0c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.177+0000 7f1503e00640 1 -- 172.21.15.5:0/1847636940 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14f0003b90 msgr2=0x7f150c0c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.177+0000 7f1503e00640 1 --2- 172.21.15.5:0/1847636940 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14f0003b90 0x7f150c0c5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.177+0000 7f1503e00640 1 -- 172.21.15.5:0/1847636940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f150c0cab70 msgr2=0x7f150c0c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.177+0000 7f1503e00640 1 --2- 172.21.15.5:0/1847636940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f150c0cab70 0x7f150c0c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.177+0000 7f1503e00640 1 -- 172.21.15.5:0/1847636940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c0c9b10 con 0x7f150c0b4510 2024-08-17T02:26:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.177+0000 7f1503e00640 1 --2- 172.21.15.5:0/1847636940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f150c0b4510 0x7f150c16d270 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f14f4000fd0 tx=0x7f14f4001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.177+0000 7f1501600640 1 -- 172.21.15.5:0/1847636940 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f4018030 con 0x7f150c0b4510 2024-08-17T02:26:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.177+0000 7f1501600640 1 -- 172.21.15.5:0/1847636940 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f4000cd0 con 0x7f150c0b4510 2024-08-17T02:26:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.177+0000 7f1501600640 1 -- 172.21.15.5:0/1847636940 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f400fac0 con 0x7f150c0b4510 2024-08-17T02:26:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.177+0000 7f150b200640 1 -- 172.21.15.5:0/1847636940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150c0b4980 con 0x7f150c0b4510 2024-08-17T02:26:53.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.178+0000 7f150b200640 1 -- 172.21.15.5:0/1847636940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150c0ca090 con 0x7f150c0b4510 2024-08-17T02:26:53.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.179+0000 7f150b200640 1 -- 172.21.15.5:0/1847636940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150c063f10 con 0x7f150c0b4510 2024-08-17T02:26:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.179+0000 7f1501600640 1 -- 172.21.15.5:0/1847636940 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f14f401b070 con 0x7f150c0b4510 2024-08-17T02:26:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.180+0000 7f1501600640 1 --2- 172.21.15.5:0/1847636940 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14e8065180 0x7f14e8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.180+0000 7f1501600640 1 -- 172.21.15.5:0/1847636940 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f14f4019070 con 0x7f150c0b4510 2024-08-17T02:26:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.181+0000 7f1509e00640 1 --2- 172.21.15.5:0/1847636940 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14e8065180 0x7f14e8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.181+0000 7f1509e00640 1 --2- 172.21.15.5:0/1847636940 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14e8065180 0x7f14e8067630 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f14fc032000 tx=0x7f14fc003000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.184+0000 7f1501600640 1 -- 172.21.15.5:0/1847636940 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f14f4053c50 con 0x7f150c0b4510 2024-08-17T02:26:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:53.371+0000 7f150b200640 1 -- 172.21.15.5:0/1847636940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f150c0ca820 con 0x7f150c0b4510 2024-08-17T02:26:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:26:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.036+0000 7f1501600640 1 -- 172.21.15.5:0/1847636940 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) v1 ==== 181+0+0 (secure 0 0 0) 0x7f14f40537e0 con 0x7f150c0b4510 2024-08-17T02:26:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.040+0000 7f150b200640 1 -- 172.21.15.5:0/1847636940 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14e8065180 msgr2=0x7f14e8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.040+0000 7f150b200640 1 --2- 172.21.15.5:0/1847636940 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14e8065180 0x7f14e8067630 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f14fc032000 tx=0x7f14fc003000 comp rx=0 tx=0).stop 2024-08-17T02:26:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.040+0000 7f150b200640 1 -- 172.21.15.5:0/1847636940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f150c0b4510 msgr2=0x7f150c16d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.040+0000 7f150b200640 1 --2- 172.21.15.5:0/1847636940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f150c0b4510 0x7f150c16d270 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f14f4000fd0 tx=0x7f14f4001d20 comp rx=0 tx=0).stop 2024-08-17T02:26:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.040+0000 7f150b200640 1 -- 172.21.15.5:0/1847636940 shutdown_connections 2024-08-17T02:26:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.040+0000 7f150b200640 1 --2- 172.21.15.5:0/1847636940 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f14e8065180 0x7f14e8067630 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.040+0000 7f150b200640 1 --2- 172.21.15.5:0/1847636940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f150c0cab70 0x7f150c0c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.040+0000 7f150b200640 1 --2- 172.21.15.5:0/1847636940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f150c0b4510 0x7f150c16d270 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.040+0000 7f150b200640 1 --2- 172.21.15.5:0/1847636940 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14f0003b90 0x7f150c0c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.040+0000 7f150b200640 1 -- 172.21.15.5:0/1847636940 >> 172.21.15.5:0/1847636940 conn(0x7f150c087a70 msgr2=0x7f150c159b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.040+0000 7f150b200640 1 -- 172.21.15.5:0/1847636940 shutdown_connections 2024-08-17T02:26:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.040+0000 7f150b200640 1 -- 172.21.15.5:0/1847636940 wait complete. 2024-08-17T02:26:54.060 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:26:54.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.217+0000 7f3430e00640 1 Processor -- start 2024-08-17T02:26:54.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.217+0000 7f3430e00640 1 -- start start 2024-08-17T02:26:54.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.219+0000 7f3430e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f342c0add70 0x7f342c0ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.219+0000 7f3430e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342c1582b0 con 0x7f342c156a90 2024-08-17T02:26:54.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.219+0000 7f3430e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342c0ca110 con 0x7f342c0aed30 2024-08-17T02:26:54.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.219+0000 7f3430e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342c0c9f80 con 0x7f342c0add70 2024-08-17T02:26:54.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.219+0000 7f3429e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f342c156a90 0x7f342c0ad660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48330/0 (socket says 172.21.15.5:48330) 2024-08-17T02:26:54.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.219+0000 7f3429e00640 1 -- 172.21.15.5:0/2430186748 learned_addr learned my addr 172.21.15.5:0/2430186748 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:26:54.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.219+0000 7f3421400640 1 --2- 172.21.15.5:0/2430186748 >> v2:172.21.15.87:3300/0 conn(0x7f342c0add70 0x7f342c0ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.219+0000 7f3429400640 1 -- 172.21.15.5:0/2430186748 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925724492 0 0) 0x7f342c1582b0 con 0x7f342c156a90 2024-08-17T02:26:54.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.219+0000 7f3429400640 1 -- 172.21.15.5:0/2430186748 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34100034e0 con 0x7f342c156a90 2024-08-17T02:26:54.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.220+0000 7f3429400640 1 -- 172.21.15.5:0/2430186748 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963838642 0 0) 0x7f342c0ca110 con 0x7f342c0aed30 2024-08-17T02:26:54.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.220+0000 7f3429400640 1 -- 172.21.15.5:0/2430186748 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f342c1582b0 con 0x7f342c0aed30 2024-08-17T02:26:54.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.220+0000 7f3421400640 1 -- 172.21.15.5:0/2430186748 >> v1:172.21.15.87:6789/0 conn(0x7f342c0aed30 legacy=0x7f342c0ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.220+0000 7f3421400640 1 -- 172.21.15.5:0/2430186748 >> v1:172.21.15.5:6789/0 conn(0x7f342c156a90 legacy=0x7f342c0ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.220+0000 7f3429400640 1 -- 172.21.15.5:0/2430186748 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 497955838 0 0) 0x7f34100034e0 con 0x7f342c156a90 2024-08-17T02:26:54.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.220+0000 7f3421400640 1 -- 172.21.15.5:0/2430186748 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c0af4b0 con 0x7f342c0add70 2024-08-17T02:26:54.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.221+0000 7f3421400640 1 --2- 172.21.15.5:0/2430186748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c0add70 0x7f342c0ae7f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3414009850 tx=0x7f34140090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7901053a7ffa36c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.221+0000 7f3429400640 1 -- 172.21.15.5:0/2430186748 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c001470 con 0x7f342c0add70 2024-08-17T02:26:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.221+0000 7f3429400640 1 -- 172.21.15.5:0/2430186748 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341402ab00 con 0x7f342c0add70 2024-08-17T02:26:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.221+0000 7f3429400640 1 -- 172.21.15.5:0/2430186748 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341402ae80 con 0x7f342c0add70 2024-08-17T02:26:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.222+0000 7f3430e00640 1 -- 172.21.15.5:0/2430186748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c0add70 msgr2=0x7f342c0ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.222+0000 7f3430e00640 1 --2- 172.21.15.5:0/2430186748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c0add70 0x7f342c0ae7f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3414009850 tx=0x7f34140090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.222+0000 7f3430e00640 1 -- 172.21.15.5:0/2430186748 shutdown_connections 2024-08-17T02:26:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.222+0000 7f3430e00640 1 --2- 172.21.15.5:0/2430186748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c0add70 0x7f342c0ae7f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.222+0000 7f3430e00640 1 -- 172.21.15.5:0/2430186748 >> 172.21.15.5:0/2430186748 conn(0x7f342c066e60 msgr2=0x7f342c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.222+0000 7f3430e00640 1 -- 172.21.15.5:0/2430186748 shutdown_connections 2024-08-17T02:26:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.222+0000 7f3430e00640 1 -- 172.21.15.5:0/2430186748 wait complete. 2024-08-17T02:26:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.223+0000 7f3430e00640 1 Processor -- start 2024-08-17T02:26:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.223+0000 7f3430e00640 1 -- start start 2024-08-17T02:26:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.224+0000 7f3430e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f342c0add70 0x7f342c144200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.224+0000 7f3430e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f342c0aed30 0x7f342c1595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.224+0000 7f3430e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c156a90 0x7f342c159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.224+0000 7f3430e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c0a7830 con 0x7f342c0add70 2024-08-17T02:26:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.224+0000 7f3430e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c0a50a0 con 0x7f342c156a90 2024-08-17T02:26:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.224+0000 7f3430e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342c0a44d0 con 0x7f342c0aed30 2024-08-17T02:26:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.224+0000 7f3429e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f342c0add70 0x7f342c144200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.225+0000 7f3429e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f342c0add70 0x7f342c144200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40616/0 (socket says 172.21.15.5:40616) 2024-08-17T02:26:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.225+0000 7f3429e00640 1 -- 172.21.15.5:0/821541747 learned_addr learned my addr 172.21.15.5:0/821541747 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.225+0000 7f342a800640 1 --2- 172.21.15.5:0/821541747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c156a90 0x7f342c159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.225+0000 7f3421400640 1 --2- 172.21.15.5:0/821541747 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f342c0aed30 0x7f342c1595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.225+0000 7f3429e00640 1 -- 172.21.15.5:0/821541747 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f342c0aed30 msgr2=0x7f342c1595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.225+0000 7f3429e00640 1 --2- 172.21.15.5:0/821541747 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f342c0aed30 0x7f342c1595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.225+0000 7f3429e00640 1 -- 172.21.15.5:0/821541747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c156a90 msgr2=0x7f342c159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.225+0000 7f3429e00640 1 --2- 172.21.15.5:0/821541747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c156a90 0x7f342c159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.225+0000 7f3429e00640 1 -- 172.21.15.5:0/821541747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3414009390 con 0x7f342c0add70 2024-08-17T02:26:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.225+0000 7f3429e00640 1 --2- 172.21.15.5:0/821541747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f342c0add70 0x7f342c144200 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f341c001380 tx=0x7f341c001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.226+0000 7f3422000640 1 -- 172.21.15.5:0/821541747 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c007360 con 0x7f342c0add70 2024-08-17T02:26:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.226+0000 7f3422000640 1 -- 172.21.15.5:0/821541747 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c0074e0 con 0x7f342c0add70 2024-08-17T02:26:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.226+0000 7f3422000640 1 -- 172.21.15.5:0/821541747 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c0049f0 con 0x7f342c0add70 2024-08-17T02:26:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.226+0000 7f3430e00640 1 -- 172.21.15.5:0/821541747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342c0a4770 con 0x7f342c0add70 2024-08-17T02:26:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.226+0000 7f3430e00640 1 -- 172.21.15.5:0/821541747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342c0a4d30 con 0x7f342c0add70 2024-08-17T02:26:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.227+0000 7f3430e00640 1 -- 172.21.15.5:0/821541747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342c0a5590 con 0x7f342c0add70 2024-08-17T02:26:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.228+0000 7f3422000640 1 -- 172.21.15.5:0/821541747 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f341c00a5b0 con 0x7f342c0add70 2024-08-17T02:26:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.228+0000 7f3422000640 1 --2- 172.21.15.5:0/821541747 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3408065150 0x7f3408067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.228+0000 7f3422000640 1 -- 172.21.15.5:0/821541747 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6251+0+0 (secure 0 0 0) 0x7f341c081ea0 con 0x7f342c0add70 2024-08-17T02:26:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.229+0000 7f3421400640 1 --2- 172.21.15.5:0/821541747 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3408065150 0x7f3408067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.229+0000 7f3421400640 1 --2- 172.21.15.5:0/821541747 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3408065150 0x7f3408067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3414034000 tx=0x7f3414032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.232+0000 7f3422000640 1 -- 172.21.15.5:0/821541747 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f341c04fdd0 con 0x7f342c0add70 2024-08-17T02:26:54.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:54.416+0000 7f3430e00640 1 -- 172.21.15.5:0/821541747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f342c063fb0 con 0x7f342c0add70 2024-08-17T02:26:55.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.051+0000 7f3422000640 1 -- 172.21.15.5:0/821541747 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) v1 ==== 169+0+0 (secure 0 0 0) 0x7f341c018020 con 0x7f342c0add70 2024-08-17T02:26:55.053 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-17T02:26:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.055+0000 7f3430e00640 1 -- 172.21.15.5:0/821541747 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3408065150 msgr2=0x7f3408067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.055+0000 7f3430e00640 1 --2- 172.21.15.5:0/821541747 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3408065150 0x7f3408067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3414034000 tx=0x7f3414032000 comp rx=0 tx=0).stop 2024-08-17T02:26:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.055+0000 7f3430e00640 1 -- 172.21.15.5:0/821541747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f342c0add70 msgr2=0x7f342c144200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.055+0000 7f3430e00640 1 --2- 172.21.15.5:0/821541747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f342c0add70 0x7f342c144200 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f341c001380 tx=0x7f341c001b30 comp rx=0 tx=0).stop 2024-08-17T02:26:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.055+0000 7f3430e00640 1 -- 172.21.15.5:0/821541747 shutdown_connections 2024-08-17T02:26:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.055+0000 7f3430e00640 1 --2- 172.21.15.5:0/821541747 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3408065150 0x7f3408067600 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.055+0000 7f3430e00640 1 --2- 172.21.15.5:0/821541747 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f342c0aed30 0x7f342c1595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.055+0000 7f3430e00640 1 --2- 172.21.15.5:0/821541747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c156a90 0x7f342c159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.055+0000 7f3430e00640 1 --2- 172.21.15.5:0/821541747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f342c0add70 0x7f342c144200 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.055+0000 7f3430e00640 1 -- 172.21.15.5:0/821541747 >> 172.21.15.5:0/821541747 conn(0x7f342c066e60 msgr2=0x7f342c152250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.055+0000 7f3430e00640 1 -- 172.21.15.5:0/821541747 shutdown_connections 2024-08-17T02:26:55.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.055+0000 7f3430e00640 1 -- 172.21.15.5:0/821541747 wait complete. 2024-08-17T02:26:55.074 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.226+0000 7f39c6a00640 1 Processor -- start 2024-08-17T02:26:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.226+0000 7f39c6a00640 1 -- start start 2024-08-17T02:26:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.227+0000 7f39c6a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f39c00ad960 0x7f39c015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.227+0000 7f39c6a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f39c00ca050 0x7f39c0156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.227+0000 7f39c6a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c015b5e0 con 0x7f39c00add30 2024-08-17T02:26:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.227+0000 7f39c6a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c00cb160 con 0x7f39c00ad960 2024-08-17T02:26:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.227+0000 7f39c6a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c00b0d10 con 0x7f39c00ca050 2024-08-17T02:26:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.227+0000 7f39bfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f39c00ad960 0x7f39c015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.227+0000 7f39bfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f39c00ad960 0x7f39c015b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40628/0 (socket says 172.21.15.5:40628) 2024-08-17T02:26:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.228+0000 7f39bfe00640 1 -- 172.21.15.5:0/1904212138 learned_addr learned my addr 172.21.15.5:0/1904212138 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.227+0000 7f39c4a00640 1 --1- 172.21.15.5:0/1904212138 >> v1:172.21.15.5:6789/0 conn(0x7f39c00add30 0x7f39c0156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48344/0 (socket says 172.21.15.5:48344) 2024-08-17T02:26:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.228+0000 7f39bf400640 1 --2- 172.21.15.5:0/1904212138 >> v2:172.21.15.87:3300/0 conn(0x7f39c00ca050 0x7f39c0156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.228+0000 7f39bfe00640 1 -- 172.21.15.5:0/1904212138 >> v2:172.21.15.87:3300/0 conn(0x7f39c00ca050 msgr2=0x7f39c0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.228+0000 7f39bfe00640 1 --2- 172.21.15.5:0/1904212138 >> v2:172.21.15.87:3300/0 conn(0x7f39c00ca050 0x7f39c0156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.228+0000 7f39bfe00640 1 -- 172.21.15.5:0/1904212138 >> v1:172.21.15.5:6789/0 conn(0x7f39c00add30 legacy=0x7f39c0156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.228+0000 7f39bfe00640 1 -- 172.21.15.5:0/1904212138 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c00ca550 con 0x7f39c00ad960 2024-08-17T02:26:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.228+0000 7f39bf400640 1 --2- 172.21.15.5:0/1904212138 >> v2:172.21.15.87:3300/0 conn(0x7f39c00ca050 0x7f39c0156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.228+0000 7f39bea00640 1 -- 172.21.15.5:0/1904212138 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564209076 0 0) 0x7f39b8001490 con 0x7f39c00add30 2024-08-17T02:26:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.229+0000 7f39bfe00640 1 --2- 172.21.15.5:0/1904212138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c00ad960 0x7f39c015b0a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f39c0063600 tx=0x7f39b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=facc5f5d13e3fb46 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.229+0000 7f39bea00640 1 -- 172.21.15.5:0/1904212138 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0032440 con 0x7f39c00ad960 2024-08-17T02:26:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.229+0000 7f39bea00640 1 -- 172.21.15.5:0/1904212138 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b00325a0 con 0x7f39c00ad960 2024-08-17T02:26:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.229+0000 7f39bea00640 1 -- 172.21.15.5:0/1904212138 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0032940 con 0x7f39c00ad960 2024-08-17T02:26:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.230+0000 7f39c6a00640 1 -- 172.21.15.5:0/1904212138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c00ad960 msgr2=0x7f39c015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.230+0000 7f39c6a00640 1 --2- 172.21.15.5:0/1904212138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c00ad960 0x7f39c015b0a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f39c0063600 tx=0x7f39b00091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.230+0000 7f39c6a00640 1 -- 172.21.15.5:0/1904212138 shutdown_connections 2024-08-17T02:26:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.230+0000 7f39c6a00640 1 --2- 172.21.15.5:0/1904212138 >> v2:172.21.15.87:3300/0 conn(0x7f39c00ca050 0x7f39c0156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.230+0000 7f39c6a00640 1 --2- 172.21.15.5:0/1904212138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c00ad960 0x7f39c015b0a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.230+0000 7f39c6a00640 1 -- 172.21.15.5:0/1904212138 >> 172.21.15.5:0/1904212138 conn(0x7f39c0066e60 msgr2=0x7f39c0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.230+0000 7f39c6a00640 1 -- 172.21.15.5:0/1904212138 shutdown_connections 2024-08-17T02:26:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.230+0000 7f39c6a00640 1 -- 172.21.15.5:0/1904212138 wait complete. 2024-08-17T02:26:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.231+0000 7f39c6a00640 1 Processor -- start 2024-08-17T02:26:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.232+0000 7f39c6a00640 1 -- start start 2024-08-17T02:26:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.232+0000 7f39c6a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39c00ad960 0x7f39c015bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.232+0000 7f39c6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c00add30 0x7f39c0150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.233+0000 7f39c6a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39c00ca050 0x7f39c01511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.233+0000 7f39c6a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c01503c0 con 0x7f39c00add30 2024-08-17T02:26:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.233+0000 7f39c6a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c016a6d0 con 0x7f39c00ca050 2024-08-17T02:26:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.233+0000 7f39c6a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c016b250 con 0x7f39c00ad960 2024-08-17T02:26:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.233+0000 7f39bf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c00add30 0x7f39c0150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.233+0000 7f39bf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c00add30 0x7f39c0150ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40630/0 (socket says 172.21.15.5:40630) 2024-08-17T02:26:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.233+0000 7f39bf400640 1 -- 172.21.15.5:0/3805224673 learned_addr learned my addr 172.21.15.5:0/3805224673 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.233+0000 7f39bfe00640 1 --2- 172.21.15.5:0/3805224673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39c00ad960 0x7f39c015bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.233+0000 7f39c4a00640 1 --2- 172.21.15.5:0/3805224673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39c00ca050 0x7f39c01511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.233+0000 7f39bf400640 1 -- 172.21.15.5:0/3805224673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39c00ad960 msgr2=0x7f39c015bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.233+0000 7f39bf400640 1 --2- 172.21.15.5:0/3805224673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39c00ad960 0x7f39c015bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.233+0000 7f39bf400640 1 -- 172.21.15.5:0/3805224673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39c00ca050 msgr2=0x7f39c01511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.233+0000 7f39bf400640 1 --2- 172.21.15.5:0/3805224673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39c00ca050 0x7f39c01511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.233+0000 7f39bf400640 1 -- 172.21.15.5:0/3805224673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b0009450 con 0x7f39c00add30 2024-08-17T02:26:55.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.234+0000 7f39bf400640 1 --2- 172.21.15.5:0/3805224673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c00add30 0x7f39c0150ca0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00c880 tx=0x7f39ac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.234+0000 7f39b7400640 1 -- 172.21.15.5:0/3805224673 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac00ce10 con 0x7f39c00add30 2024-08-17T02:26:55.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.234+0000 7f39b7400640 1 -- 172.21.15.5:0/3805224673 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac007830 con 0x7f39c00add30 2024-08-17T02:26:55.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.234+0000 7f39b7400640 1 -- 172.21.15.5:0/3805224673 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac007bb0 con 0x7f39c00add30 2024-08-17T02:26:55.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.234+0000 7f39c6a00640 1 -- 172.21.15.5:0/3805224673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c016a920 con 0x7f39c00add30 2024-08-17T02:26:55.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.234+0000 7f39c6a00640 1 -- 172.21.15.5:0/3805224673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c016aee0 con 0x7f39c00add30 2024-08-17T02:26:55.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.235+0000 7f39c6a00640 1 -- 172.21.15.5:0/3805224673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c0063fb0 con 0x7f39c00add30 2024-08-17T02:26:55.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.236+0000 7f39b7400640 1 -- 172.21.15.5:0/3805224673 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f39ac0113f0 con 0x7f39c00add30 2024-08-17T02:26:55.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.237+0000 7f39b7400640 1 --2- 172.21.15.5:0/3805224673 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f39a0065150 0x7f39a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.237+0000 7f39b7400640 1 -- 172.21.15.5:0/3805224673 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f39ac082370 con 0x7f39c00add30 2024-08-17T02:26:55.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.237+0000 7f39bfe00640 1 --2- 172.21.15.5:0/3805224673 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f39a0065150 0x7f39a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.238+0000 7f39bfe00640 1 --2- 172.21.15.5:0/3805224673 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f39a0065150 0x7f39a0067600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f39b0034000 tx=0x7f39b0032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.241+0000 7f39b7400640 1 -- 172.21.15.5:0/3805224673 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f39ac053ef0 con 0x7f39c00add30 2024-08-17T02:26:55.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.423+0000 7f39c6a00640 1 -- 172.21.15.5:0/3805224673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39c015b360 con 0x7f39c00add30 2024-08-17T02:26:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.424+0000 7f39b7400640 1 -- 172.21.15.5:0/3805224673 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+15414 (secure 0 0 0) 0x7f39ac053a80 con 0x7f39c00add30 2024-08-17T02:26:55.425 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:26:55.425 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:26:55.043972+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000001044363.meta","create_time":"2024-08-17T02:24:42.487826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001044363"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001044363.data","create_time":"2024-08-17T02:24:43.336536+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001044363"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6836/1918940200":"2024-08-18T02:26:51.946222+0000","172.21.15.5:6835/1918940200":"2024-08-18T02:26:51.946222+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.426+0000 7f39c6a00640 1 -- 172.21.15.5:0/3805224673 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f39a0065150 msgr2=0x7f39a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.426+0000 7f39c6a00640 1 --2- 172.21.15.5:0/3805224673 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f39a0065150 0x7f39a0067600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f39b0034000 tx=0x7f39b0032000 comp rx=0 tx=0).stop 2024-08-17T02:26:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.426+0000 7f39c6a00640 1 -- 172.21.15.5:0/3805224673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c00add30 msgr2=0x7f39c0150ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.426+0000 7f39c6a00640 1 --2- 172.21.15.5:0/3805224673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c00add30 0x7f39c0150ca0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00c880 tx=0x7f39ac008040 comp rx=0 tx=0).stop 2024-08-17T02:26:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.426+0000 7f39c6a00640 1 -- 172.21.15.5:0/3805224673 shutdown_connections 2024-08-17T02:26:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.426+0000 7f39c6a00640 1 --2- 172.21.15.5:0/3805224673 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f39a0065150 0x7f39a0067600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.426+0000 7f39c6a00640 1 --2- 172.21.15.5:0/3805224673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39c00ca050 0x7f39c01511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.426+0000 7f39c6a00640 1 --2- 172.21.15.5:0/3805224673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c00add30 0x7f39c0150ca0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.426+0000 7f39c6a00640 1 --2- 172.21.15.5:0/3805224673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39c00ad960 0x7f39c015bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.426+0000 7f39c6a00640 1 -- 172.21.15.5:0/3805224673 >> 172.21.15.5:0/3805224673 conn(0x7f39c0066e60 msgr2=0x7f39c015cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.426+0000 7f39c6a00640 1 -- 172.21.15.5:0/3805224673 shutdown_connections 2024-08-17T02:26:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.426+0000 7f39c6a00640 1 -- 172.21.15.5:0/3805224673 wait complete. 2024-08-17T02:26:55.442 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:23:28.773677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000001044363.meta', 'create_time': '2024-08-17T02:24:42.487826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000001044363'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000001044363.data', 'create_time': '2024-08-17T02:24:43.336536+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000001044363'}}}] 2024-08-17T02:26:55.442 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:55.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.596+0000 7f4a45400640 1 Processor -- start 2024-08-17T02:26:55.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.596+0000 7f4a45400640 1 -- start start 2024-08-17T02:26:55.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.597+0000 7f4a45400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a40158f30 0x7f4a400acb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.597+0000 7f4a45400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a40067aa0 0x7f4a400aa640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.597+0000 7f4a45400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a400a8dd0 con 0x7f4a40158b60 2024-08-17T02:26:55.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.597+0000 7f4a45400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a400aa270 con 0x7f4a40067aa0 2024-08-17T02:26:55.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.597+0000 7f4a45400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a400abbc0 con 0x7f4a40158f30 2024-08-17T02:26:55.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.597+0000 7f4a3f200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a40067aa0 0x7f4a400aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.598+0000 7f4a3f200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a40067aa0 0x7f4a400aa640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40646/0 (socket says 172.21.15.5:40646) 2024-08-17T02:26:55.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.598+0000 7f4a3f200640 1 -- 172.21.15.5:0/1868633573 learned_addr learned my addr 172.21.15.5:0/1868633573 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:55.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.598+0000 7f4a3e800640 1 --1- 172.21.15.5:0/1868633573 >> v1:172.21.15.5:6789/0 conn(0x7f4a40158b60 0x7f4a400ac420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48356/0 (socket says 172.21.15.5:48356) 2024-08-17T02:26:55.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.598+0000 7f4a3de00640 1 --2- 172.21.15.5:0/1868633573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a40158f30 0x7f4a400acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.598+0000 7f4a3f200640 1 -- 172.21.15.5:0/1868633573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a40158f30 msgr2=0x7f4a400acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:55.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.598+0000 7f4a3f200640 1 --2- 172.21.15.5:0/1868633573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a40158f30 0x7f4a400acb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.598+0000 7f4a3f200640 1 -- 172.21.15.5:0/1868633573 >> v1:172.21.15.5:6789/0 conn(0x7f4a40158b60 legacy=0x7f4a400ac420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.598+0000 7f4a3f200640 1 -- 172.21.15.5:0/1868633573 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a400abe60 con 0x7f4a40067aa0 2024-08-17T02:26:55.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.598+0000 7f4a3d400640 1 -- 172.21.15.5:0/1868633573 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3057276568 0 0) 0x7f4a400a8dd0 con 0x7f4a40158b60 2024-08-17T02:26:55.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.599+0000 7f4a3f200640 1 --2- 172.21.15.5:0/1868633573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a40067aa0 0x7f4a400aa640 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009f20 tx=0x7f4a38009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8ed9af30b33d58 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.599+0000 7f4a3d400640 1 -- 172.21.15.5:0/1868633573 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38031400 con 0x7f4a40067aa0 2024-08-17T02:26:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.599+0000 7f4a3d400640 1 -- 172.21.15.5:0/1868633573 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3802d050 con 0x7f4a40067aa0 2024-08-17T02:26:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.599+0000 7f4a3d400640 1 -- 172.21.15.5:0/1868633573 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38031790 con 0x7f4a40067aa0 2024-08-17T02:26:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.600+0000 7f4a45400640 1 -- 172.21.15.5:0/1868633573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a40067aa0 msgr2=0x7f4a400aa640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.600+0000 7f4a45400640 1 --2- 172.21.15.5:0/1868633573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a40067aa0 0x7f4a400aa640 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009f20 tx=0x7f4a38009840 comp rx=0 tx=0).stop 2024-08-17T02:26:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.600+0000 7f4a45400640 1 -- 172.21.15.5:0/1868633573 shutdown_connections 2024-08-17T02:26:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.600+0000 7f4a45400640 1 --2- 172.21.15.5:0/1868633573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a40067aa0 0x7f4a400aa640 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.600+0000 7f4a45400640 1 --2- 172.21.15.5:0/1868633573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a40158f30 0x7f4a400acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.600+0000 7f4a45400640 1 -- 172.21.15.5:0/1868633573 >> 172.21.15.5:0/1868633573 conn(0x7f4a400cc390 msgr2=0x7f4a40066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.600+0000 7f4a45400640 1 -- 172.21.15.5:0/1868633573 shutdown_connections 2024-08-17T02:26:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.600+0000 7f4a45400640 1 -- 172.21.15.5:0/1868633573 wait complete. 2024-08-17T02:26:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.601+0000 7f4a45400640 1 Processor -- start 2024-08-17T02:26:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.601+0000 7f4a45400640 1 -- start start 2024-08-17T02:26:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.602+0000 7f4a45400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a40067aa0 0x7f4a401423f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.602+0000 7f4a45400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a40158b60 0x7f4a40142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.602+0000 7f4a45400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a40158f30 0x7f4a40159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.602+0000 7f4a45400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4015aab0 con 0x7f4a40158b60 2024-08-17T02:26:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.602+0000 7f4a45400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a40153410 con 0x7f4a40067aa0 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.602+0000 7f4a45400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a40142930 con 0x7f4a40158f30 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.603+0000 7f4a3de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a40158b60 0x7f4a40142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.603+0000 7f4a3de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a40158b60 0x7f4a40142f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40650/0 (socket says 172.21.15.5:40650) 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.603+0000 7f4a3de00640 1 -- 172.21.15.5:0/3702917174 learned_addr learned my addr 172.21.15.5:0/3702917174 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.603+0000 7f4a3e800640 1 --2- 172.21.15.5:0/3702917174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a40067aa0 0x7f4a401423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.603+0000 7f4a3f200640 1 --2- 172.21.15.5:0/3702917174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a40158f30 0x7f4a40159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.603+0000 7f4a3de00640 1 -- 172.21.15.5:0/3702917174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a40158f30 msgr2=0x7f4a40159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.603+0000 7f4a3de00640 1 --2- 172.21.15.5:0/3702917174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a40158f30 0x7f4a40159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.603+0000 7f4a3de00640 1 -- 172.21.15.5:0/3702917174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a40067aa0 msgr2=0x7f4a401423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.603+0000 7f4a3de00640 1 --2- 172.21.15.5:0/3702917174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a40067aa0 0x7f4a401423f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.603+0000 7f4a3de00640 1 -- 172.21.15.5:0/3702917174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a38009ae0 con 0x7f4a40158b60 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.603+0000 7f4a3de00640 1 --2- 172.21.15.5:0/3702917174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a40158b60 0x7f4a40142f30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c00e900 tx=0x7f4a2c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.603+0000 7f4a36000640 1 -- 172.21.15.5:0/3702917174 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c00c940 con 0x7f4a40158b60 2024-08-17T02:26:55.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.603+0000 7f4a36000640 1 -- 172.21.15.5:0/3702917174 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c00cac0 con 0x7f4a40158b60 2024-08-17T02:26:55.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.603+0000 7f4a36000640 1 -- 172.21.15.5:0/3702917174 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c00ce80 con 0x7f4a40158b60 2024-08-17T02:26:55.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.604+0000 7f4a45400640 1 -- 172.21.15.5:0/3702917174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a40159ea0 con 0x7f4a40158b60 2024-08-17T02:26:55.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.604+0000 7f4a45400640 1 -- 172.21.15.5:0/3702917174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4015a460 con 0x7f4a40158b60 2024-08-17T02:26:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.605+0000 7f4a45400640 1 -- 172.21.15.5:0/3702917174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4015ac20 con 0x7f4a40158b60 2024-08-17T02:26:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.605+0000 7f4a36000640 1 -- 172.21.15.5:0/3702917174 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4a2c013680 con 0x7f4a40158b60 2024-08-17T02:26:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.606+0000 7f4a36000640 1 --2- 172.21.15.5:0/3702917174 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4a20065150 0x7f4a20067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.606+0000 7f4a36000640 1 -- 172.21.15.5:0/3702917174 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f4a2c082760 con 0x7f4a40158b60 2024-08-17T02:26:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.606+0000 7f4a3e800640 1 --2- 172.21.15.5:0/3702917174 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4a20065150 0x7f4a20067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.607+0000 7f4a3e800640 1 --2- 172.21.15.5:0/3702917174 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4a20065150 0x7f4a20067600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4a400ab590 tx=0x7f4a30007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.610+0000 7f4a36000640 1 -- 172.21.15.5:0/3702917174 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4a2c050700 con 0x7f4a40158b60 2024-08-17T02:26:55.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.797+0000 7f4a45400640 1 -- 172.21.15.5:0/3702917174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a40063fb0 con 0x7f4a40158b60 2024-08-17T02:26:55.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.797+0000 7f4a36000640 1 -- 172.21.15.5:0/3702917174 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a2c053d20 con 0x7f4a40158b60 2024-08-17T02:26:55.798 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:26:55.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.799+0000 7f4a45400640 1 -- 172.21.15.5:0/3702917174 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4a20065150 msgr2=0x7f4a20067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.799+0000 7f4a45400640 1 --2- 172.21.15.5:0/3702917174 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4a20065150 0x7f4a20067600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4a400ab590 tx=0x7f4a30007b60 comp rx=0 tx=0).stop 2024-08-17T02:26:55.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.799+0000 7f4a45400640 1 -- 172.21.15.5:0/3702917174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a40158b60 msgr2=0x7f4a40142f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.799+0000 7f4a45400640 1 --2- 172.21.15.5:0/3702917174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a40158b60 0x7f4a40142f30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c00e900 tx=0x7f4a2c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.799+0000 7f4a45400640 1 -- 172.21.15.5:0/3702917174 shutdown_connections 2024-08-17T02:26:55.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.799+0000 7f4a45400640 1 --2- 172.21.15.5:0/3702917174 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4a20065150 0x7f4a20067600 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.799+0000 7f4a45400640 1 --2- 172.21.15.5:0/3702917174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a40158f30 0x7f4a40159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.799+0000 7f4a45400640 1 --2- 172.21.15.5:0/3702917174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a40158b60 0x7f4a40142f30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.799+0000 7f4a45400640 1 --2- 172.21.15.5:0/3702917174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a40067aa0 0x7f4a401423f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.800+0000 7f4a45400640 1 -- 172.21.15.5:0/3702917174 >> 172.21.15.5:0/3702917174 conn(0x7f4a400cc390 msgr2=0x7f4a400ac380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.800+0000 7f4a45400640 1 -- 172.21.15.5:0/3702917174 shutdown_connections 2024-08-17T02:26:55.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.800+0000 7f4a45400640 1 -- 172.21.15.5:0/3702917174 wait complete. 2024-08-17T02:26:55.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001044363.meta pg_num 2024-08-17T02:26:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.969+0000 7f2370e00640 1 Processor -- start 2024-08-17T02:26:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.969+0000 7f2370e00640 1 -- start start 2024-08-17T02:26:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.970+0000 7f2370e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f236c0ad960 0x7f236c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.970+0000 7f2370e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f236c0ca050 0x7f236c156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.970+0000 7f2370e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236c15b5e0 con 0x7f236c0add30 2024-08-17T02:26:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.970+0000 7f2370e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236c0cb160 con 0x7f236c0ad960 2024-08-17T02:26:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.970+0000 7f2370e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0b0d10 con 0x7f236c0ca050 2024-08-17T02:26:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.970+0000 7f2363e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f236c0ca050 0x7f236c156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.971+0000 7f2363e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f236c0ca050 0x7f236c156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:54716/0 (socket says 172.21.15.5:54716) 2024-08-17T02:26:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.971+0000 7f2369e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f236c0ad960 0x7f236c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.971+0000 7f236a800640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f236c0add30 0x7f236c156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:56652/0 (socket says 172.21.15.5:56652) 2024-08-17T02:26:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.971+0000 7f2363e00640 1 -- 172.21.15.5:0/1179562763 learned_addr learned my addr 172.21.15.5:0/1179562763 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.971+0000 7f2369e00640 1 -- 172.21.15.5:0/1179562763 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f236c0ca050 msgr2=0x7f236c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.971+0000 7f2369e00640 1 --2- 172.21.15.5:0/1179562763 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f236c0ca050 0x7f236c156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.971+0000 7f2369e00640 1 -- 172.21.15.5:0/1179562763 >> v1:172.21.15.87:6789/0 conn(0x7f236c0add30 legacy=0x7f236c156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.971+0000 7f2369e00640 1 -- 172.21.15.5:0/1179562763 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c0ca550 con 0x7f236c0ad960 2024-08-17T02:26:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.971+0000 7f2363e00640 1 --2- 172.21.15.5:0/1179562763 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f236c0ca050 0x7f236c156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.972+0000 7f2369e00640 1 --2- 172.21.15.5:0/1179562763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f236c0ad960 0x7f236c15b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f235c009850 tx=0x7f235c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4cbc54368dc0b30 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.973+0000 7f2369400640 1 -- 172.21.15.5:0/1179562763 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c02ae20 con 0x7f236c0ad960 2024-08-17T02:26:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.973+0000 7f2369400640 1 -- 172.21.15.5:0/1179562763 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c032440 con 0x7f236c0ad960 2024-08-17T02:26:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.973+0000 7f2369400640 1 -- 172.21.15.5:0/1179562763 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c032820 con 0x7f236c0ad960 2024-08-17T02:26:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.973+0000 7f2370e00640 1 -- 172.21.15.5:0/1179562763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f236c0ad960 msgr2=0x7f236c15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.973+0000 7f2370e00640 1 --2- 172.21.15.5:0/1179562763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f236c0ad960 0x7f236c15b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f235c009850 tx=0x7f235c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.973+0000 7f2370e00640 1 -- 172.21.15.5:0/1179562763 shutdown_connections 2024-08-17T02:26:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.973+0000 7f2370e00640 1 --2- 172.21.15.5:0/1179562763 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f236c0ca050 0x7f236c156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.973+0000 7f2370e00640 1 --2- 172.21.15.5:0/1179562763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f236c0ad960 0x7f236c15b0a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.973+0000 7f2370e00640 1 -- 172.21.15.5:0/1179562763 >> 172.21.15.5:0/1179562763 conn(0x7f236c066e60 msgr2=0x7f236c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.973+0000 7f2370e00640 1 -- 172.21.15.5:0/1179562763 shutdown_connections 2024-08-17T02:26:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.973+0000 7f2370e00640 1 -- 172.21.15.5:0/1179562763 wait complete. 2024-08-17T02:26:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.975+0000 7f2370e00640 1 Processor -- start 2024-08-17T02:26:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.975+0000 7f2370e00640 1 -- start start 2024-08-17T02:26:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.976+0000 7f2370e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f236c0ad960 0x7f236c169bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.976+0000 7f2370e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f236c0add30 0x7f236c151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.976+0000 7f2370e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f236c0ca050 0x7f236c14d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.976+0000 7f2370e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c16a110 con 0x7f236c0ca050 2024-08-17T02:26:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.976+0000 7f2370e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c16cb60 con 0x7f236c0ad960 2024-08-17T02:26:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.976+0000 7f2370e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236c16ce40 con 0x7f236c0add30 2024-08-17T02:26:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.976+0000 7f236a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f236c0ca050 0x7f236c14d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.976+0000 7f236a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f236c0ca050 0x7f236c14d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40660/0 (socket says 172.21.15.5:40660) 2024-08-17T02:26:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.976+0000 7f236a800640 1 -- 172.21.15.5:0/2446056839 learned_addr learned my addr 172.21.15.5:0/2446056839 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.977+0000 7f236a800640 1 -- 172.21.15.5:0/2446056839 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f236c0add30 msgr2=0x7f236c151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.977+0000 7f236a800640 1 --2- 172.21.15.5:0/2446056839 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f236c0add30 0x7f236c151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.977+0000 7f236a800640 1 -- 172.21.15.5:0/2446056839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f236c0ad960 msgr2=0x7f236c169bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.977+0000 7f236a800640 1 --2- 172.21.15.5:0/2446056839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f236c0ad960 0x7f236c169bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.977+0000 7f236a800640 1 -- 172.21.15.5:0/2446056839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2354009450 con 0x7f236c0ca050 2024-08-17T02:26:55.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.977+0000 7f236a800640 1 --2- 172.21.15.5:0/2446056839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f236c0ca050 0x7f236c14d5b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f236400c910 tx=0x7f2364001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.977+0000 7f2361600640 1 -- 172.21.15.5:0/2446056839 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236400cea0 con 0x7f236c0ca050 2024-08-17T02:26:55.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.977+0000 7f2361600640 1 -- 172.21.15.5:0/2446056839 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2364005d60 con 0x7f236c0ca050 2024-08-17T02:26:55.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.977+0000 7f2361600640 1 -- 172.21.15.5:0/2446056839 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236400a870 con 0x7f236c0ca050 2024-08-17T02:26:55.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.977+0000 7f2370e00640 1 -- 172.21.15.5:0/2446056839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235c009390 con 0x7f236c0ca050 2024-08-17T02:26:55.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.977+0000 7f2370e00640 1 -- 172.21.15.5:0/2446056839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236c16d400 con 0x7f236c0ca050 2024-08-17T02:26:55.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.978+0000 7f2370e00640 1 -- 172.21.15.5:0/2446056839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236c063fb0 con 0x7f236c0ca050 2024-08-17T02:26:55.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.979+0000 7f2361600640 1 -- 172.21.15.5:0/2446056839 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f236400aca0 con 0x7f236c0ca050 2024-08-17T02:26:55.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.980+0000 7f2361600640 1 --2- 172.21.15.5:0/2446056839 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2348065150 0x7f2348067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.980+0000 7f2361600640 1 -- 172.21.15.5:0/2446056839 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f23640820c0 con 0x7f236c0ca050 2024-08-17T02:26:55.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.980+0000 7f2369e00640 1 --2- 172.21.15.5:0/2446056839 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2348065150 0x7f2348067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.981+0000 7f2369e00640 1 --2- 172.21.15.5:0/2446056839 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2348065150 0x7f2348067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f235c034000 tx=0x7f235c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:55.984+0000 7f2361600640 1 -- 172.21.15.5:0/2446056839 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2364050190 con 0x7f236c0ca050 2024-08-17T02:26:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.169+0000 7f2370e00640 1 -- 172.21.15.5:0/2446056839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001044363.meta", "var": "pg_num"} v 0) v1 -- 0x7f236c15b5e0 con 0x7f236c0ca050 2024-08-17T02:26:56.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.169+0000 7f2361600640 1 -- 172.21.15.5:0/2446056839 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001044363.meta", "var": "pg_num"}]=0 v42) v1 ==== 124+0+11 (secure 0 0 0) 0x7f236c15b5e0 con 0x7f236c0ca050 2024-08-17T02:26:56.170 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:26:56.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.171+0000 7f2370e00640 1 -- 172.21.15.5:0/2446056839 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2348065150 msgr2=0x7f2348067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.171+0000 7f2370e00640 1 --2- 172.21.15.5:0/2446056839 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2348065150 0x7f2348067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f235c034000 tx=0x7f235c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:56.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.171+0000 7f2370e00640 1 -- 172.21.15.5:0/2446056839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f236c0ca050 msgr2=0x7f236c14d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.171+0000 7f2370e00640 1 --2- 172.21.15.5:0/2446056839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f236c0ca050 0x7f236c14d5b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f236400c910 tx=0x7f2364001690 comp rx=0 tx=0).stop 2024-08-17T02:26:56.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.171+0000 7f2370e00640 1 -- 172.21.15.5:0/2446056839 shutdown_connections 2024-08-17T02:26:56.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.171+0000 7f2370e00640 1 --2- 172.21.15.5:0/2446056839 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2348065150 0x7f2348067600 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.171+0000 7f2370e00640 1 --2- 172.21.15.5:0/2446056839 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f236c0add30 0x7f236c151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.171+0000 7f2370e00640 1 --2- 172.21.15.5:0/2446056839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f236c0ca050 0x7f236c14d5b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.171+0000 7f2370e00640 1 --2- 172.21.15.5:0/2446056839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f236c0ad960 0x7f236c169bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.171+0000 7f2370e00640 1 -- 172.21.15.5:0/2446056839 >> 172.21.15.5:0/2446056839 conn(0x7f236c066e60 msgr2=0x7f236c0b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.171+0000 7f2370e00640 1 -- 172.21.15.5:0/2446056839 shutdown_connections 2024-08-17T02:26:56.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.172+0000 7f2370e00640 1 -- 172.21.15.5:0/2446056839 wait complete. 2024-08-17T02:26:56.187 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001044363.data pg_num 2024-08-17T02:26:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.342+0000 7f744ea00640 1 Processor -- start 2024-08-17T02:26:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.342+0000 7f744ea00640 1 -- start start 2024-08-17T02:26:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.343+0000 7f744ea00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f744806e4b0 0x7f74480afa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.343+0000 7f744ea00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74480aeeb0 con 0x7f744806e060 2024-08-17T02:26:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.343+0000 7f744ea00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74480aadd0 con 0x7f7448155040 2024-08-17T02:26:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.343+0000 7f744ea00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74481597f0 con 0x7f744806e4b0 2024-08-17T02:26:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.344+0000 7f743fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f744806e060 0x7f74480af340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48372/0 (socket says 172.21.15.5:48372) 2024-08-17T02:26:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.344+0000 7f743fe00640 1 -- 172.21.15.5:0/2032002888 learned_addr learned my addr 172.21.15.5:0/2032002888 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:26:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.344+0000 7f744ca00640 1 --2- 172.21.15.5:0/2032002888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f744806e4b0 0x7f74480afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.344+0000 7f7447400640 1 -- 172.21.15.5:0/2032002888 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180342660 0 0) 0x7f74480aeeb0 con 0x7f744806e060 2024-08-17T02:26:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.344+0000 7f7447400640 1 -- 172.21.15.5:0/2032002888 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f742c0034e0 con 0x7f744806e060 2024-08-17T02:26:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.344+0000 7f7447400640 1 -- 172.21.15.5:0/2032002888 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430697631 0 0) 0x7f74480aadd0 con 0x7f7448155040 2024-08-17T02:26:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.344+0000 7f7447400640 1 -- 172.21.15.5:0/2032002888 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74480aeeb0 con 0x7f7448155040 2024-08-17T02:26:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.344+0000 7f744ca00640 1 -- 172.21.15.5:0/2032002888 >> v1:172.21.15.87:6789/0 conn(0x7f7448155040 legacy=0x7f7448158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.345+0000 7f744ca00640 1 -- 172.21.15.5:0/2032002888 >> v1:172.21.15.5:6789/0 conn(0x7f744806e060 legacy=0x7f74480af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.345+0000 7f744ca00640 1 -- 172.21.15.5:0/2032002888 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7448159ad0 con 0x7f744806e4b0 2024-08-17T02:26:56.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.346+0000 7f744ca00640 1 --2- 172.21.15.5:0/2032002888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f744806e4b0 0x7f74480afa50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f744000afa0 tx=0x7f744000a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d4d2e573706edf9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.346+0000 7f7447400640 1 -- 172.21.15.5:0/2032002888 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744000a2e0 con 0x7f744806e4b0 2024-08-17T02:26:56.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.346+0000 7f7447400640 1 -- 172.21.15.5:0/2032002888 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744002f050 con 0x7f744806e4b0 2024-08-17T02:26:56.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.346+0000 7f7447400640 1 -- 172.21.15.5:0/2032002888 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400086a0 con 0x7f744806e4b0 2024-08-17T02:26:56.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.346+0000 7f744ea00640 1 -- 172.21.15.5:0/2032002888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f744806e4b0 msgr2=0x7f74480afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.346+0000 7f744ea00640 1 --2- 172.21.15.5:0/2032002888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f744806e4b0 0x7f74480afa50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f744000afa0 tx=0x7f744000a890 comp rx=0 tx=0).stop 2024-08-17T02:26:56.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.346+0000 7f744ea00640 1 -- 172.21.15.5:0/2032002888 shutdown_connections 2024-08-17T02:26:56.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.346+0000 7f744ea00640 1 --2- 172.21.15.5:0/2032002888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f744806e4b0 0x7f74480afa50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.346+0000 7f744ea00640 1 -- 172.21.15.5:0/2032002888 >> 172.21.15.5:0/2032002888 conn(0x7f7448066e60 msgr2=0x7f7448067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.347+0000 7f744ea00640 1 -- 172.21.15.5:0/2032002888 shutdown_connections 2024-08-17T02:26:56.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.347+0000 7f744ea00640 1 -- 172.21.15.5:0/2032002888 wait complete. 2024-08-17T02:26:56.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.348+0000 7f744ea00640 1 Processor -- start 2024-08-17T02:26:56.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.348+0000 7f744ea00640 1 -- start start 2024-08-17T02:26:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.349+0000 7f744ea00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f744806e060 0x7f744813c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.349+0000 7f744ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f744806e4b0 0x7f744814d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.349+0000 7f744ea00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7448155040 0x7f744814d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.349+0000 7f744ea00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74480a8c50 con 0x7f744806e4b0 2024-08-17T02:26:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.349+0000 7f744ea00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74481512d0 con 0x7f7448155040 2024-08-17T02:26:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.349+0000 7f744ea00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74481515b0 con 0x7f744806e060 2024-08-17T02:26:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.349+0000 7f743fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f744806e4b0 0x7f744814d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.349+0000 7f743fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f744806e4b0 0x7f744814d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40670/0 (socket says 172.21.15.5:40670) 2024-08-17T02:26:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.349+0000 7f743fe00640 1 -- 172.21.15.5:0/762026167 learned_addr learned my addr 172.21.15.5:0/762026167 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.349+0000 7f7447e00640 1 --2- 172.21.15.5:0/762026167 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f744806e060 0x7f744813c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.349+0000 7f744ca00640 1 --2- 172.21.15.5:0/762026167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7448155040 0x7f744814d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.350+0000 7f743fe00640 1 -- 172.21.15.5:0/762026167 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f744806e060 msgr2=0x7f744813c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.350+0000 7f743fe00640 1 --2- 172.21.15.5:0/762026167 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f744806e060 0x7f744813c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.350+0000 7f743fe00640 1 -- 172.21.15.5:0/762026167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7448155040 msgr2=0x7f744814d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.350+0000 7f743fe00640 1 --2- 172.21.15.5:0/762026167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7448155040 0x7f744814d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.350+0000 7f743fe00640 1 -- 172.21.15.5:0/762026167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744000ab30 con 0x7f744806e4b0 2024-08-17T02:26:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.350+0000 7f7447e00640 1 --2- 172.21.15.5:0/762026167 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f744806e060 0x7f744813c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.350+0000 7f744ca00640 1 --2- 172.21.15.5:0/762026167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7448155040 0x7f744814d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.350+0000 7f743fe00640 1 --2- 172.21.15.5:0/762026167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f744806e4b0 0x7f744814d1f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7430005840 tx=0x7f7430007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.350+0000 7f743f400640 1 -- 172.21.15.5:0/762026167 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7430005aa0 con 0x7f744806e4b0 2024-08-17T02:26:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.350+0000 7f743f400640 1 -- 172.21.15.5:0/762026167 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7430005c00 con 0x7f744806e4b0 2024-08-17T02:26:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.350+0000 7f744ea00640 1 -- 172.21.15.5:0/762026167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7448151890 con 0x7f744806e4b0 2024-08-17T02:26:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.350+0000 7f743f400640 1 -- 172.21.15.5:0/762026167 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74300070f0 con 0x7f744806e4b0 2024-08-17T02:26:56.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.350+0000 7f744ea00640 1 -- 172.21.15.5:0/762026167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744813c9f0 con 0x7f744806e4b0 2024-08-17T02:26:56.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.351+0000 7f744ea00640 1 -- 172.21.15.5:0/762026167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7448063fb0 con 0x7f744806e4b0 2024-08-17T02:26:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.352+0000 7f743f400640 1 -- 172.21.15.5:0/762026167 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7430007520 con 0x7f744806e4b0 2024-08-17T02:26:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.353+0000 7f743f400640 1 --2- 172.21.15.5:0/762026167 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7424065150 0x7f7424067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.354+0000 7f743f400640 1 -- 172.21.15.5:0/762026167 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f7430082080 con 0x7f744806e4b0 2024-08-17T02:26:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.354+0000 7f7447e00640 1 --2- 172.21.15.5:0/762026167 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7424065150 0x7f7424067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.354+0000 7f7447e00640 1 --2- 172.21.15.5:0/762026167 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7424065150 0x7f7424067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f744806b310 tx=0x7f7438009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.358+0000 7f743f400640 1 -- 172.21.15.5:0/762026167 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f74300500a0 con 0x7f744806e4b0 2024-08-17T02:26:56.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.549+0000 7f744ea00640 1 -- 172.21.15.5:0/762026167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001044363.data", "var": "pg_num"} v 0) v1 -- 0x7f74480a8d90 con 0x7f744806e4b0 2024-08-17T02:26:56.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.550+0000 7f743f400640 1 -- 172.21.15.5:0/762026167 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001044363.data", "var": "pg_num"}]=0 v42) v1 ==== 124+0+11 (secure 0 0 0) 0x7f74300536c0 con 0x7f744806e4b0 2024-08-17T02:26:56.550 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:26:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.552+0000 7f744ea00640 1 -- 172.21.15.5:0/762026167 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7424065150 msgr2=0x7f7424067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.552+0000 7f744ea00640 1 --2- 172.21.15.5:0/762026167 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7424065150 0x7f7424067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f744806b310 tx=0x7f7438009040 comp rx=0 tx=0).stop 2024-08-17T02:26:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.552+0000 7f744ea00640 1 -- 172.21.15.5:0/762026167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f744806e4b0 msgr2=0x7f744814d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.552+0000 7f744ea00640 1 --2- 172.21.15.5:0/762026167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f744806e4b0 0x7f744814d1f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7430005840 tx=0x7f7430007e10 comp rx=0 tx=0).stop 2024-08-17T02:26:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.552+0000 7f744ea00640 1 -- 172.21.15.5:0/762026167 shutdown_connections 2024-08-17T02:26:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.552+0000 7f744ea00640 1 --2- 172.21.15.5:0/762026167 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7424065150 0x7f7424067600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.552+0000 7f744ea00640 1 --2- 172.21.15.5:0/762026167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7448155040 0x7f744814d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.552+0000 7f744ea00640 1 --2- 172.21.15.5:0/762026167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f744806e4b0 0x7f744814d1f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.552+0000 7f744ea00640 1 --2- 172.21.15.5:0/762026167 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f744806e060 0x7f744813c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.552+0000 7f744ea00640 1 -- 172.21.15.5:0/762026167 >> 172.21.15.5:0/762026167 conn(0x7f7448066e60 msgr2=0x7f74480c8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.552+0000 7f744ea00640 1 -- 172.21.15.5:0/762026167 shutdown_connections 2024-08-17T02:26:56.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.552+0000 7f744ea00640 1 -- 172.21.15.5:0/762026167 wait complete. 2024-08-17T02:26:56.568 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:56.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.718+0000 7f2339c00640 1 Processor -- start 2024-08-17T02:26:56.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.718+0000 7f2339c00640 1 -- start start 2024-08-17T02:26:56.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.719+0000 7f2339c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f23341590b0 0x7f23340b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.719+0000 7f2339c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23340c92b0 con 0x7f23340acf10 2024-08-17T02:26:56.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.719+0000 7f2339c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23340ad480 con 0x7f23340afca0 2024-08-17T02:26:56.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.719+0000 7f2339c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23340b0980 con 0x7f23341590b0 2024-08-17T02:26:56.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.720+0000 7f232be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f23341590b0 0x7f23340b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.720+0000 7f232be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f23341590b0 0x7f23340b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40674/0 (socket says 172.21.15.5:40674) 2024-08-17T02:26:56.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.720+0000 7f232be00640 1 -- 172.21.15.5:0/103433918 learned_addr learned my addr 172.21.15.5:0/103433918 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:56.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.720+0000 7f2333400640 1 --1- 172.21.15.5:0/103433918 >> v1:172.21.15.5:6789/0 conn(0x7f23340acf10 0x7f23340c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48380/0 (socket says 172.21.15.5:48380) 2024-08-17T02:26:56.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.720+0000 7f232be00640 1 -- 172.21.15.5:0/103433918 >> v1:172.21.15.87:6789/0 conn(0x7f23340afca0 legacy=0x7f23341589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.720+0000 7f232be00640 1 -- 172.21.15.5:0/103433918 >> v1:172.21.15.5:6789/0 conn(0x7f23340acf10 legacy=0x7f23340c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.720+0000 7f232be00640 1 -- 172.21.15.5:0/103433918 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23340ad760 con 0x7f23341590b0 2024-08-17T02:26:56.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.721+0000 7f232be00640 1 --2- 172.21.15.5:0/103433918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23341590b0 0x7f23340b0070 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f231c009910 tx=0x7f231c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38966ffc56cb51d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.721+0000 7f2332000640 1 -- 172.21.15.5:0/103433918 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c032440 con 0x7f23341590b0 2024-08-17T02:26:56.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.721+0000 7f2332000640 1 -- 172.21.15.5:0/103433918 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c0325a0 con 0x7f23341590b0 2024-08-17T02:26:56.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.721+0000 7f2332000640 1 -- 172.21.15.5:0/103433918 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c032980 con 0x7f23341590b0 2024-08-17T02:26:56.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.722+0000 7f2339c00640 1 -- 172.21.15.5:0/103433918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23341590b0 msgr2=0x7f23340b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.722+0000 7f2339c00640 1 --2- 172.21.15.5:0/103433918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23341590b0 0x7f23340b0070 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f231c009910 tx=0x7f231c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.722+0000 7f2339c00640 1 -- 172.21.15.5:0/103433918 shutdown_connections 2024-08-17T02:26:56.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.722+0000 7f2339c00640 1 --2- 172.21.15.5:0/103433918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23341590b0 0x7f23340b0070 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.722+0000 7f2339c00640 1 -- 172.21.15.5:0/103433918 >> 172.21.15.5:0/103433918 conn(0x7f2334066e60 msgr2=0x7f2334067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.722+0000 7f2339c00640 1 -- 172.21.15.5:0/103433918 shutdown_connections 2024-08-17T02:26:56.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.722+0000 7f2339c00640 1 -- 172.21.15.5:0/103433918 wait complete. 2024-08-17T02:26:56.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.724+0000 7f2339c00640 1 Processor -- start 2024-08-17T02:26:56.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.724+0000 7f2339c00640 1 -- start start 2024-08-17T02:26:56.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.724+0000 7f2339c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23340acf10 0x7f23340c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.725+0000 7f2339c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23340afca0 0x7f233414a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.725+0000 7f2339c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23341590b0 0x7f23341531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.725+0000 7f2339c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2334155c00 con 0x7f23341590b0 2024-08-17T02:26:56.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.725+0000 7f2339c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2334154ff0 con 0x7f23340acf10 2024-08-17T02:26:56.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.725+0000 7f2339c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23341552d0 con 0x7f23340afca0 2024-08-17T02:26:56.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.725+0000 7f2333400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23341590b0 0x7f23341531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.725+0000 7f2333400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23341590b0 0x7f23341531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40680/0 (socket says 172.21.15.5:40680) 2024-08-17T02:26:56.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.725+0000 7f2333400640 1 -- 172.21.15.5:0/2439190851 learned_addr learned my addr 172.21.15.5:0/2439190851 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:56.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.725+0000 7f232be00640 1 --2- 172.21.15.5:0/2439190851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23340afca0 0x7f233414a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.725+0000 7f2332a00640 1 --2- 172.21.15.5:0/2439190851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23340acf10 0x7f23340c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.725+0000 7f2333400640 1 -- 172.21.15.5:0/2439190851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23340afca0 msgr2=0x7f233414a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.725+0000 7f2333400640 1 --2- 172.21.15.5:0/2439190851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23340afca0 0x7f233414a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.725+0000 7f2333400640 1 -- 172.21.15.5:0/2439190851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23340acf10 msgr2=0x7f23340c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.725+0000 7f2333400640 1 --2- 172.21.15.5:0/2439190851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23340acf10 0x7f23340c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.725+0000 7f2333400640 1 -- 172.21.15.5:0/2439190851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c009450 con 0x7f23341590b0 2024-08-17T02:26:56.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.726+0000 7f2333400640 1 --2- 172.21.15.5:0/2439190851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23341590b0 0x7f23341531c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f232c00c910 tx=0x7f232c001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.726+0000 7f232a000640 1 -- 172.21.15.5:0/2439190851 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c00cea0 con 0x7f23341590b0 2024-08-17T02:26:56.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.726+0000 7f232a000640 1 -- 172.21.15.5:0/2439190851 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c005d60 con 0x7f23341590b0 2024-08-17T02:26:56.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.726+0000 7f2339c00640 1 -- 172.21.15.5:0/2439190851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23341555b0 con 0x7f23341590b0 2024-08-17T02:26:56.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.726+0000 7f232a000640 1 -- 172.21.15.5:0/2439190851 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c00a870 con 0x7f23341590b0 2024-08-17T02:26:56.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.726+0000 7f2339c00640 1 -- 172.21.15.5:0/2439190851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23340c7280 con 0x7f23341590b0 2024-08-17T02:26:56.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.727+0000 7f2339c00640 1 -- 172.21.15.5:0/2439190851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2334155d70 con 0x7f23341590b0 2024-08-17T02:26:56.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.728+0000 7f232a000640 1 -- 172.21.15.5:0/2439190851 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f232c00aca0 con 0x7f23341590b0 2024-08-17T02:26:56.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.729+0000 7f232a000640 1 --2- 172.21.15.5:0/2439190851 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2310065180 0x7f2310067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.729+0000 7f232a000640 1 -- 172.21.15.5:0/2439190851 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f232c082250 con 0x7f23341590b0 2024-08-17T02:26:56.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.729+0000 7f2332a00640 1 --2- 172.21.15.5:0/2439190851 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2310065180 0x7f2310067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.730+0000 7f2332a00640 1 --2- 172.21.15.5:0/2439190851 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2310065180 0x7f2310067630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f233416c750 tx=0x7f2324009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.733+0000 7f232a000640 1 -- 172.21.15.5:0/2439190851 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f232c050320 con 0x7f23341590b0 2024-08-17T02:26:56.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.955+0000 7f2339c00640 1 -- 172.21.15.5:0/2439190851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2334063fb0 con 0x7f23341590b0 2024-08-17T02:26:56.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.956+0000 7f232a000640 1 -- 172.21.15.5:0/2439190851 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f232c053940 con 0x7f23341590b0 2024-08-17T02:26:56.957 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:26:56.957 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1398504310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1398504310},{"type":"v1","addr":"172.21.15.5:6837","nonce":1398504310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/1045077639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1045077639},{"type":"v1","addr":"172.21.15.87:6833","nonce":1045077639}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/940060904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":940060904},{"type":"v1","addr":"172.21.15.5:6836","nonce":940060904}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:44.295321+0000","modified":"2024-08-17T02:24:45.911915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4858},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4858":{"gid":4858,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.87:6835/1739323622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1739323622},{"type":"v1","addr":"172.21.15.87:6835","nonce":1739323622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001044363","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:26:56.957 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 22 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.958+0000 7f2339c00640 1 -- 172.21.15.5:0/2439190851 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2310065180 msgr2=0x7f2310067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.958+0000 7f2339c00640 1 --2- 172.21.15.5:0/2439190851 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2310065180 0x7f2310067630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f233416c750 tx=0x7f2324009040 comp rx=0 tx=0).stop 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.958+0000 7f2339c00640 1 -- 172.21.15.5:0/2439190851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23341590b0 msgr2=0x7f23341531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.958+0000 7f2339c00640 1 --2- 172.21.15.5:0/2439190851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23341590b0 0x7f23341531c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f232c00c910 tx=0x7f232c001690 comp rx=0 tx=0).stop 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.958+0000 7f2339c00640 1 -- 172.21.15.5:0/2439190851 shutdown_connections 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.958+0000 7f2339c00640 1 --2- 172.21.15.5:0/2439190851 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f2310065180 0x7f2310067630 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.958+0000 7f2339c00640 1 --2- 172.21.15.5:0/2439190851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23340afca0 0x7f233414a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.958+0000 7f2339c00640 1 --2- 172.21.15.5:0/2439190851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23341590b0 0x7f23341531c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.958+0000 7f2339c00640 1 --2- 172.21.15.5:0/2439190851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23340acf10 0x7f23340c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.958+0000 7f2339c00640 1 -- 172.21.15.5:0/2439190851 >> 172.21.15.5:0/2439190851 conn(0x7f2334066e60 msgr2=0x7f23340ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.958+0000 7f2339c00640 1 -- 172.21.15.5:0/2439190851 shutdown_connections 2024-08-17T02:26:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:56.959+0000 7f2339c00640 1 -- 172.21.15.5:0/2439190851 wait complete. 2024-08-17T02:26:56.974 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:57.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.126+0000 7f8d85200640 1 Processor -- start 2024-08-17T02:26:57.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.126+0000 7f8d85200640 1 -- start start 2024-08-17T02:26:57.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.127+0000 7f8d85200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8d800acf10 0x7f8d800b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.127+0000 7f8d85200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d800c92b0 con 0x7f8d801590b0 2024-08-17T02:26:57.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.127+0000 7f8d85200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d800ad480 con 0x7f8d800afca0 2024-08-17T02:26:57.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.127+0000 7f8d85200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d800b0980 con 0x7f8d800acf10 2024-08-17T02:26:57.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.128+0000 7f8d7e800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8d800acf10 0x7f8d800b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.128+0000 7f8d7e800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8d800acf10 0x7f8d800b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40684/0 (socket says 172.21.15.5:40684) 2024-08-17T02:26:57.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.128+0000 7f8d7e800640 1 -- 172.21.15.5:0/2572270490 learned_addr learned my addr 172.21.15.5:0/2572270490 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:57.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.128+0000 7f8d7d400640 1 --1- 172.21.15.5:0/2572270490 >> v1:172.21.15.5:6789/0 conn(0x7f8d801590b0 0x7f8d800c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48396/0 (socket says 172.21.15.5:48396) 2024-08-17T02:26:57.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.128+0000 7f8d7de00640 1 --1- 172.21.15.5:0/2572270490 >> v1:172.21.15.87:6789/0 conn(0x7f8d800afca0 0x7f8d801589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:56684/0 (socket says 172.21.15.5:56684) 2024-08-17T02:26:57.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.128+0000 7f8d7e800640 1 -- 172.21.15.5:0/2572270490 >> v1:172.21.15.87:6789/0 conn(0x7f8d800afca0 legacy=0x7f8d801589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.128+0000 7f8d7e800640 1 -- 172.21.15.5:0/2572270490 >> v1:172.21.15.5:6789/0 conn(0x7f8d801590b0 legacy=0x7f8d800c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.128+0000 7f8d7e800640 1 -- 172.21.15.5:0/2572270490 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d800ad760 con 0x7f8d800acf10 2024-08-17T02:26:57.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.129+0000 7f8d7e800640 1 --2- 172.21.15.5:0/2572270490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800acf10 0x7f8d800b0070 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800d1a0 tx=0x7f8d7800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e3e0a543d45cf8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.129+0000 7f8d7ca00640 1 -- 172.21.15.5:0/2572270490 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7800b2e0 con 0x7f8d800acf10 2024-08-17T02:26:57.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.129+0000 7f8d7ca00640 1 -- 172.21.15.5:0/2572270490 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7800b440 con 0x7f8d800acf10 2024-08-17T02:26:57.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.129+0000 7f8d7ca00640 1 -- 172.21.15.5:0/2572270490 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d78009840 con 0x7f8d800acf10 2024-08-17T02:26:57.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.130+0000 7f8d85200640 1 -- 172.21.15.5:0/2572270490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800acf10 msgr2=0x7f8d800b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.130+0000 7f8d85200640 1 --2- 172.21.15.5:0/2572270490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800acf10 0x7f8d800b0070 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800d1a0 tx=0x7f8d7800ba50 comp rx=0 tx=0).stop 2024-08-17T02:26:57.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.130+0000 7f8d85200640 1 -- 172.21.15.5:0/2572270490 shutdown_connections 2024-08-17T02:26:57.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.130+0000 7f8d85200640 1 --2- 172.21.15.5:0/2572270490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800acf10 0x7f8d800b0070 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.130+0000 7f8d85200640 1 -- 172.21.15.5:0/2572270490 >> 172.21.15.5:0/2572270490 conn(0x7f8d80066e60 msgr2=0x7f8d80067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.130+0000 7f8d85200640 1 -- 172.21.15.5:0/2572270490 shutdown_connections 2024-08-17T02:26:57.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.130+0000 7f8d85200640 1 -- 172.21.15.5:0/2572270490 wait complete. 2024-08-17T02:26:57.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.131+0000 7f8d85200640 1 Processor -- start 2024-08-17T02:26:57.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.132+0000 7f8d85200640 1 -- start start 2024-08-17T02:26:57.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.132+0000 7f8d85200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800acf10 0x7f8d80137a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.132+0000 7f8d85200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d800afca0 0x7f8d800c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.132+0000 7f8d85200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d801590b0 0x7f8d800ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.132+0000 7f8d85200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d801386d0 con 0x7f8d800acf10 2024-08-17T02:26:57.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.132+0000 7f8d85200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d800cb2a0 con 0x7f8d800afca0 2024-08-17T02:26:57.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.132+0000 7f8d85200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8014eb70 con 0x7f8d801590b0 2024-08-17T02:26:57.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.133+0000 7f8d7de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800acf10 0x7f8d80137a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.133+0000 7f8d7de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800acf10 0x7f8d80137a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40692/0 (socket says 172.21.15.5:40692) 2024-08-17T02:26:57.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.133+0000 7f8d7de00640 1 -- 172.21.15.5:0/75475821 learned_addr learned my addr 172.21.15.5:0/75475821 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:57.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.133+0000 7f8d7d400640 1 --2- 172.21.15.5:0/75475821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d800afca0 0x7f8d800c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.133+0000 7f8d7e800640 1 --2- 172.21.15.5:0/75475821 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d801590b0 0x7f8d800ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.133+0000 7f8d7de00640 1 -- 172.21.15.5:0/75475821 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d801590b0 msgr2=0x7f8d800ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.133+0000 7f8d7de00640 1 --2- 172.21.15.5:0/75475821 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d801590b0 0x7f8d800ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.133+0000 7f8d7de00640 1 -- 172.21.15.5:0/75475821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d800afca0 msgr2=0x7f8d800c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.133+0000 7f8d7de00640 1 --2- 172.21.15.5:0/75475821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d800afca0 0x7f8d800c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.133+0000 7f8d7de00640 1 -- 172.21.15.5:0/75475821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7800bcf0 con 0x7f8d800acf10 2024-08-17T02:26:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.133+0000 7f8d7de00640 1 --2- 172.21.15.5:0/75475821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800acf10 0x7f8d80137a10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000c590 tx=0x7f8d70007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.134+0000 7f8d75600640 1 -- 172.21.15.5:0/75475821 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d70007300 con 0x7f8d800acf10 2024-08-17T02:26:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.134+0000 7f8d75600640 1 -- 172.21.15.5:0/75475821 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d700074a0 con 0x7f8d800acf10 2024-08-17T02:26:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.134+0000 7f8d75600640 1 -- 172.21.15.5:0/75475821 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d700047a0 con 0x7f8d800acf10 2024-08-17T02:26:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.134+0000 7f8d85200640 1 -- 172.21.15.5:0/75475821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8014ee50 con 0x7f8d800acf10 2024-08-17T02:26:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.134+0000 7f8d85200640 1 -- 172.21.15.5:0/75475821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d80138360 con 0x7f8d800acf10 2024-08-17T02:26:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.135+0000 7f8d85200640 1 -- 172.21.15.5:0/75475821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d80063fb0 con 0x7f8d800acf10 2024-08-17T02:26:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.136+0000 7f8d75600640 1 -- 172.21.15.5:0/75475821 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8d70004bd0 con 0x7f8d800acf10 2024-08-17T02:26:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.137+0000 7f8d75600640 1 --2- 172.21.15.5:0/75475821 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8d60065150 0x7f8d60067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.137+0000 7f8d75600640 1 -- 172.21.15.5:0/75475821 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f8d70081430 con 0x7f8d800acf10 2024-08-17T02:26:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.137+0000 7f8d7d400640 1 --2- 172.21.15.5:0/75475821 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8d60065150 0x7f8d60067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.138+0000 7f8d7d400640 1 --2- 172.21.15.5:0/75475821 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8d60065150 0x7f8d60067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8d8014be30 tx=0x7f8d6c007e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.141+0000 7f8d75600640 1 -- 172.21.15.5:0/75475821 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8d7004be40 con 0x7f8d800acf10 2024-08-17T02:26:57.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.326+0000 7f8d85200640 1 -- 172.21.15.5:0/75475821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d80067b70 con 0x7f8d800acf10 2024-08-17T02:26:57.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.327+0000 7f8d75600640 1 -- 172.21.15.5:0/75475821 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+15414 (secure 0 0 0) 0x7f8d7004f500 con 0x7f8d800acf10 2024-08-17T02:26:57.327 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:26:57.327 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:26:55.043972+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000001044363.meta","create_time":"2024-08-17T02:24:42.487826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001044363"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001044363.data","create_time":"2024-08-17T02:24:43.336536+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001044363"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6836/1918940200":"2024-08-18T02:26:51.946222+0000","172.21.15.5:6835/1918940200":"2024-08-18T02:26:51.946222+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:57.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.329+0000 7f8d85200640 1 -- 172.21.15.5:0/75475821 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8d60065150 msgr2=0x7f8d60067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.329+0000 7f8d85200640 1 --2- 172.21.15.5:0/75475821 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8d60065150 0x7f8d60067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8d8014be30 tx=0x7f8d6c007e20 comp rx=0 tx=0).stop 2024-08-17T02:26:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.329+0000 7f8d85200640 1 -- 172.21.15.5:0/75475821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800acf10 msgr2=0x7f8d80137a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.329+0000 7f8d85200640 1 --2- 172.21.15.5:0/75475821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800acf10 0x7f8d80137a10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000c590 tx=0x7f8d70007ee0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.329+0000 7f8d85200640 1 -- 172.21.15.5:0/75475821 shutdown_connections 2024-08-17T02:26:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.329+0000 7f8d85200640 1 --2- 172.21.15.5:0/75475821 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8d60065150 0x7f8d60067600 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.329+0000 7f8d85200640 1 --2- 172.21.15.5:0/75475821 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d801590b0 0x7f8d800ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.329+0000 7f8d85200640 1 --2- 172.21.15.5:0/75475821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d800afca0 0x7f8d800c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.329+0000 7f8d85200640 1 --2- 172.21.15.5:0/75475821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800acf10 0x7f8d80137a10 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.329+0000 7f8d85200640 1 -- 172.21.15.5:0/75475821 >> 172.21.15.5:0/75475821 conn(0x7f8d80066e60 msgr2=0x7f8d800ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.329+0000 7f8d85200640 1 -- 172.21.15.5:0/75475821 shutdown_connections 2024-08-17T02:26:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.329+0000 7f8d85200640 1 -- 172.21.15.5:0/75475821 wait complete. 2024-08-17T02:26:57.345 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000001044363 and related pools 2024-08-17T02:26:57.345 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:57.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.496+0000 7f0864200640 1 Processor -- start 2024-08-17T02:26:57.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.496+0000 7f0864200640 1 -- start start 2024-08-17T02:26:57.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.497+0000 7f0864200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f085c158a20 0x7f085c0a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.497+0000 7f0864200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f085c0ae860 0x7f085c06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.497+0000 7f0864200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085c0aed90 con 0x7f085c158df0 2024-08-17T02:26:57.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.497+0000 7f0864200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085c0af070 con 0x7f085c0ae860 2024-08-17T02:26:57.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.497+0000 7f0864200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085c0af350 con 0x7f085c158a20 2024-08-17T02:26:57.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.498+0000 7f0860e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f085c0ae860 0x7f085c06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.498+0000 7f0860e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f085c0ae860 0x7f085c06d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40706/0 (socket says 172.21.15.5:40706) 2024-08-17T02:26:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.498+0000 7f0860e00640 1 -- 172.21.15.5:0/195365489 learned_addr learned my addr 172.21.15.5:0/195365489 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.498+0000 7f0861800640 1 --2- 172.21.15.5:0/195365489 >> v2:172.21.15.87:3300/0 conn(0x7f085c158a20 0x7f085c0a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.498+0000 7f0860e00640 1 -- 172.21.15.5:0/195365489 >> v2:172.21.15.87:3300/0 conn(0x7f085c158a20 msgr2=0x7f085c0a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.498+0000 7f0860e00640 1 --2- 172.21.15.5:0/195365489 >> v2:172.21.15.87:3300/0 conn(0x7f085c158a20 0x7f085c0a89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.498+0000 7f0860e00640 1 -- 172.21.15.5:0/195365489 >> v1:172.21.15.87:6789/0 conn(0x7f085c158df0 legacy=0x7f085c15c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.498+0000 7f0860e00640 1 -- 172.21.15.5:0/195365489 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c0af630 con 0x7f085c0ae860 2024-08-17T02:26:57.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.499+0000 7f0860e00640 1 --2- 172.21.15.5:0/195365489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f085c0ae860 0x7f085c06d7d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f085c068a60 tx=0x7f08480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a32add9a19d3bf4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.499+0000 7f085be00640 1 -- 172.21.15.5:0/195365489 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084802ae80 con 0x7f085c0ae860 2024-08-17T02:26:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.499+0000 7f085be00640 1 -- 172.21.15.5:0/195365489 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0848032440 con 0x7f085c0ae860 2024-08-17T02:26:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.499+0000 7f085be00640 1 -- 172.21.15.5:0/195365489 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848032800 con 0x7f085c0ae860 2024-08-17T02:26:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.500+0000 7f0864200640 1 -- 172.21.15.5:0/195365489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f085c0ae860 msgr2=0x7f085c06d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.500+0000 7f0864200640 1 --2- 172.21.15.5:0/195365489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f085c0ae860 0x7f085c06d7d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f085c068a60 tx=0x7f08480091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.500+0000 7f0864200640 1 -- 172.21.15.5:0/195365489 shutdown_connections 2024-08-17T02:26:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.500+0000 7f0864200640 1 --2- 172.21.15.5:0/195365489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f085c0ae860 0x7f085c06d7d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.500+0000 7f0864200640 1 --2- 172.21.15.5:0/195365489 >> v2:172.21.15.87:3300/0 conn(0x7f085c158a20 0x7f085c0a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.500+0000 7f0864200640 1 -- 172.21.15.5:0/195365489 >> 172.21.15.5:0/195365489 conn(0x7f085c066e60 msgr2=0x7f085c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.500+0000 7f0864200640 1 -- 172.21.15.5:0/195365489 shutdown_connections 2024-08-17T02:26:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.500+0000 7f0864200640 1 -- 172.21.15.5:0/195365489 wait complete. 2024-08-17T02:26:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.501+0000 7f0864200640 1 Processor -- start 2024-08-17T02:26:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.502+0000 7f0864200640 1 -- start start 2024-08-17T02:26:57.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.502+0000 7f0864200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f085c0ae860 0x7f085c13fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.502+0000 7f0864200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f085c158a20 0x7f085c15cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.502+0000 7f0864200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f085c158df0 0x7f085c15d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.502+0000 7f0864200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085c15c820 con 0x7f085c158df0 2024-08-17T02:26:57.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.502+0000 7f0864200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085c15b780 con 0x7f085c0ae860 2024-08-17T02:26:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.502+0000 7f0864200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085c15ba60 con 0x7f085c158a20 2024-08-17T02:26:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.503+0000 7f0862200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f085c158df0 0x7f085c15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.503+0000 7f0862200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f085c158df0 0x7f085c15d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40714/0 (socket says 172.21.15.5:40714) 2024-08-17T02:26:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.503+0000 7f0862200640 1 -- 172.21.15.5:0/3234174592 learned_addr learned my addr 172.21.15.5:0/3234174592 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.503+0000 7f0861800640 1 --2- 172.21.15.5:0/3234174592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f085c0ae860 0x7f085c13fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.503+0000 7f0860e00640 1 --2- 172.21.15.5:0/3234174592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f085c158a20 0x7f085c15cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.503+0000 7f0862200640 1 -- 172.21.15.5:0/3234174592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f085c158a20 msgr2=0x7f085c15cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.503+0000 7f0862200640 1 --2- 172.21.15.5:0/3234174592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f085c158a20 0x7f085c15cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.503+0000 7f0862200640 1 -- 172.21.15.5:0/3234174592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f085c0ae860 msgr2=0x7f085c13fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.503+0000 7f0862200640 1 --2- 172.21.15.5:0/3234174592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f085c0ae860 0x7f085c13fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.503+0000 7f0862200640 1 -- 172.21.15.5:0/3234174592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0848009450 con 0x7f085c158df0 2024-08-17T02:26:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.503+0000 7f0862200640 1 --2- 172.21.15.5:0/3234174592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f085c158df0 0x7f085c15d020 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f085400c7c0 tx=0x7f08540015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.504+0000 7f0858c00640 1 -- 172.21.15.5:0/3234174592 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085400a640 con 0x7f085c158df0 2024-08-17T02:26:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.504+0000 7f0858c00640 1 -- 172.21.15.5:0/3234174592 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085400a7c0 con 0x7f085c158df0 2024-08-17T02:26:57.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.504+0000 7f0858c00640 1 -- 172.21.15.5:0/3234174592 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085400ab80 con 0x7f085c158df0 2024-08-17T02:26:57.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.504+0000 7f0864200640 1 -- 172.21.15.5:0/3234174592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085c15bd40 con 0x7f085c158df0 2024-08-17T02:26:57.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.504+0000 7f0864200640 1 -- 172.21.15.5:0/3234174592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085c15c300 con 0x7f085c158df0 2024-08-17T02:26:57.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.505+0000 7f0864200640 1 -- 172.21.15.5:0/3234174592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f085c15c4f0 con 0x7f085c158df0 2024-08-17T02:26:57.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.506+0000 7f0858c00640 1 -- 172.21.15.5:0/3234174592 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0854003030 con 0x7f085c158df0 2024-08-17T02:26:57.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.506+0000 7f0858c00640 1 --2- 172.21.15.5:0/3234174592 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f083c065150 0x7f083c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.507+0000 7f0858c00640 1 -- 172.21.15.5:0/3234174592 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f0854082380 con 0x7f085c158df0 2024-08-17T02:26:57.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.507+0000 7f0861800640 1 --2- 172.21.15.5:0/3234174592 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f083c065150 0x7f083c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.507+0000 7f0861800640 1 --2- 172.21.15.5:0/3234174592 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f083c065150 0x7f083c067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0850009d20 tx=0x7f08500090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.510+0000 7f0858c00640 1 -- 172.21.15.5:0/3234174592 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f08540503d0 con 0x7f085c158df0 2024-08-17T02:26:57.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.730+0000 7f0864200640 1 -- 172.21.15.5:0/3234174592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f085c063fb0 con 0x7f085c158df0 2024-08-17T02:26:57.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.730+0000 7f0858c00640 1 -- 172.21.15.5:0/3234174592 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f08540539f0 con 0x7f085c158df0 2024-08-17T02:26:57.731 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:26:57.731 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1398504310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1398504310},{"type":"v1","addr":"172.21.15.5:6837","nonce":1398504310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/1045077639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1045077639},{"type":"v1","addr":"172.21.15.87:6833","nonce":1045077639}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/940060904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":940060904},{"type":"v1","addr":"172.21.15.5:6836","nonce":940060904}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:44.295321+0000","modified":"2024-08-17T02:24:45.911915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4858},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4858":{"gid":4858,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.87:6835/1739323622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1739323622},{"type":"v1","addr":"172.21.15.87:6835","nonce":1739323622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001044363","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:26:57.732 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 22 2024-08-17T02:26:57.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.732+0000 7f0864200640 1 -- 172.21.15.5:0/3234174592 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f083c065150 msgr2=0x7f083c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.732+0000 7f0864200640 1 --2- 172.21.15.5:0/3234174592 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f083c065150 0x7f083c067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0850009d20 tx=0x7f08500090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.732+0000 7f0864200640 1 -- 172.21.15.5:0/3234174592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f085c158df0 msgr2=0x7f085c15d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.732+0000 7f0864200640 1 --2- 172.21.15.5:0/3234174592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f085c158df0 0x7f085c15d020 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f085400c7c0 tx=0x7f08540015f0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.732+0000 7f0864200640 1 -- 172.21.15.5:0/3234174592 shutdown_connections 2024-08-17T02:26:57.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.732+0000 7f0864200640 1 --2- 172.21.15.5:0/3234174592 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f083c065150 0x7f083c067600 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.732+0000 7f0864200640 1 --2- 172.21.15.5:0/3234174592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f085c158a20 0x7f085c15cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.733+0000 7f0864200640 1 --2- 172.21.15.5:0/3234174592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f085c158df0 0x7f085c15d020 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.733+0000 7f0864200640 1 --2- 172.21.15.5:0/3234174592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f085c0ae860 0x7f085c13fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.733+0000 7f0864200640 1 -- 172.21.15.5:0/3234174592 >> 172.21.15.5:0/3234174592 conn(0x7f085c066e60 msgr2=0x7f085c069830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.733+0000 7f0864200640 1 -- 172.21.15.5:0/3234174592 shutdown_connections 2024-08-17T02:26:57.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.733+0000 7f0864200640 1 -- 172.21.15.5:0/3234174592 wait complete. 2024-08-17T02:26:57.748 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.900+0000 7f946ac00640 1 Processor -- start 2024-08-17T02:26:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.900+0000 7f946ac00640 1 -- start start 2024-08-17T02:26:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.901+0000 7f946ac00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9464158990 0x7f94640ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.901+0000 7f946ac00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9464158d60 0x7f94640af590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.901+0000 7f946ac00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94640ce930 con 0x7f94640cd810 2024-08-17T02:26:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.901+0000 7f946ac00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94640cdd20 con 0x7f9464158990 2024-08-17T02:26:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.901+0000 7f946ac00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94640ce000 con 0x7f9464158d60 2024-08-17T02:26:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.901+0000 7f9468e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f94640cd810 0x7f94640cc520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48400/0 (socket says 172.21.15.5:48400) 2024-08-17T02:26:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.901+0000 7f9468e00640 1 -- 172.21.15.5:0/658885741 learned_addr learned my addr 172.21.15.5:0/658885741 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:26:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.901+0000 7f9469800640 1 --2- 172.21.15.5:0/658885741 >> v2:172.21.15.87:3300/0 conn(0x7f9464158990 0x7f94640ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.901+0000 7f946a200640 1 --2- 172.21.15.5:0/658885741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9464158d60 0x7f94640af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.902+0000 7f9463e00640 1 -- 172.21.15.5:0/658885741 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3900596288 0 0) 0x7f94640ce930 con 0x7f94640cd810 2024-08-17T02:26:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.902+0000 7f9463e00640 1 -- 172.21.15.5:0/658885741 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f944c0034e0 con 0x7f94640cd810 2024-08-17T02:26:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.902+0000 7f9469800640 1 -- 172.21.15.5:0/658885741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9464158d60 msgr2=0x7f94640af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.902+0000 7f9469800640 1 --2- 172.21.15.5:0/658885741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9464158d60 0x7f94640af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.902+0000 7f9469800640 1 -- 172.21.15.5:0/658885741 >> v1:172.21.15.5:6789/0 conn(0x7f94640cd810 legacy=0x7f94640cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.902+0000 7f9469800640 1 -- 172.21.15.5:0/658885741 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94640ce2e0 con 0x7f9464158990 2024-08-17T02:26:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.902+0000 7f946a200640 1 --2- 172.21.15.5:0/658885741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9464158d60 0x7f94640af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:57.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.903+0000 7f9469800640 1 --2- 172.21.15.5:0/658885741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9464158990 0x7f94640ca210 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9458009850 tx=0x7f94580090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13a06329bf1b7ded server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.903+0000 7f9463e00640 1 -- 172.21.15.5:0/658885741 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945802ae20 con 0x7f9464158990 2024-08-17T02:26:57.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.903+0000 7f9463e00640 1 -- 172.21.15.5:0/658885741 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9458032440 con 0x7f9464158990 2024-08-17T02:26:57.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.903+0000 7f9463e00640 1 -- 172.21.15.5:0/658885741 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458032820 con 0x7f9464158990 2024-08-17T02:26:57.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.904+0000 7f946ac00640 1 -- 172.21.15.5:0/658885741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9464158990 msgr2=0x7f94640ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.904+0000 7f946ac00640 1 --2- 172.21.15.5:0/658885741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9464158990 0x7f94640ca210 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9458009850 tx=0x7f94580090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.904+0000 7f946ac00640 1 -- 172.21.15.5:0/658885741 shutdown_connections 2024-08-17T02:26:57.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.904+0000 7f946ac00640 1 --2- 172.21.15.5:0/658885741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9464158d60 0x7f94640af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.904+0000 7f946ac00640 1 --2- 172.21.15.5:0/658885741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9464158990 0x7f94640ca210 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.904+0000 7f946ac00640 1 -- 172.21.15.5:0/658885741 >> 172.21.15.5:0/658885741 conn(0x7f946406e590 msgr2=0x7f946406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.904+0000 7f946ac00640 1 -- 172.21.15.5:0/658885741 shutdown_connections 2024-08-17T02:26:57.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.904+0000 7f946ac00640 1 -- 172.21.15.5:0/658885741 wait complete. 2024-08-17T02:26:57.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.905+0000 7f946ac00640 1 Processor -- start 2024-08-17T02:26:57.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.905+0000 7f946ac00640 1 -- start start 2024-08-17T02:26:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.906+0000 7f946ac00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94640cd810 0x7f9464155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.906+0000 7f946ac00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9464158990 0x7f94640c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.906+0000 7f946ac00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9464158d60 0x7f946414d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.906+0000 7f946ac00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9464156350 con 0x7f9464158990 2024-08-17T02:26:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.906+0000 7f946ac00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9464154d70 con 0x7f94640cd810 2024-08-17T02:26:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.906+0000 7f946ac00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9464155050 con 0x7f9464158d60 2024-08-17T02:26:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.907+0000 7f9468e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9464158990 0x7f94640c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.907+0000 7f9468e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9464158990 0x7f94640c90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40716/0 (socket says 172.21.15.5:40716) 2024-08-17T02:26:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.907+0000 7f9468e00640 1 -- 172.21.15.5:0/1731379953 learned_addr learned my addr 172.21.15.5:0/1731379953 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.907+0000 7f9469800640 1 --2- 172.21.15.5:0/1731379953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94640cd810 0x7f9464155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.907+0000 7f946a200640 1 --2- 172.21.15.5:0/1731379953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9464158d60 0x7f946414d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.907+0000 7f9468e00640 1 -- 172.21.15.5:0/1731379953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9464158d60 msgr2=0x7f946414d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.907+0000 7f9468e00640 1 --2- 172.21.15.5:0/1731379953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9464158d60 0x7f946414d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.907+0000 7f9468e00640 1 -- 172.21.15.5:0/1731379953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94640cd810 msgr2=0x7f9464155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.907+0000 7f9468e00640 1 --2- 172.21.15.5:0/1731379953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94640cd810 0x7f9464155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.907+0000 7f9468e00640 1 -- 172.21.15.5:0/1731379953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c009a20 con 0x7f9464158990 2024-08-17T02:26:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.907+0000 7f9468e00640 1 --2- 172.21.15.5:0/1731379953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9464158990 0x7f94640c90a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f945000c5b0 tx=0x7f9450007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.907+0000 7f9460c00640 1 -- 172.21.15.5:0/1731379953 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9450005b70 con 0x7f9464158990 2024-08-17T02:26:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.908+0000 7f9460c00640 1 -- 172.21.15.5:0/1731379953 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9450005cf0 con 0x7f9464158990 2024-08-17T02:26:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.908+0000 7f9460c00640 1 -- 172.21.15.5:0/1731379953 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9450005ea0 con 0x7f9464158990 2024-08-17T02:26:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.908+0000 7f946ac00640 1 -- 172.21.15.5:0/1731379953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9458009390 con 0x7f9464158990 2024-08-17T02:26:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.908+0000 7f946ac00640 1 -- 172.21.15.5:0/1731379953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9464155610 con 0x7f9464158990 2024-08-17T02:26:57.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.909+0000 7f946ac00640 1 -- 172.21.15.5:0/1731379953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9464070720 con 0x7f9464158990 2024-08-17T02:26:57.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.909+0000 7f9460c00640 1 -- 172.21.15.5:0/1731379953 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f94500075f0 con 0x7f9464158990 2024-08-17T02:26:57.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.910+0000 7f9460c00640 1 --2- 172.21.15.5:0/1731379953 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9444065150 0x7f9444067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.910+0000 7f9460c00640 1 -- 172.21.15.5:0/1731379953 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f9450081930 con 0x7f9464158990 2024-08-17T02:26:57.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.911+0000 7f9469800640 1 --2- 172.21.15.5:0/1731379953 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9444065150 0x7f9444067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.911+0000 7f9469800640 1 --2- 172.21.15.5:0/1731379953 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9444065150 0x7f9444067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9458034000 tx=0x7f9458032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:57.914+0000 7f9460c00640 1 -- 172.21.15.5:0/1731379953 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f945004f980 con 0x7f9464158990 2024-08-17T02:26:58.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.137+0000 7f946ac00640 1 -- 172.21.15.5:0/1731379953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9464068660 con 0x7f9464158990 2024-08-17T02:26:58.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.138+0000 7f9460c00640 1 -- 172.21.15.5:0/1731379953 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f9450052fa0 con 0x7f9464158990 2024-08-17T02:26:58.138 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:26:58.138 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1398504310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1398504310},{"type":"v1","addr":"172.21.15.5:6837","nonce":1398504310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/1045077639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1045077639},{"type":"v1","addr":"172.21.15.87:6833","nonce":1045077639}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/940060904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":940060904},{"type":"v1","addr":"172.21.15.5:6836","nonce":940060904}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:44.295321+0000","modified":"2024-08-17T02:24:45.911915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4858},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4858":{"gid":4858,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.87:6835/1739323622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1739323622},{"type":"v1","addr":"172.21.15.87:6835","nonce":1739323622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001044363","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:26:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 22 2024-08-17T02:26:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.140+0000 7f946ac00640 1 -- 172.21.15.5:0/1731379953 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9444065150 msgr2=0x7f9444067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.140+0000 7f946ac00640 1 --2- 172.21.15.5:0/1731379953 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9444065150 0x7f9444067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9458034000 tx=0x7f9458032000 comp rx=0 tx=0).stop 2024-08-17T02:26:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.140+0000 7f946ac00640 1 -- 172.21.15.5:0/1731379953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9464158990 msgr2=0x7f94640c90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.140+0000 7f946ac00640 1 --2- 172.21.15.5:0/1731379953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9464158990 0x7f94640c90a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f945000c5b0 tx=0x7f9450007d70 comp rx=0 tx=0).stop 2024-08-17T02:26:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.140+0000 7f946ac00640 1 -- 172.21.15.5:0/1731379953 shutdown_connections 2024-08-17T02:26:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.140+0000 7f946ac00640 1 --2- 172.21.15.5:0/1731379953 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9444065150 0x7f9444067600 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.140+0000 7f946ac00640 1 --2- 172.21.15.5:0/1731379953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9464158d60 0x7f946414d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.140+0000 7f946ac00640 1 --2- 172.21.15.5:0/1731379953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9464158990 0x7f94640c90a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.140+0000 7f946ac00640 1 --2- 172.21.15.5:0/1731379953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94640cd810 0x7f9464155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.140+0000 7f946ac00640 1 -- 172.21.15.5:0/1731379953 >> 172.21.15.5:0/1731379953 conn(0x7f946406e590 msgr2=0x7f94640c4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.140+0000 7f946ac00640 1 -- 172.21.15.5:0/1731379953 shutdown_connections 2024-08-17T02:26:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.140+0000 7f946ac00640 1 -- 172.21.15.5:0/1731379953 wait complete. 2024-08-17T02:26:58.156 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:58.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.308+0000 7f7219600640 1 Processor -- start 2024-08-17T02:26:58.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.308+0000 7f7219600640 1 -- start start 2024-08-17T02:26:58.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.309+0000 7f7219600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f72140ca050 0x7f7214156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.309+0000 7f7219600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72140cb160 con 0x7f72140add30 2024-08-17T02:26:58.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.309+0000 7f7219600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72140b0d10 con 0x7f72140ad960 2024-08-17T02:26:58.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.309+0000 7f7219600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72140ca550 con 0x7f72140ca050 2024-08-17T02:26:58.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.310+0000 7f7213400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f72140add30 0x7f72140aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48414/0 (socket says 172.21.15.5:48414) 2024-08-17T02:26:58.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.310+0000 7f7213400640 1 -- 172.21.15.5:0/3432696700 learned_addr learned my addr 172.21.15.5:0/3432696700 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:26:58.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.310+0000 7f720be00640 1 --2- 172.21.15.5:0/3432696700 >> v2:172.21.15.87:3300/0 conn(0x7f72140ca050 0x7f7214156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.310+0000 7f7212000640 1 -- 172.21.15.5:0/3432696700 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097542812 0 0) 0x7f72140cb160 con 0x7f72140add30 2024-08-17T02:26:58.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.310+0000 7f7212000640 1 -- 172.21.15.5:0/3432696700 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71f80034e0 con 0x7f72140add30 2024-08-17T02:26:58.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.310+0000 7f720be00640 1 -- 172.21.15.5:0/3432696700 >> v1:172.21.15.87:6789/0 conn(0x7f72140ad960 legacy=0x7f7214156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.310+0000 7f720be00640 1 -- 172.21.15.5:0/3432696700 >> v1:172.21.15.5:6789/0 conn(0x7f72140add30 legacy=0x7f72140aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.310+0000 7f720be00640 1 -- 172.21.15.5:0/3432696700 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72140ca830 con 0x7f72140ca050 2024-08-17T02:26:58.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.311+0000 7f720be00640 1 --2- 172.21.15.5:0/3432696700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72140ca050 0x7f7214156b30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009850 tx=0x7f71fc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=612842802fac64e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.312+0000 7f7212000640 1 -- 172.21.15.5:0/3432696700 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc032440 con 0x7f72140ca050 2024-08-17T02:26:58.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.312+0000 7f7212000640 1 -- 172.21.15.5:0/3432696700 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc0325a0 con 0x7f72140ca050 2024-08-17T02:26:58.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.312+0000 7f7212000640 1 -- 172.21.15.5:0/3432696700 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc032940 con 0x7f72140ca050 2024-08-17T02:26:58.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.313+0000 7f7219600640 1 -- 172.21.15.5:0/3432696700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72140ca050 msgr2=0x7f7214156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.313+0000 7f7219600640 1 --2- 172.21.15.5:0/3432696700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72140ca050 0x7f7214156b30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009850 tx=0x7f71fc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.313+0000 7f7219600640 1 -- 172.21.15.5:0/3432696700 shutdown_connections 2024-08-17T02:26:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.313+0000 7f7219600640 1 --2- 172.21.15.5:0/3432696700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72140ca050 0x7f7214156b30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.313+0000 7f7219600640 1 -- 172.21.15.5:0/3432696700 >> 172.21.15.5:0/3432696700 conn(0x7f7214066e60 msgr2=0x7f7214067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.313+0000 7f7219600640 1 -- 172.21.15.5:0/3432696700 shutdown_connections 2024-08-17T02:26:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.313+0000 7f7219600640 1 -- 172.21.15.5:0/3432696700 wait complete. 2024-08-17T02:26:58.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.314+0000 7f7219600640 1 Processor -- start 2024-08-17T02:26:58.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.315+0000 7f7219600640 1 -- start start 2024-08-17T02:26:58.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.315+0000 7f7219600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72140ad960 0x7f7214144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.315+0000 7f7219600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72140add30 0x7f721415b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.315+0000 7f7219600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72140ca050 0x7f7214157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.315+0000 7f7219600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72140a9530 con 0x7f72140add30 2024-08-17T02:26:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.315+0000 7f7219600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7214144970 con 0x7f72140ca050 2024-08-17T02:26:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.315+0000 7f7219600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72140a97d0 con 0x7f72140ad960 2024-08-17T02:26:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.316+0000 7f720be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72140add30 0x7f721415b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.316+0000 7f720be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72140add30 0x7f721415b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40726/0 (socket says 172.21.15.5:40726) 2024-08-17T02:26:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.316+0000 7f720be00640 1 -- 172.21.15.5:0/3628536062 learned_addr learned my addr 172.21.15.5:0/3628536062 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.316+0000 7f7213400640 1 --2- 172.21.15.5:0/3628536062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72140ca050 0x7f7214157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.316+0000 7f7212a00640 1 --2- 172.21.15.5:0/3628536062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72140ad960 0x7f7214144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.316+0000 7f720be00640 1 -- 172.21.15.5:0/3628536062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72140ad960 msgr2=0x7f7214144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.316+0000 7f720be00640 1 --2- 172.21.15.5:0/3628536062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72140ad960 0x7f7214144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.316+0000 7f720be00640 1 -- 172.21.15.5:0/3628536062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72140ca050 msgr2=0x7f7214157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.316+0000 7f720be00640 1 --2- 172.21.15.5:0/3628536062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72140ca050 0x7f7214157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.316+0000 7f720be00640 1 -- 172.21.15.5:0/3628536062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc009390 con 0x7f72140add30 2024-08-17T02:26:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.316+0000 7f7212a00640 1 --2- 172.21.15.5:0/3628536062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72140ad960 0x7f7214144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.316+0000 7f720be00640 1 --2- 172.21.15.5:0/3628536062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72140add30 0x7f721415b290 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f71fc035040 tx=0x7f71fc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.317+0000 7f720a000640 1 -- 172.21.15.5:0/3628536062 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc031bb0 con 0x7f72140add30 2024-08-17T02:26:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.317+0000 7f720a000640 1 -- 172.21.15.5:0/3628536062 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc031d30 con 0x7f72140add30 2024-08-17T02:26:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.317+0000 7f7219600640 1 -- 172.21.15.5:0/3628536062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721415bb70 con 0x7f72140add30 2024-08-17T02:26:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.317+0000 7f720a000640 1 -- 172.21.15.5:0/3628536062 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc03e6a0 con 0x7f72140add30 2024-08-17T02:26:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.317+0000 7f7219600640 1 -- 172.21.15.5:0/3628536062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721415c130 con 0x7f72140add30 2024-08-17T02:26:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.318+0000 7f7219600640 1 -- 172.21.15.5:0/3628536062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7214063fb0 con 0x7f72140add30 2024-08-17T02:26:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.319+0000 7f720a000640 1 -- 172.21.15.5:0/3628536062 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f71fc03c400 con 0x7f72140add30 2024-08-17T02:26:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.320+0000 7f720a000640 1 --2- 172.21.15.5:0/3628536062 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f71f0065150 0x7f71f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.320+0000 7f720a000640 1 -- 172.21.15.5:0/3628536062 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f71fc0a2910 con 0x7f72140add30 2024-08-17T02:26:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.320+0000 7f7212a00640 1 --2- 172.21.15.5:0/3628536062 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f71f0065150 0x7f71f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.320+0000 7f7212a00640 1 --2- 172.21.15.5:0/3628536062 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f71f0065150 0x7f71f0067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7204001820 tx=0x7f7204009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.324+0000 7f720a000640 1 -- 172.21.15.5:0/3628536062 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f71fc070960 con 0x7f72140add30 2024-08-17T02:26:58.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.508+0000 7f7219600640 1 -- 172.21.15.5:0/3628536062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72140a9910 con 0x7f72140add30 2024-08-17T02:26:58.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.509+0000 7f720a000640 1 -- 172.21.15.5:0/3628536062 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+15414 (secure 0 0 0) 0x7f71fc037090 con 0x7f72140add30 2024-08-17T02:26:58.509 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:26:58.509 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:26:55.043972+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000001044363.meta","create_time":"2024-08-17T02:24:42.487826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001044363"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001044363.data","create_time":"2024-08-17T02:24:43.336536+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001044363"}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6836/1918940200":"2024-08-18T02:26:51.946222+0000","172.21.15.5:6835/1918940200":"2024-08-18T02:26:51.946222+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:58.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.511+0000 7f7219600640 1 -- 172.21.15.5:0/3628536062 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f71f0065150 msgr2=0x7f71f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.511+0000 7f7219600640 1 --2- 172.21.15.5:0/3628536062 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f71f0065150 0x7f71f0067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7204001820 tx=0x7f7204009040 comp rx=0 tx=0).stop 2024-08-17T02:26:58.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.511+0000 7f7219600640 1 -- 172.21.15.5:0/3628536062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72140add30 msgr2=0x7f721415b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.511+0000 7f7219600640 1 --2- 172.21.15.5:0/3628536062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72140add30 0x7f721415b290 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f71fc035040 tx=0x7f71fc032000 comp rx=0 tx=0).stop 2024-08-17T02:26:58.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.511+0000 7f7219600640 1 -- 172.21.15.5:0/3628536062 shutdown_connections 2024-08-17T02:26:58.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.511+0000 7f7219600640 1 --2- 172.21.15.5:0/3628536062 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f71f0065150 0x7f71f0067600 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.511+0000 7f7219600640 1 --2- 172.21.15.5:0/3628536062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72140ca050 0x7f7214157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.511+0000 7f7219600640 1 --2- 172.21.15.5:0/3628536062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72140add30 0x7f721415b290 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.511+0000 7f7219600640 1 --2- 172.21.15.5:0/3628536062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72140ad960 0x7f7214144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.511+0000 7f7219600640 1 -- 172.21.15.5:0/3628536062 >> 172.21.15.5:0/3628536062 conn(0x7f7214066e60 msgr2=0x7f7214154cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.511+0000 7f7219600640 1 -- 172.21.15.5:0/3628536062 shutdown_connections 2024-08-17T02:26:58.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.511+0000 7f7219600640 1 -- 172.21.15.5:0/3628536062 wait complete. 2024-08-17T02:26:58.526 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000001044363 2024-08-17T02:26:58.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.678+0000 7fddb1e00640 1 Processor -- start 2024-08-17T02:26:58.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.678+0000 7fddb1e00640 1 -- start start 2024-08-17T02:26:58.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.679+0000 7fddb1e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fddac0ad960 0x7fddac15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.679+0000 7fddb1e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddac15b5e0 con 0x7fddac0add30 2024-08-17T02:26:58.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.679+0000 7fddb1e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddac0cb160 con 0x7fddac0ca050 2024-08-17T02:26:58.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.679+0000 7fddb1e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddac0b0d10 con 0x7fddac0ad960 2024-08-17T02:26:58.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.679+0000 7fddaaa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fddac0ad960 0x7fddac15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.679+0000 7fddab400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fddac0add30 0x7fddac0aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48416/0 (socket says 172.21.15.5:48416) 2024-08-17T02:26:58.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.679+0000 7fddab400640 1 -- 172.21.15.5:0/3636835654 learned_addr learned my addr 172.21.15.5:0/3636835654 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:26:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.680+0000 7fddaaa00640 1 -- 172.21.15.5:0/3636835654 >> v1:172.21.15.87:6789/0 conn(0x7fddac0ca050 legacy=0x7fddac156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.680+0000 7fddaaa00640 1 -- 172.21.15.5:0/3636835654 >> v1:172.21.15.5:6789/0 conn(0x7fddac0add30 legacy=0x7fddac0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.680+0000 7fddaaa00640 1 -- 172.21.15.5:0/3636835654 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac0ca550 con 0x7fddac0ad960 2024-08-17T02:26:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.680+0000 7fddaa000640 1 -- 172.21.15.5:0/3636835654 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918825928 0 0) 0x7fdda4001490 con 0x7fddac0add30 2024-08-17T02:26:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.681+0000 7fddaaa00640 1 --2- 172.21.15.5:0/3636835654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddac0ad960 0x7fddac15b0a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009850 tx=0x7fdd9c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46aa673fa018a5f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.681+0000 7fddaa000640 1 -- 172.21.15.5:0/3636835654 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c02ae40 con 0x7fddac0ad960 2024-08-17T02:26:58.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.681+0000 7fddaa000640 1 -- 172.21.15.5:0/3636835654 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c032440 con 0x7fddac0ad960 2024-08-17T02:26:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.681+0000 7fddaa000640 1 -- 172.21.15.5:0/3636835654 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c0327e0 con 0x7fddac0ad960 2024-08-17T02:26:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.682+0000 7fddb1e00640 1 -- 172.21.15.5:0/3636835654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddac0ad960 msgr2=0x7fddac15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.682+0000 7fddb1e00640 1 --2- 172.21.15.5:0/3636835654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddac0ad960 0x7fddac15b0a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009850 tx=0x7fdd9c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.682+0000 7fddb1e00640 1 -- 172.21.15.5:0/3636835654 shutdown_connections 2024-08-17T02:26:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.682+0000 7fddb1e00640 1 --2- 172.21.15.5:0/3636835654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddac0ad960 0x7fddac15b0a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.682+0000 7fddb1e00640 1 -- 172.21.15.5:0/3636835654 >> 172.21.15.5:0/3636835654 conn(0x7fddac066e60 msgr2=0x7fddac067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.682+0000 7fddb1e00640 1 -- 172.21.15.5:0/3636835654 shutdown_connections 2024-08-17T02:26:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.682+0000 7fddb1e00640 1 -- 172.21.15.5:0/3636835654 wait complete. 2024-08-17T02:26:58.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.683+0000 7fddb1e00640 1 Processor -- start 2024-08-17T02:26:58.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.683+0000 7fddb1e00640 1 -- start start 2024-08-17T02:26:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.684+0000 7fddb1e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddac0ad960 0x7fddac15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.684+0000 7fddb1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddac0add30 0x7fddac14fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.684+0000 7fddb1e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddac0ca050 0x7fddac15df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.684+0000 7fddb1e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac15dc10 con 0x7fddac0add30 2024-08-17T02:26:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.684+0000 7fddb1e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac15d240 con 0x7fddac0ca050 2024-08-17T02:26:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.684+0000 7fddb1e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddac15c630 con 0x7fddac0ad960 2024-08-17T02:26:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.684+0000 7fdda3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddac0add30 0x7fddac14fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.684+0000 7fdda3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddac0add30 0x7fddac14fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40752/0 (socket says 172.21.15.5:40752) 2024-08-17T02:26:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.684+0000 7fdda3e00640 1 -- 172.21.15.5:0/2680655188 learned_addr learned my addr 172.21.15.5:0/2680655188 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.685+0000 7fddaaa00640 1 --2- 172.21.15.5:0/2680655188 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddac0ad960 0x7fddac15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.685+0000 7fddab400640 1 --2- 172.21.15.5:0/2680655188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddac0ca050 0x7fddac15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.685+0000 7fdda3e00640 1 -- 172.21.15.5:0/2680655188 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddac0ad960 msgr2=0x7fddac15d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.685+0000 7fdda3e00640 1 --2- 172.21.15.5:0/2680655188 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddac0ad960 0x7fddac15d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.685+0000 7fdda3e00640 1 -- 172.21.15.5:0/2680655188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddac0ca050 msgr2=0x7fddac15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.685+0000 7fdda3e00640 1 --2- 172.21.15.5:0/2680655188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddac0ca050 0x7fddac15df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.685+0000 7fdda3e00640 1 -- 172.21.15.5:0/2680655188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c009390 con 0x7fddac0add30 2024-08-17T02:26:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.685+0000 7fdda3e00640 1 --2- 172.21.15.5:0/2680655188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddac0add30 0x7fddac14fe90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400b4f0 tx=0x7fdd940090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.685+0000 7fdda2000640 1 -- 172.21.15.5:0/2680655188 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9400f570 con 0x7fddac0add30 2024-08-17T02:26:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.685+0000 7fdda2000640 1 -- 172.21.15.5:0/2680655188 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9400f6d0 con 0x7fddac0add30 2024-08-17T02:26:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.685+0000 7fdda2000640 1 -- 172.21.15.5:0/2680655188 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9400fa90 con 0x7fddac0add30 2024-08-17T02:26:58.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.686+0000 7fddb1e00640 1 -- 172.21.15.5:0/2680655188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddac15c910 con 0x7fddac0add30 2024-08-17T02:26:58.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.686+0000 7fddb1e00640 1 -- 172.21.15.5:0/2680655188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddac15ced0 con 0x7fddac0add30 2024-08-17T02:26:58.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.687+0000 7fddb1e00640 1 -- 172.21.15.5:0/2680655188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddac15d3f0 con 0x7fddac0add30 2024-08-17T02:26:58.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.687+0000 7fdda2000640 1 -- 172.21.15.5:0/2680655188 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdd9401a460 con 0x7fddac0add30 2024-08-17T02:26:58.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.688+0000 7fdda2000640 1 --2- 172.21.15.5:0/2680655188 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdd88065150 0x7fdd88067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.688+0000 7fdda2000640 1 -- 172.21.15.5:0/2680655188 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fdd94082040 con 0x7fddac0add30 2024-08-17T02:26:58.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.688+0000 7fddaaa00640 1 --2- 172.21.15.5:0/2680655188 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdd88065150 0x7fdd88067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.689+0000 7fddaaa00640 1 --2- 172.21.15.5:0/2680655188 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdd88065150 0x7fdd88067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c034000 tx=0x7fdd9c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.692+0000 7fdda2000640 1 -- 172.21.15.5:0/2680655188 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fddac15d3f0 con 0x7fddac0add30 2024-08-17T02:26:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.916+0000 7fddb1e00640 1 -- 172.21.15.5:0/2680655188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000001044363"} v 0) v1 -- 0x7fddac15d3b0 con 0x7fddac0add30 2024-08-17T02:26:58.917 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-17T02:26:58.917+0000 7f09ca200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:26:58.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.921+0000 7fdda2000640 1 -- 172.21.15.5:0/2680655188 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000001044363"}]=0 volume_0000000001044363 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 195+0+0 (secure 0 0 0) 0x7fdd94050110 con 0x7fddac0add30 2024-08-17T02:26:58.922 INFO:teuthology.orchestra.run.smithi005.stderr:volume_0000000001044363 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:26:58.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.923+0000 7fddb1e00640 1 -- 172.21.15.5:0/2680655188 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdd88065150 msgr2=0x7fdd88067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.923+0000 7fddb1e00640 1 --2- 172.21.15.5:0/2680655188 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdd88065150 0x7fdd88067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c034000 tx=0x7fdd9c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:58.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.924+0000 7fddb1e00640 1 -- 172.21.15.5:0/2680655188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddac0add30 msgr2=0x7fddac14fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.924+0000 7fddb1e00640 1 --2- 172.21.15.5:0/2680655188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddac0add30 0x7fddac14fe90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400b4f0 tx=0x7fdd940090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.924+0000 7fddb1e00640 1 -- 172.21.15.5:0/2680655188 shutdown_connections 2024-08-17T02:26:58.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.924+0000 7fddb1e00640 1 --2- 172.21.15.5:0/2680655188 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fdd88065150 0x7fdd88067600 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.924+0000 7fddb1e00640 1 --2- 172.21.15.5:0/2680655188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddac0ca050 0x7fddac15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.924+0000 7fddb1e00640 1 --2- 172.21.15.5:0/2680655188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddac0add30 0x7fddac14fe90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.924+0000 7fddb1e00640 1 --2- 172.21.15.5:0/2680655188 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddac0ad960 0x7fddac15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.924+0000 7fddb1e00640 1 -- 172.21.15.5:0/2680655188 >> 172.21.15.5:0/2680655188 conn(0x7fddac066e60 msgr2=0x7fddac15e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.924+0000 7fddb1e00640 1 -- 172.21.15.5:0/2680655188 shutdown_connections 2024-08-17T02:26:58.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:58.924+0000 7fddb1e00640 1 -- 172.21.15.5:0/2680655188 wait complete. 2024-08-17T02:26:58.929 INFO:tasks.ceph.mds.b.smithi087.stderr: -3139> 2024-08-17T02:24:49.135+0000 7f4a21200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:26:58.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000001044363 --yes-i-really-mean-it 2024-08-17T02:26:58.971 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-08-17T02:26:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.093+0000 7f5c4be00640 1 Processor -- start 2024-08-17T02:26:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.094+0000 7f5c4be00640 1 -- start start 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.095+0000 7f5c4be00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c4c158b90 0x7f5c4c0cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.095+0000 7f5c4be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5c4c0ce710 0x7f5c4c0b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.095+0000 7f5c4be00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4c0afb00 con 0x7f5c4c0cc8f0 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.095+0000 7f5c4be00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4c0ccd60 con 0x7f5c4c0ce710 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.095+0000 7f5c4be00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0cf140 con 0x7f5c4c158b90 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.095+0000 7f5c4b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5c4c0ce710 0x7f5c4c0b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.095+0000 7f5c4b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5c4c0ce710 0x7f5c4c0b06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40758/0 (socket says 172.21.15.5:40758) 2024-08-17T02:26:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.095+0000 7f5c4b400640 1 -- 172.21.15.5:0/1347376475 learned_addr learned my addr 172.21.15.5:0/1347376475 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.095+0000 7f5c4aa00640 1 --2- 172.21.15.5:0/1347376475 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c4c158b90 0x7f5c4c0cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.096+0000 7f5c4b400640 1 -- 172.21.15.5:0/1347376475 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c4c158b90 msgr2=0x7f5c4c0cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.096+0000 7f5c4b400640 1 --2- 172.21.15.5:0/1347376475 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c4c158b90 0x7f5c4c0cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.096+0000 7f5c4b400640 1 -- 172.21.15.5:0/1347376475 >> v1:172.21.15.87:6789/0 conn(0x7f5c4c0cc8f0 legacy=0x7f5c4c0aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.096+0000 7f5c4b400640 1 -- 172.21.15.5:0/1347376475 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c0cf420 con 0x7f5c4c0ce710 2024-08-17T02:26:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.097+0000 7f5c4b400640 1 --2- 172.21.15.5:0/1347376475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c0ce710 0x7f5c4c0b06a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009f20 tx=0x7f5c44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d276478c5cd0fc7c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.097+0000 7f5c4a000640 1 -- 172.21.15.5:0/1347376475 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c44031400 con 0x7f5c4c0ce710 2024-08-17T02:26:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.097+0000 7f5c4a000640 1 -- 172.21.15.5:0/1347376475 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4402d050 con 0x7f5c4c0ce710 2024-08-17T02:26:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.097+0000 7f5c4a000640 1 -- 172.21.15.5:0/1347376475 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440317d0 con 0x7f5c4c0ce710 2024-08-17T02:26:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.097+0000 7f5c4be00640 1 -- 172.21.15.5:0/1347376475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c0ce710 msgr2=0x7f5c4c0b06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.097+0000 7f5c4be00640 1 --2- 172.21.15.5:0/1347376475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c0ce710 0x7f5c4c0b06a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009f20 tx=0x7f5c44009840 comp rx=0 tx=0).stop 2024-08-17T02:26:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.098+0000 7f5c4be00640 1 -- 172.21.15.5:0/1347376475 shutdown_connections 2024-08-17T02:26:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.098+0000 7f5c4be00640 1 --2- 172.21.15.5:0/1347376475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c0ce710 0x7f5c4c0b06a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.098+0000 7f5c4be00640 1 --2- 172.21.15.5:0/1347376475 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c4c158b90 0x7f5c4c0cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.098+0000 7f5c4be00640 1 -- 172.21.15.5:0/1347376475 >> 172.21.15.5:0/1347376475 conn(0x7f5c4c06f010 msgr2=0x7f5c4c068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.098+0000 7f5c4be00640 1 -- 172.21.15.5:0/1347376475 shutdown_connections 2024-08-17T02:26:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.098+0000 7f5c4be00640 1 -- 172.21.15.5:0/1347376475 wait complete. 2024-08-17T02:26:59.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.099+0000 7f5c4be00640 1 Processor -- start 2024-08-17T02:26:59.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.099+0000 7f5c4be00640 1 -- start start 2024-08-17T02:26:59.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.100+0000 7f5c4be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c0cc8f0 0x7f5c4c0b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.100+0000 7f5c4be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c4c0ce710 0x7f5c4c15b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.100+0000 7f5c4be00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c4c158b90 0x7f5c4c153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.100+0000 7f5c4be00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c159a00 con 0x7f5c4c0cc8f0 2024-08-17T02:26:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.100+0000 7f5c4be00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c15bdd0 con 0x7f5c4c0ce710 2024-08-17T02:26:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.100+0000 7f5c4be00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0b3f20 con 0x7f5c4c158b90 2024-08-17T02:26:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.100+0000 7f5c4aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c0cc8f0 0x7f5c4c0b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.100+0000 7f5c4aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c0cc8f0 0x7f5c4c0b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40766/0 (socket says 172.21.15.5:40766) 2024-08-17T02:26:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.100+0000 7f5c4aa00640 1 -- 172.21.15.5:0/2145706580 learned_addr learned my addr 172.21.15.5:0/2145706580 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:26:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.100+0000 7f5c43e00640 1 --2- 172.21.15.5:0/2145706580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c4c0ce710 0x7f5c4c15b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.101+0000 7f5c4b400640 1 --2- 172.21.15.5:0/2145706580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c4c158b90 0x7f5c4c153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.101+0000 7f5c4aa00640 1 -- 172.21.15.5:0/2145706580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c4c158b90 msgr2=0x7f5c4c153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.101+0000 7f5c4aa00640 1 --2- 172.21.15.5:0/2145706580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c4c158b90 0x7f5c4c153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.101+0000 7f5c4aa00640 1 -- 172.21.15.5:0/2145706580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c4c0ce710 msgr2=0x7f5c4c15b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.101+0000 7f5c4aa00640 1 --2- 172.21.15.5:0/2145706580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c4c0ce710 0x7f5c4c15b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.101+0000 7f5c4aa00640 1 -- 172.21.15.5:0/2145706580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c44009ae0 con 0x7f5c4c0cc8f0 2024-08-17T02:26:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.101+0000 7f5c4b400640 1 --2- 172.21.15.5:0/2145706580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c4c158b90 0x7f5c4c153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.101+0000 7f5c4aa00640 1 --2- 172.21.15.5:0/2145706580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c0cc8f0 0x7f5c4c0b2d30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00d890 tx=0x7f5c3c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.101+0000 7f5c42000640 1 -- 172.21.15.5:0/2145706580 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c00de20 con 0x7f5c4c0cc8f0 2024-08-17T02:26:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.101+0000 7f5c42000640 1 -- 172.21.15.5:0/2145706580 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c00b8d0 con 0x7f5c4c0cc8f0 2024-08-17T02:26:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.101+0000 7f5c42000640 1 -- 172.21.15.5:0/2145706580 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c00bc90 con 0x7f5c4c0cc8f0 2024-08-17T02:26:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.101+0000 7f5c4be00640 1 -- 172.21.15.5:0/2145706580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4c0b3310 con 0x7f5c4c0cc8f0 2024-08-17T02:26:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.102+0000 7f5c4be00640 1 -- 172.21.15.5:0/2145706580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4c0b38d0 con 0x7f5c4c0cc8f0 2024-08-17T02:26:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.103+0000 7f5c4be00640 1 -- 172.21.15.5:0/2145706580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4c070720 con 0x7f5c4c0cc8f0 2024-08-17T02:26:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.103+0000 7f5c42000640 1 -- 172.21.15.5:0/2145706580 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5c3c01e460 con 0x7f5c4c0cc8f0 2024-08-17T02:26:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.104+0000 7f5c42000640 1 --2- 172.21.15.5:0/2145706580 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5c28065180 0x7f5c28067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.104+0000 7f5c42000640 1 -- 172.21.15.5:0/2145706580 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f5c3c082bc0 con 0x7f5c4c0cc8f0 2024-08-17T02:26:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.105+0000 7f5c43e00640 1 --2- 172.21.15.5:0/2145706580 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5c28065180 0x7f5c28067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.105+0000 7f5c43e00640 1 --2- 172.21.15.5:0/2145706580 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5c28065180 0x7f5c28067630 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c16c3e0 tx=0x7f5c34007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.108+0000 7f5c42000640 1 -- 172.21.15.5:0/2145706580 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5c3c050b00 con 0x7f5c4c0cc8f0 2024-08-17T02:26:59.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.330+0000 7f5c4be00640 1 -- 172.21.15.5:0/2145706580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000001044363", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5c4c088700 con 0x7f5c4c0cc8f0 2024-08-17T02:26:59.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.922+0000 7f5c42000640 1 -- 172.21.15.5:0/2145706580 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000001044363", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 121+0+0 (secure 0 0 0) 0x7f5c3c054120 con 0x7f5c4c0cc8f0 2024-08-17T02:26:59.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.925+0000 7f5c4be00640 1 -- 172.21.15.5:0/2145706580 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5c28065180 msgr2=0x7f5c28067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.925+0000 7f5c4be00640 1 --2- 172.21.15.5:0/2145706580 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5c28065180 0x7f5c28067630 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c16c3e0 tx=0x7f5c34007e30 comp rx=0 tx=0).stop 2024-08-17T02:26:59.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.925+0000 7f5c4be00640 1 -- 172.21.15.5:0/2145706580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c0cc8f0 msgr2=0x7f5c4c0b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.925+0000 7f5c4be00640 1 --2- 172.21.15.5:0/2145706580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c0cc8f0 0x7f5c4c0b2d30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00d890 tx=0x7f5c3c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:59.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.925+0000 7f5c4be00640 1 -- 172.21.15.5:0/2145706580 shutdown_connections 2024-08-17T02:26:59.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.925+0000 7f5c4be00640 1 --2- 172.21.15.5:0/2145706580 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5c28065180 0x7f5c28067630 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.925+0000 7f5c4be00640 1 --2- 172.21.15.5:0/2145706580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c4c158b90 0x7f5c4c153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.925+0000 7f5c4be00640 1 --2- 172.21.15.5:0/2145706580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c4c0ce710 0x7f5c4c15b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.925+0000 7f5c4be00640 1 --2- 172.21.15.5:0/2145706580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c0cc8f0 0x7f5c4c0b2d30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.925+0000 7f5c4be00640 1 -- 172.21.15.5:0/2145706580 >> 172.21.15.5:0/2145706580 conn(0x7f5c4c06f010 msgr2=0x7f5c4c1571c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.925+0000 7f5c4be00640 1 -- 172.21.15.5:0/2145706580 shutdown_connections 2024-08-17T02:26:59.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:26:59.925+0000 7f5c4be00640 1 -- 172.21.15.5:0/2145706580 wait complete. 2024-08-17T02:26:59.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000001044363.meta cephfs.volume_0000000001044363.meta --yes-i-really-really-mean-it 2024-08-17T02:27:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.100+0000 7f6b69200640 1 Processor -- start 2024-08-17T02:27:00.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.100+0000 7f6b69200640 1 -- start start 2024-08-17T02:27:00.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.101+0000 7f6b69200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6b64158c70 0x7f6b640b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.101+0000 7f6b69200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6b64159040 0x7f6b640b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.101+0000 7f6b69200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b640b2500 con 0x7f6b640b3c80 2024-08-17T02:27:00.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.101+0000 7f6b69200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b640b47b0 con 0x7f6b64159040 2024-08-17T02:27:00.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.101+0000 7f6b69200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b640c6e50 con 0x7f6b64158c70 2024-08-17T02:27:00.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.101+0000 7f6b61400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6b64159040 0x7f6b640b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.101+0000 7f6b61400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6b64159040 0x7f6b640b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45960/0 (socket says 172.21.15.5:45960) 2024-08-17T02:27:00.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.101+0000 7f6b62800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6b640b3c80 0x7f6b640b40a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39134/0 (socket says 172.21.15.5:39134) 2024-08-17T02:27:00.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.101+0000 7f6b61400640 1 -- 172.21.15.5:0/4258228076 learned_addr learned my addr 172.21.15.5:0/4258228076 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:00.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.102+0000 7f6b61e00640 1 --2- 172.21.15.5:0/4258228076 >> v2:172.21.15.87:3300/0 conn(0x7f6b64158c70 0x7f6b640b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.102+0000 7f6b61400640 1 -- 172.21.15.5:0/4258228076 >> v2:172.21.15.87:3300/0 conn(0x7f6b64158c70 msgr2=0x7f6b640b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:00.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.102+0000 7f6b61400640 1 --2- 172.21.15.5:0/4258228076 >> v2:172.21.15.87:3300/0 conn(0x7f6b64158c70 0x7f6b640b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.102+0000 7f6b61400640 1 -- 172.21.15.5:0/4258228076 >> v1:172.21.15.5:6789/0 conn(0x7f6b640b3c80 legacy=0x7f6b640b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.102+0000 7f6b61400640 1 -- 172.21.15.5:0/4258228076 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b640b4990 con 0x7f6b64159040 2024-08-17T02:27:00.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.102+0000 7f6b60a00640 1 -- 172.21.15.5:0/4258228076 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253877336 0 0) 0x7f6b640b2500 con 0x7f6b640b3c80 2024-08-17T02:27:00.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.103+0000 7f6b61400640 1 --2- 172.21.15.5:0/4258228076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b64159040 0x7f6b640b1fc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6b64064f60 tx=0x7f6b500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62b6b8ee09b12fb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.103+0000 7f6b60a00640 1 -- 172.21.15.5:0/4258228076 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50032440 con 0x7f6b64159040 2024-08-17T02:27:00.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.103+0000 7f6b60a00640 1 -- 172.21.15.5:0/4258228076 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b500325a0 con 0x7f6b64159040 2024-08-17T02:27:00.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.103+0000 7f6b60a00640 1 -- 172.21.15.5:0/4258228076 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50032940 con 0x7f6b64159040 2024-08-17T02:27:00.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.104+0000 7f6b69200640 1 -- 172.21.15.5:0/4258228076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b64159040 msgr2=0x7f6b640b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.104+0000 7f6b69200640 1 --2- 172.21.15.5:0/4258228076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b64159040 0x7f6b640b1fc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6b64064f60 tx=0x7f6b500091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.104+0000 7f6b69200640 1 -- 172.21.15.5:0/4258228076 shutdown_connections 2024-08-17T02:27:00.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.104+0000 7f6b69200640 1 --2- 172.21.15.5:0/4258228076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b64159040 0x7f6b640b1fc0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.104+0000 7f6b69200640 1 --2- 172.21.15.5:0/4258228076 >> v2:172.21.15.87:3300/0 conn(0x7f6b64158c70 0x7f6b640b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.104+0000 7f6b69200640 1 -- 172.21.15.5:0/4258228076 >> 172.21.15.5:0/4258228076 conn(0x7f6b6406e590 msgr2=0x7f6b6406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.104+0000 7f6b69200640 1 -- 172.21.15.5:0/4258228076 shutdown_connections 2024-08-17T02:27:00.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.104+0000 7f6b69200640 1 -- 172.21.15.5:0/4258228076 wait complete. 2024-08-17T02:27:00.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.105+0000 7f6b69200640 1 Processor -- start 2024-08-17T02:27:00.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.106+0000 7f6b69200640 1 -- start start 2024-08-17T02:27:00.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.107+0000 7f6b69200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b640b3c80 0x7f6b64154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.107+0000 7f6b69200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b64158c70 0x7f6b64154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.107+0000 7f6b69200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b64159040 0x7f6b64159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.107+0000 7f6b69200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6415cbd0 con 0x7f6b64159040 2024-08-17T02:27:00.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.107+0000 7f6b69200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6415c7f0 con 0x7f6b64158c70 2024-08-17T02:27:00.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.107+0000 7f6b69200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b64154c70 con 0x7f6b640b3c80 2024-08-17T02:27:00.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.107+0000 7f6b62800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b64159040 0x7f6b64159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.107+0000 7f6b62800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b64159040 0x7f6b64159500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45974/0 (socket says 172.21.15.5:45974) 2024-08-17T02:27:00.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.107+0000 7f6b62800640 1 -- 172.21.15.5:0/121717615 learned_addr learned my addr 172.21.15.5:0/121717615 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:00.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.107+0000 7f6b61400640 1 --2- 172.21.15.5:0/121717615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b64158c70 0x7f6b64154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.107+0000 7f6b61e00640 1 --2- 172.21.15.5:0/121717615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b640b3c80 0x7f6b64154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.107+0000 7f6b62800640 1 -- 172.21.15.5:0/121717615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b640b3c80 msgr2=0x7f6b64154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.107+0000 7f6b62800640 1 --2- 172.21.15.5:0/121717615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b640b3c80 0x7f6b64154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.107+0000 7f6b62800640 1 -- 172.21.15.5:0/121717615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b64158c70 msgr2=0x7f6b64154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.107+0000 7f6b62800640 1 --2- 172.21.15.5:0/121717615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b64158c70 0x7f6b64154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.107+0000 7f6b62800640 1 -- 172.21.15.5:0/121717615 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b50009450 con 0x7f6b64159040 2024-08-17T02:27:00.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.108+0000 7f6b62800640 1 --2- 172.21.15.5:0/121717615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b64159040 0x7f6b64159500 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00c820 tx=0x7f6b5c0015d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.108+0000 7f6b59600640 1 -- 172.21.15.5:0/121717615 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c00ce10 con 0x7f6b64159040 2024-08-17T02:27:00.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.108+0000 7f6b59600640 1 -- 172.21.15.5:0/121717615 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5c005d60 con 0x7f6b64159040 2024-08-17T02:27:00.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.108+0000 7f6b59600640 1 -- 172.21.15.5:0/121717615 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c00a890 con 0x7f6b64159040 2024-08-17T02:27:00.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.108+0000 7f6b69200640 1 -- 172.21.15.5:0/121717615 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b64159a40 con 0x7f6b64159040 2024-08-17T02:27:00.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.108+0000 7f6b69200640 1 -- 172.21.15.5:0/121717615 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6415c510 con 0x7f6b64159040 2024-08-17T02:27:00.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.109+0000 7f6b69200640 1 -- 172.21.15.5:0/121717615 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6415c9a0 con 0x7f6b64159040 2024-08-17T02:27:00.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.110+0000 7f6b59600640 1 -- 172.21.15.5:0/121717615 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6b5c00ac80 con 0x7f6b64159040 2024-08-17T02:27:00.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.111+0000 7f6b59600640 1 --2- 172.21.15.5:0/121717615 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6b440651d0 0x7f6b44067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.111+0000 7f6b59600640 1 -- 172.21.15.5:0/121717615 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f6b5c082150 con 0x7f6b64159040 2024-08-17T02:27:00.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.111+0000 7f6b61e00640 1 --2- 172.21.15.5:0/121717615 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6b440651d0 0x7f6b44067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.111+0000 7f6b61e00640 1 --2- 172.21.15.5:0/121717615 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6b440651d0 0x7f6b44067680 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009d20 tx=0x7f6b540090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.114+0000 7f6b59600640 1 -- 172.21.15.5:0/121717615 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6b6415c9a0 con 0x7f6b64159040 2024-08-17T02:27:00.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:00.296+0000 7f6b69200640 1 -- 172.21.15.5:0/121717615 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001044363.meta", "pool2": "cephfs.volume_0000000001044363.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6b6415c9a0 con 0x7f6b64159040 2024-08-17T02:27:01.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.074+0000 7f6b59600640 1 -- 172.21.15.5:0/121717615 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001044363.meta", "pool2": "cephfs.volume_0000000001044363.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000001044363.meta' removed v44) v1 ==== 241+0+0 (secure 0 0 0) 0x7f6b6415c9a0 con 0x7f6b64159040 2024-08-17T02:27:01.075 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs.volume_0000000001044363.meta' removed 2024-08-17T02:27:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.078+0000 7f6b69200640 1 -- 172.21.15.5:0/121717615 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6b440651d0 msgr2=0x7f6b44067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.078+0000 7f6b69200640 1 --2- 172.21.15.5:0/121717615 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6b440651d0 0x7f6b44067680 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009d20 tx=0x7f6b540090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.078+0000 7f6b69200640 1 -- 172.21.15.5:0/121717615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b64159040 msgr2=0x7f6b64159500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.078+0000 7f6b69200640 1 --2- 172.21.15.5:0/121717615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b64159040 0x7f6b64159500 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00c820 tx=0x7f6b5c0015d0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.078+0000 7f6b69200640 1 -- 172.21.15.5:0/121717615 shutdown_connections 2024-08-17T02:27:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.078+0000 7f6b69200640 1 --2- 172.21.15.5:0/121717615 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6b440651d0 0x7f6b44067680 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.078+0000 7f6b69200640 1 --2- 172.21.15.5:0/121717615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b64159040 0x7f6b64159500 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.078+0000 7f6b69200640 1 --2- 172.21.15.5:0/121717615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b64158c70 0x7f6b64154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.078+0000 7f6b69200640 1 --2- 172.21.15.5:0/121717615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b640b3c80 0x7f6b64154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.078+0000 7f6b69200640 1 -- 172.21.15.5:0/121717615 >> 172.21.15.5:0/121717615 conn(0x7f6b6406e590 msgr2=0x7f6b641560c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.078+0000 7f6b69200640 1 -- 172.21.15.5:0/121717615 shutdown_connections 2024-08-17T02:27:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.078+0000 7f6b69200640 1 -- 172.21.15.5:0/121717615 wait complete. 2024-08-17T02:27:01.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000001044363.data cephfs.volume_0000000001044363.data --yes-i-really-really-mean-it 2024-08-17T02:27:01.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.257+0000 7fc196800640 1 Processor -- start 2024-08-17T02:27:01.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.257+0000 7fc196800640 1 -- start start 2024-08-17T02:27:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.259+0000 7fc196800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1901589a0 0x7fc1900acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.259+0000 7fc196800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc190159b40 0x7fc19006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.259+0000 7fc196800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1900cd450 con 0x7fc1900aef70 2024-08-17T02:27:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.259+0000 7fc196800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1900af3c0 con 0x7fc190159b40 2024-08-17T02:27:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.259+0000 7fc196800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900ad380 con 0x7fc1901589a0 2024-08-17T02:27:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.259+0000 7fc18fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc190159b40 0x7fc19006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.259+0000 7fc18fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc190159b40 0x7fc19006e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45978/0 (socket says 172.21.15.5:45978) 2024-08-17T02:27:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.259+0000 7fc18fe00640 1 -- 172.21.15.5:0/4221761155 learned_addr learned my addr 172.21.15.5:0/4221761155 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.259+0000 7fc187e00640 1 --1- 172.21.15.5:0/4221761155 >> v1:172.21.15.5:6789/0 conn(0x7fc1900aef70 0x7fc190158d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39144/0 (socket says 172.21.15.5:39144) 2024-08-17T02:27:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.259+0000 7fc18f400640 1 --2- 172.21.15.5:0/4221761155 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1901589a0 0x7fc1900acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.259+0000 7fc18fe00640 1 -- 172.21.15.5:0/4221761155 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1901589a0 msgr2=0x7fc1900acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.259+0000 7fc18fe00640 1 --2- 172.21.15.5:0/4221761155 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1901589a0 0x7fc1900acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.259+0000 7fc18fe00640 1 -- 172.21.15.5:0/4221761155 >> v1:172.21.15.5:6789/0 conn(0x7fc1900aef70 legacy=0x7fc190158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.259+0000 7fc18fe00640 1 -- 172.21.15.5:0/4221761155 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1900ad660 con 0x7fc190159b40 2024-08-17T02:27:01.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.260+0000 7fc18fe00640 1 --2- 172.21.15.5:0/4221761155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc190159b40 0x7fc19006e8d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc188009f20 tx=0x7fc188009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645261d527e1f5b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.261+0000 7fc18ea00640 1 -- 172.21.15.5:0/4221761155 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc188031400 con 0x7fc190159b40 2024-08-17T02:27:01.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.261+0000 7fc18ea00640 1 -- 172.21.15.5:0/4221761155 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18802d050 con 0x7fc190159b40 2024-08-17T02:27:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.261+0000 7fc18ea00640 1 -- 172.21.15.5:0/4221761155 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1880317d0 con 0x7fc190159b40 2024-08-17T02:27:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.261+0000 7fc196800640 1 -- 172.21.15.5:0/4221761155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc190159b40 msgr2=0x7fc19006e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.261+0000 7fc196800640 1 --2- 172.21.15.5:0/4221761155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc190159b40 0x7fc19006e8d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc188009f20 tx=0x7fc188009840 comp rx=0 tx=0).stop 2024-08-17T02:27:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.261+0000 7fc196800640 1 -- 172.21.15.5:0/4221761155 shutdown_connections 2024-08-17T02:27:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.261+0000 7fc196800640 1 --2- 172.21.15.5:0/4221761155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc190159b40 0x7fc19006e8d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.261+0000 7fc196800640 1 --2- 172.21.15.5:0/4221761155 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1901589a0 0x7fc1900acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.261+0000 7fc196800640 1 -- 172.21.15.5:0/4221761155 >> 172.21.15.5:0/4221761155 conn(0x7fc19006c760 msgr2=0x7fc19006cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.261+0000 7fc196800640 1 -- 172.21.15.5:0/4221761155 shutdown_connections 2024-08-17T02:27:01.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.261+0000 7fc196800640 1 -- 172.21.15.5:0/4221761155 wait complete. 2024-08-17T02:27:01.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.263+0000 7fc196800640 1 Processor -- start 2024-08-17T02:27:01.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.263+0000 7fc196800640 1 -- start start 2024-08-17T02:27:01.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.264+0000 7fc196800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1900aef70 0x7fc19015ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.264+0000 7fc196800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1901589a0 0x7fc19015c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.264+0000 7fc196800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc190159b40 0x7fc19015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.264+0000 7fc196800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1901696a0 con 0x7fc190159b40 2024-08-17T02:27:01.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.264+0000 7fc196800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc190154010 con 0x7fc1901589a0 2024-08-17T02:27:01.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.264+0000 7fc196800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19015d340 con 0x7fc1900aef70 2024-08-17T02:27:01.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.264+0000 7fc18fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc190159b40 0x7fc19015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.264+0000 7fc18fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc190159b40 0x7fc19015cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45982/0 (socket says 172.21.15.5:45982) 2024-08-17T02:27:01.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.264+0000 7fc18fe00640 1 -- 172.21.15.5:0/1475292805 learned_addr learned my addr 172.21.15.5:0/1475292805 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:01.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.264+0000 7fc18f400640 1 --2- 172.21.15.5:0/1475292805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1900aef70 0x7fc19015ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.264+0000 7fc187e00640 1 --2- 172.21.15.5:0/1475292805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1901589a0 0x7fc19015c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.265+0000 7fc18fe00640 1 -- 172.21.15.5:0/1475292805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1900aef70 msgr2=0x7fc19015ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.265+0000 7fc18fe00640 1 --2- 172.21.15.5:0/1475292805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1900aef70 0x7fc19015ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.265+0000 7fc18fe00640 1 -- 172.21.15.5:0/1475292805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1901589a0 msgr2=0x7fc19015c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.265+0000 7fc18fe00640 1 --2- 172.21.15.5:0/1475292805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1901589a0 0x7fc19015c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.265+0000 7fc18fe00640 1 -- 172.21.15.5:0/1475292805 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc188009ae0 con 0x7fc190159b40 2024-08-17T02:27:01.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.265+0000 7fc18fe00640 1 --2- 172.21.15.5:0/1475292805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc190159b40 0x7fc19015cd30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc188009f80 tx=0x7fc188036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.265+0000 7fc186a00640 1 -- 172.21.15.5:0/1475292805 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc188008e50 con 0x7fc190159b40 2024-08-17T02:27:01.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.265+0000 7fc186a00640 1 -- 172.21.15.5:0/1475292805 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18803b410 con 0x7fc190159b40 2024-08-17T02:27:01.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.265+0000 7fc186a00640 1 -- 172.21.15.5:0/1475292805 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18803b7d0 con 0x7fc190159b40 2024-08-17T02:27:01.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.265+0000 7fc196800640 1 -- 172.21.15.5:0/1475292805 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19015d620 con 0x7fc190159b40 2024-08-17T02:27:01.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.265+0000 7fc196800640 1 -- 172.21.15.5:0/1475292805 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19015dbe0 con 0x7fc190159b40 2024-08-17T02:27:01.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.267+0000 7fc196800640 1 -- 172.21.15.5:0/1475292805 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc190169810 con 0x7fc190159b40 2024-08-17T02:27:01.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.267+0000 7fc186a00640 1 -- 172.21.15.5:0/1475292805 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc188038050 con 0x7fc190159b40 2024-08-17T02:27:01.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.268+0000 7fc186a00640 1 --2- 172.21.15.5:0/1475292805 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc16c065150 0x7fc16c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.268+0000 7fc186a00640 1 -- 172.21.15.5:0/1475292805 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5448+0+0 (secure 0 0 0) 0x7fc1880a30a0 con 0x7fc190159b40 2024-08-17T02:27:01.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.268+0000 7fc18f400640 1 --2- 172.21.15.5:0/1475292805 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc16c065150 0x7fc16c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.269+0000 7fc18f400640 1 --2- 172.21.15.5:0/1475292805 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc16c065150 0x7fc16c067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc180007ba0 tx=0x7fc180008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.273+0000 7fc186a00640 1 -- 172.21.15.5:0/1475292805 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc190169810 con 0x7fc190159b40 2024-08-17T02:27:01.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:01.462+0000 7fc196800640 1 -- 172.21.15.5:0/1475292805 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001044363.data", "pool2": "cephfs.volume_0000000001044363.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc190169810 con 0x7fc190159b40 2024-08-17T02:27:02.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.077+0000 7fc186a00640 1 -- 172.21.15.5:0/1475292805 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001044363.data", "pool2": "cephfs.volume_0000000001044363.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000001044363.data' removed v45) v1 ==== 241+0+0 (secure 0 0 0) 0x7fc190169810 con 0x7fc190159b40 2024-08-17T02:27:02.078 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs.volume_0000000001044363.data' removed 2024-08-17T02:27:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.080+0000 7fc196800640 1 -- 172.21.15.5:0/1475292805 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc16c065150 msgr2=0x7fc16c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.080+0000 7fc196800640 1 --2- 172.21.15.5:0/1475292805 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc16c065150 0x7fc16c067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc180007ba0 tx=0x7fc180008040 comp rx=0 tx=0).stop 2024-08-17T02:27:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.080+0000 7fc196800640 1 -- 172.21.15.5:0/1475292805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc190159b40 msgr2=0x7fc19015cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.080+0000 7fc196800640 1 --2- 172.21.15.5:0/1475292805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc190159b40 0x7fc19015cd30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc188009f80 tx=0x7fc188036000 comp rx=0 tx=0).stop 2024-08-17T02:27:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.081+0000 7fc196800640 1 -- 172.21.15.5:0/1475292805 shutdown_connections 2024-08-17T02:27:02.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.081+0000 7fc196800640 1 --2- 172.21.15.5:0/1475292805 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fc16c065150 0x7fc16c067600 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.081+0000 7fc196800640 1 --2- 172.21.15.5:0/1475292805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc190159b40 0x7fc19015cd30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.081+0000 7fc196800640 1 --2- 172.21.15.5:0/1475292805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1901589a0 0x7fc19015c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.081+0000 7fc196800640 1 --2- 172.21.15.5:0/1475292805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1900aef70 0x7fc19015ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.081+0000 7fc196800640 1 -- 172.21.15.5:0/1475292805 >> 172.21.15.5:0/1475292805 conn(0x7fc19006c760 msgr2=0x7fc19015ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.081+0000 7fc196800640 1 -- 172.21.15.5:0/1475292805 shutdown_connections 2024-08-17T02:27:02.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.081+0000 7fc196800640 1 -- 172.21.15.5:0/1475292805 wait complete. 2024-08-17T02:27:02.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:27:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.253+0000 7f0b5b200640 1 Processor -- start 2024-08-17T02:27:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.253+0000 7f0b5b200640 1 -- start start 2024-08-17T02:27:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.254+0000 7f0b5b200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b54159100 0x7f0b540aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.254+0000 7f0b5b200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0b54067f70 0x7f0b540af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.254+0000 7f0b5b200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b540b14e0 con 0x7f0b54069d40 2024-08-17T02:27:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.254+0000 7f0b5b200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b54069210 con 0x7f0b54067f70 2024-08-17T02:27:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.254+0000 7f0b5b200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b540694f0 con 0x7f0b54159100 2024-08-17T02:27:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.255+0000 7f0b53400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0b54069d40 0x7f0b540ccc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39158/0 (socket says 172.21.15.5:39158) 2024-08-17T02:27:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.255+0000 7f0b53400640 1 -- 172.21.15.5:0/2672200756 learned_addr learned my addr 172.21.15.5:0/2672200756 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.255+0000 7f0b53e00640 1 --2- 172.21.15.5:0/2672200756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b54159100 0x7f0b540aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.255+0000 7f0b59200640 1 --2- 172.21.15.5:0/2672200756 >> v2:172.21.15.87:3300/0 conn(0x7f0b54067f70 0x7f0b540af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.255+0000 7f0b52a00640 1 -- 172.21.15.5:0/2672200756 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470997152 0 0) 0x7f0b540b14e0 con 0x7f0b54069d40 2024-08-17T02:27:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.255+0000 7f0b52a00640 1 -- 172.21.15.5:0/2672200756 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b380034e0 con 0x7f0b54069d40 2024-08-17T02:27:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.255+0000 7f0b53e00640 1 -- 172.21.15.5:0/2672200756 >> v2:172.21.15.87:3300/0 conn(0x7f0b54067f70 msgr2=0x7f0b540af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.255+0000 7f0b53e00640 1 --2- 172.21.15.5:0/2672200756 >> v2:172.21.15.87:3300/0 conn(0x7f0b54067f70 0x7f0b540af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.255+0000 7f0b53e00640 1 -- 172.21.15.5:0/2672200756 >> v1:172.21.15.5:6789/0 conn(0x7f0b54069d40 legacy=0x7f0b540ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.255+0000 7f0b53e00640 1 -- 172.21.15.5:0/2672200756 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b540697d0 con 0x7f0b54159100 2024-08-17T02:27:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.256+0000 7f0b53e00640 1 --2- 172.21.15.5:0/2672200756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b54159100 0x7f0b540aeae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009850 tx=0x7f0b440090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac35e611dc52750a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.257+0000 7f0b52a00640 1 -- 172.21.15.5:0/2672200756 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4402ad00 con 0x7f0b54159100 2024-08-17T02:27:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.257+0000 7f0b52a00640 1 -- 172.21.15.5:0/2672200756 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4402ae60 con 0x7f0b54159100 2024-08-17T02:27:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.257+0000 7f0b52a00640 1 -- 172.21.15.5:0/2672200756 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44032670 con 0x7f0b54159100 2024-08-17T02:27:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.257+0000 7f0b5b200640 1 -- 172.21.15.5:0/2672200756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b54159100 msgr2=0x7f0b540aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.257+0000 7f0b5b200640 1 --2- 172.21.15.5:0/2672200756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b54159100 0x7f0b540aeae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009850 tx=0x7f0b440090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.257+0000 7f0b5b200640 1 -- 172.21.15.5:0/2672200756 shutdown_connections 2024-08-17T02:27:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.257+0000 7f0b5b200640 1 --2- 172.21.15.5:0/2672200756 >> v2:172.21.15.87:3300/0 conn(0x7f0b54067f70 0x7f0b540af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.257+0000 7f0b5b200640 1 --2- 172.21.15.5:0/2672200756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b54159100 0x7f0b540aeae0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.257+0000 7f0b5b200640 1 -- 172.21.15.5:0/2672200756 >> 172.21.15.5:0/2672200756 conn(0x7f0b540ce5e0 msgr2=0x7f0b54095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.257+0000 7f0b5b200640 1 -- 172.21.15.5:0/2672200756 shutdown_connections 2024-08-17T02:27:02.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.257+0000 7f0b5b200640 1 -- 172.21.15.5:0/2672200756 wait complete. 2024-08-17T02:27:02.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.259+0000 7f0b5b200640 1 Processor -- start 2024-08-17T02:27:02.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.259+0000 7f0b5b200640 1 -- start start 2024-08-17T02:27:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.260+0000 7f0b5b200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b54067f70 0x7f0b54169380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.260+0000 7f0b5b200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54069d40 0x7f0b5409a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.260+0000 7f0b5b200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b54159100 0x7f0b5409adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.260+0000 7f0b5b200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b540c3d60 con 0x7f0b54069d40 2024-08-17T02:27:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.260+0000 7f0b5b200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b540c43e0 con 0x7f0b54159100 2024-08-17T02:27:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.260+0000 7f0b5b200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b540c37a0 con 0x7f0b54067f70 2024-08-17T02:27:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.260+0000 7f0b53400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54069d40 0x7f0b5409a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.260+0000 7f0b53400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54069d40 0x7f0b5409a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45984/0 (socket says 172.21.15.5:45984) 2024-08-17T02:27:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.260+0000 7f0b53400640 1 -- 172.21.15.5:0/300492025 learned_addr learned my addr 172.21.15.5:0/300492025 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.260+0000 7f0b53e00640 1 --2- 172.21.15.5:0/300492025 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b54067f70 0x7f0b54169380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.260+0000 7f0b59200640 1 --2- 172.21.15.5:0/300492025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b54159100 0x7f0b5409adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.260+0000 7f0b53400640 1 -- 172.21.15.5:0/300492025 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b54067f70 msgr2=0x7f0b54169380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.260+0000 7f0b53400640 1 --2- 172.21.15.5:0/300492025 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b54067f70 0x7f0b54169380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.260+0000 7f0b53400640 1 -- 172.21.15.5:0/300492025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b54159100 msgr2=0x7f0b5409adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.260+0000 7f0b53400640 1 --2- 172.21.15.5:0/300492025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b54159100 0x7f0b5409adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.260+0000 7f0b53400640 1 -- 172.21.15.5:0/300492025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b44009390 con 0x7f0b54069d40 2024-08-17T02:27:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.261+0000 7f0b53400640 1 --2- 172.21.15.5:0/300492025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54069d40 0x7f0b5409a880 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000c5b0 tx=0x7f0b40007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.261+0000 7f0b4b400640 1 -- 172.21.15.5:0/300492025 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40005aa0 con 0x7f0b54069d40 2024-08-17T02:27:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.261+0000 7f0b4b400640 1 -- 172.21.15.5:0/300492025 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b40005c00 con 0x7f0b54069d40 2024-08-17T02:27:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.261+0000 7f0b5b200640 1 -- 172.21.15.5:0/300492025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b540c3a80 con 0x7f0b54069d40 2024-08-17T02:27:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.261+0000 7f0b4b400640 1 -- 172.21.15.5:0/300492025 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b400070f0 con 0x7f0b54069d40 2024-08-17T02:27:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.261+0000 7f0b5b200640 1 -- 172.21.15.5:0/300492025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b541698c0 con 0x7f0b54069d40 2024-08-17T02:27:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.262+0000 7f0b5b200640 1 -- 172.21.15.5:0/300492025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b540c4590 con 0x7f0b54069d40 2024-08-17T02:27:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.263+0000 7f0b4b400640 1 -- 172.21.15.5:0/300492025 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0b40007520 con 0x7f0b54069d40 2024-08-17T02:27:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.264+0000 7f0b4b400640 1 --2- 172.21.15.5:0/300492025 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0b34065150 0x7f0b34067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.264+0000 7f0b4b400640 1 -- 172.21.15.5:0/300492025 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0b40081c60 con 0x7f0b54069d40 2024-08-17T02:27:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.264+0000 7f0b53e00640 1 --2- 172.21.15.5:0/300492025 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0b34065150 0x7f0b34067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.265+0000 7f0b53e00640 1 --2- 172.21.15.5:0/300492025 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0b34065150 0x7f0b34067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0b44034000 tx=0x7f0b44032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.267+0000 7f0b4b400640 1 -- 172.21.15.5:0/300492025 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0b540c4590 con 0x7f0b54069d40 2024-08-17T02:27:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.453+0000 7f0b5b200640 1 -- 172.21.15.5:0/300492025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0b540c4550 con 0x7f0b54069d40 2024-08-17T02:27:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.457+0000 7f0b4b400640 1 -- 172.21.15.5:0/300492025 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0b4004ffa0 con 0x7f0b54069d40 2024-08-17T02:27:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.459+0000 7f0b5b200640 1 -- 172.21.15.5:0/300492025 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0b34065150 msgr2=0x7f0b34067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.459+0000 7f0b5b200640 1 --2- 172.21.15.5:0/300492025 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0b34065150 0x7f0b34067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0b44034000 tx=0x7f0b44032000 comp rx=0 tx=0).stop 2024-08-17T02:27:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.459+0000 7f0b5b200640 1 -- 172.21.15.5:0/300492025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54069d40 msgr2=0x7f0b5409a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.459+0000 7f0b5b200640 1 --2- 172.21.15.5:0/300492025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54069d40 0x7f0b5409a880 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000c5b0 tx=0x7f0b40007d70 comp rx=0 tx=0).stop 2024-08-17T02:27:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.459+0000 7f0b5b200640 1 -- 172.21.15.5:0/300492025 shutdown_connections 2024-08-17T02:27:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.459+0000 7f0b5b200640 1 --2- 172.21.15.5:0/300492025 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0b34065150 0x7f0b34067600 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.459+0000 7f0b5b200640 1 --2- 172.21.15.5:0/300492025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b54159100 0x7f0b5409adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.459+0000 7f0b5b200640 1 --2- 172.21.15.5:0/300492025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54069d40 0x7f0b5409a880 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.459+0000 7f0b5b200640 1 --2- 172.21.15.5:0/300492025 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b54067f70 0x7f0b54169380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.459+0000 7f0b5b200640 1 -- 172.21.15.5:0/300492025 >> 172.21.15.5:0/300492025 conn(0x7f0b540ce5e0 msgr2=0x7f0b54157da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.459+0000 7f0b5b200640 1 -- 172.21.15.5:0/300492025 shutdown_connections 2024-08-17T02:27:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.459+0000 7f0b5b200640 1 -- 172.21.15.5:0/300492025 wait complete. 2024-08-17T02:27:02.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:27:02.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.625+0000 7f6266e00640 1 Processor -- start 2024-08-17T02:27:02.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.626+0000 7f6266e00640 1 -- start start 2024-08-17T02:27:02.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.627+0000 7f6266e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62600ca050 0x7f6260156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.627+0000 7f6266e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62600cb160 con 0x7f62600ad960 2024-08-17T02:27:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.627+0000 7f6266e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62600b0d10 con 0x7f62600add30 2024-08-17T02:27:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.627+0000 7f6266e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62600ca550 con 0x7f62600ca050 2024-08-17T02:27:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.627+0000 7f625fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f62600ad960 0x7f6260156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39164/0 (socket says 172.21.15.5:39164) 2024-08-17T02:27:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.627+0000 7f625fe00640 1 -- 172.21.15.5:0/3364573836 learned_addr learned my addr 172.21.15.5:0/3364573836 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.627+0000 7f6257e00640 1 --2- 172.21.15.5:0/3364573836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62600ca050 0x7f6260156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.628+0000 7f625f400640 1 -- 172.21.15.5:0/3364573836 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913218499 0 0) 0x7f62600cb160 con 0x7f62600ad960 2024-08-17T02:27:02.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.628+0000 7f625f400640 1 -- 172.21.15.5:0/3364573836 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62440034e0 con 0x7f62600ad960 2024-08-17T02:27:02.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.628+0000 7f625f400640 1 -- 172.21.15.5:0/3364573836 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733387228 0 0) 0x7f62600b0d10 con 0x7f62600add30 2024-08-17T02:27:02.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.628+0000 7f625f400640 1 -- 172.21.15.5:0/3364573836 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62600cb160 con 0x7f62600add30 2024-08-17T02:27:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.628+0000 7f6257e00640 1 -- 172.21.15.5:0/3364573836 >> v1:172.21.15.87:6789/0 conn(0x7f62600add30 legacy=0x7f62600aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.628+0000 7f625f400640 1 -- 172.21.15.5:0/3364573836 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3751689299 0 0) 0x7f62440034e0 con 0x7f62600ad960 2024-08-17T02:27:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.628+0000 7f6257e00640 1 -- 172.21.15.5:0/3364573836 >> v1:172.21.15.5:6789/0 conn(0x7f62600ad960 legacy=0x7f6260156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.628+0000 7f6257e00640 1 -- 172.21.15.5:0/3364573836 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62600ca830 con 0x7f62600ca050 2024-08-17T02:27:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.629+0000 7f6257e00640 1 --2- 172.21.15.5:0/3364573836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62600ca050 0x7f6260156b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6248009880 tx=0x7f62480090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8716f98a4e581600 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.629+0000 7f625f400640 1 -- 172.21.15.5:0/3364573836 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6250001470 con 0x7f62600ca050 2024-08-17T02:27:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.629+0000 7f625f400640 1 -- 172.21.15.5:0/3364573836 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624802ab50 con 0x7f62600ca050 2024-08-17T02:27:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.629+0000 7f625f400640 1 -- 172.21.15.5:0/3364573836 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6248032440 con 0x7f62600ca050 2024-08-17T02:27:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.630+0000 7f6266e00640 1 -- 172.21.15.5:0/3364573836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62600ca050 msgr2=0x7f6260156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.630+0000 7f6266e00640 1 --2- 172.21.15.5:0/3364573836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62600ca050 0x7f6260156b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6248009880 tx=0x7f62480090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.630+0000 7f6266e00640 1 -- 172.21.15.5:0/3364573836 shutdown_connections 2024-08-17T02:27:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.630+0000 7f6266e00640 1 --2- 172.21.15.5:0/3364573836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62600ca050 0x7f6260156b30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.630+0000 7f6266e00640 1 -- 172.21.15.5:0/3364573836 >> 172.21.15.5:0/3364573836 conn(0x7f6260066e60 msgr2=0x7f6260067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.630+0000 7f6266e00640 1 -- 172.21.15.5:0/3364573836 shutdown_connections 2024-08-17T02:27:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.630+0000 7f6266e00640 1 -- 172.21.15.5:0/3364573836 wait complete. 2024-08-17T02:27:02.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.631+0000 7f6266e00640 1 Processor -- start 2024-08-17T02:27:02.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.631+0000 7f6266e00640 1 -- start start 2024-08-17T02:27:02.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.632+0000 7f6266e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62600ad960 0x7f6260069c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.632+0000 7f6266e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62600add30 0x7f6260167db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.632+0000 7f6266e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62600ca050 0x7f62600a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.632+0000 7f6266e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62600a9e30 con 0x7f62600ca050 2024-08-17T02:27:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.632+0000 7f6266e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62600a9540 con 0x7f62600ad960 2024-08-17T02:27:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.632+0000 7f6266e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6260167980 con 0x7f62600add30 2024-08-17T02:27:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.633+0000 7f625fe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62600ad960 0x7f6260069c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.633+0000 7f6264e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62600ca050 0x7f62600a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.633+0000 7f6257e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62600add30 0x7f6260167db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.633+0000 7f625fe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62600ad960 0x7f6260069c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:51706/0 (socket says 172.21.15.5:51706) 2024-08-17T02:27:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.633+0000 7f6257e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62600add30 0x7f6260167db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:58808/0 (socket says 172.21.15.5:58808) 2024-08-17T02:27:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.633+0000 7f625fe00640 1 -- 172.21.15.5:0/3034065861 learned_addr learned my addr 172.21.15.5:0/3034065861 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.633+0000 7f625fe00640 1 -- 172.21.15.5:0/3034065861 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62600add30 msgr2=0x7f6260167db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.633+0000 7f625fe00640 1 --2- 172.21.15.5:0/3034065861 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62600add30 0x7f6260167db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.633+0000 7f625fe00640 1 -- 172.21.15.5:0/3034065861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62600ca050 msgr2=0x7f62600a74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.633+0000 7f625fe00640 1 --2- 172.21.15.5:0/3034065861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62600ca050 0x7f62600a74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.633+0000 7f625fe00640 1 -- 172.21.15.5:0/3034065861 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6248009390 con 0x7f62600ad960 2024-08-17T02:27:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.633+0000 7f6264e00640 1 --2- 172.21.15.5:0/3034065861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62600ca050 0x7f62600a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.633+0000 7f625fe00640 1 --2- 172.21.15.5:0/3034065861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62600ad960 0x7f6260069c90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6250001380 tx=0x7f6250001bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.634+0000 7f6257400640 1 -- 172.21.15.5:0/3034065861 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6250007360 con 0x7f62600ad960 2024-08-17T02:27:02.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.634+0000 7f6257400640 1 -- 172.21.15.5:0/3034065861 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62500074e0 con 0x7f62600ad960 2024-08-17T02:27:02.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.634+0000 7f6257400640 1 -- 172.21.15.5:0/3034065861 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62500049f0 con 0x7f62600ad960 2024-08-17T02:27:02.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.634+0000 7f6266e00640 1 -- 172.21.15.5:0/3034065861 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62600a97e0 con 0x7f62600ad960 2024-08-17T02:27:02.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.634+0000 7f6266e00640 1 -- 172.21.15.5:0/3034065861 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626006a1d0 con 0x7f62600ad960 2024-08-17T02:27:02.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.635+0000 7f6266e00640 1 -- 172.21.15.5:0/3034065861 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6260063fb0 con 0x7f62600ad960 2024-08-17T02:27:02.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.636+0000 7f6257400640 1 -- 172.21.15.5:0/3034065861 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f625000a5b0 con 0x7f62600ad960 2024-08-17T02:27:02.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.637+0000 7f6257400640 1 --2- 172.21.15.5:0/3034065861 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f623c065150 0x7f623c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.637+0000 7f6257400640 1 -- 172.21.15.5:0/3034065861 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6250081aa0 con 0x7f62600ad960 2024-08-17T02:27:02.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.637+0000 7f6257e00640 1 --2- 172.21.15.5:0/3034065861 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f623c065150 0x7f623c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.638+0000 7f6257e00640 1 --2- 172.21.15.5:0/3034065861 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f623c065150 0x7f623c067600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6248034000 tx=0x7f6248032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.642+0000 7f6257400640 1 -- 172.21.15.5:0/3034065861 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f625004fe90 con 0x7f62600ad960 2024-08-17T02:27:02.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:02.889+0000 7f6266e00640 1 -- 172.21.15.5:0/3034065861 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f6260151d50 con 0x7f62600ad960 2024-08-17T02:27:03.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:03.089+0000 7f6257400640 1 -- 172.21.15.5:0/3034065861 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v161) v1 ==== 135+0+0 (secure 0 0 0) 0x7f6250018020 con 0x7f62600ad960 2024-08-17T02:27:03.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:03.091+0000 7f6266e00640 1 -- 172.21.15.5:0/3034065861 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f623c065150 msgr2=0x7f623c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:03.091+0000 7f6266e00640 1 --2- 172.21.15.5:0/3034065861 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f623c065150 0x7f623c067600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6248034000 tx=0x7f6248032000 comp rx=0 tx=0).stop 2024-08-17T02:27:03.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:03.091+0000 7f6266e00640 1 -- 172.21.15.5:0/3034065861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62600ad960 msgr2=0x7f6260069c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:03.091+0000 7f6266e00640 1 --2- 172.21.15.5:0/3034065861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62600ad960 0x7f6260069c90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6250001380 tx=0x7f6250001bd0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:03.091+0000 7f6266e00640 1 -- 172.21.15.5:0/3034065861 shutdown_connections 2024-08-17T02:27:03.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:03.091+0000 7f6266e00640 1 --2- 172.21.15.5:0/3034065861 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f623c065150 0x7f623c067600 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:03.091+0000 7f6266e00640 1 --2- 172.21.15.5:0/3034065861 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62600add30 0x7f6260167db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:03.091+0000 7f6266e00640 1 --2- 172.21.15.5:0/3034065861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62600ca050 0x7f62600a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:03.091+0000 7f6266e00640 1 --2- 172.21.15.5:0/3034065861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62600ad960 0x7f6260069c90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:03.091+0000 7f6266e00640 1 -- 172.21.15.5:0/3034065861 >> 172.21.15.5:0/3034065861 conn(0x7f6260066e60 msgr2=0x7f62600aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:03.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:03.091+0000 7f6266e00640 1 -- 172.21.15.5:0/3034065861 shutdown_connections 2024-08-17T02:27:03.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:03.091+0000 7f6266e00640 1 -- 172.21.15.5:0/3034065861 wait complete. 2024-08-17T02:27:03.110 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:27:03.111 INFO:tasks.cephfs_test_runner: 2024-08-17T02:27:03.111 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:27:03.111 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:27:03.111 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:27:03.111 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:27:03.111 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:27:03.111 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:27:03.111 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:27:03.111 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:27:03.111 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:27:03.112 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:27:03.112 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:27:03.112 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:27:03.112 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:27:03.112 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:27:03.112 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:27:03.112 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:27:03.112 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:27:03.112 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:27:03.112 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:27:03.112 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:27:03.112 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:27:03.112 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:27:03.112 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:27:03.112 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi005 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001044363 --yes-i-really-mean-it' 2024-08-17T02:27:03.112 INFO:tasks.cephfs_test_runner: 2024-08-17T02:27:03.113 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:27:03.113 INFO:tasks.cephfs_test_runner:Ran 1 test in 176.349s 2024-08-17T02:27:03.113 INFO:tasks.cephfs_test_runner: 2024-08-17T02:27:03.113 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:27:03.113 INFO:tasks.cephfs_test_runner: 2024-08-17T02:27:03.113 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:27:03.113 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:27:03.113 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:27:03.113 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:27:03.113 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:27:03.113 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:27:03.113 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:27:03.113 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:27:03.113 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:27:03.114 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:27:03.114 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:27:03.114 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:27:03.114 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:27:03.114 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:27:03.114 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:27:03.114 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:27:03.114 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:27:03.114 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:27:03.114 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:27:03.114 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:27:03.114 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:27:03.114 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:27:03.114 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:27:03.114 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi005 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001044363 --yes-i-really-mean-it' 2024-08-17T02:27:03.115 INFO:tasks.cephfs_test_runner: 2024-08-17T02:27:03.115 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:27:03.346 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=3c92741e63ad496c8d2086d5a2d620d9 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:27:03.347 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:27:03.356 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-17T02:27:03.374 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-17T02:27:03.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:03.374 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-17T02:27:03.414 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:27:03.414 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:27:03.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:03.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:27:03.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:03.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:27:03.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:03.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-08-17T02:27:04.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:04.084 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-17T02:27:04.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:04.122 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-08-17T02:27:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2024-08-17T02:27:04.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:04.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:04.225 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-08-17T02:27:04.265 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:27:04.265 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:27:04.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:04.267 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:27:04.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:04.368 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:27:04.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:04.663 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-08-17T02:27:04.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:04.977 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-08-17T02:27:05.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:05.012 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-08-17T02:27:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:Cannot find device "ceph-brx" 2024-08-17T02:27:05.114 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:05.115 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:27:05.123 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:27:05.124 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:05.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.285+0000 7f3516400640 1 Processor -- start 2024-08-17T02:27:05.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.285+0000 7f3516400640 1 -- start start 2024-08-17T02:27:05.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.286+0000 7f3516400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f35100acf10 0x7f35100b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.286+0000 7f3516400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35100c92b0 con 0x7f35100afca0 2024-08-17T02:27:05.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.286+0000 7f3516400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35100ad480 con 0x7f35101590b0 2024-08-17T02:27:05.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.286+0000 7f3516400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35100b0980 con 0x7f35100acf10 2024-08-17T02:27:05.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.287+0000 7f350f400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f35100afca0 0x7f35101589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39174/0 (socket says 172.21.15.5:39174) 2024-08-17T02:27:05.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.287+0000 7f350f400640 1 -- 172.21.15.5:0/2234273829 learned_addr learned my addr 172.21.15.5:0/2234273829 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:05.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.287+0000 7f350fe00640 1 --2- 172.21.15.5:0/2234273829 >> v2:172.21.15.87:3300/0 conn(0x7f35100acf10 0x7f35100b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.287+0000 7f350e000640 1 -- 172.21.15.5:0/2234273829 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518436731 0 0) 0x7f35100c92b0 con 0x7f35100afca0 2024-08-17T02:27:05.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.287+0000 7f350e000640 1 -- 172.21.15.5:0/2234273829 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34f40034e0 con 0x7f35100afca0 2024-08-17T02:27:05.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.287+0000 7f350e000640 1 -- 172.21.15.5:0/2234273829 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632078211 0 0) 0x7f35100ad480 con 0x7f35101590b0 2024-08-17T02:27:05.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.287+0000 7f350e000640 1 -- 172.21.15.5:0/2234273829 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35100c92b0 con 0x7f35101590b0 2024-08-17T02:27:05.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.287+0000 7f350fe00640 1 -- 172.21.15.5:0/2234273829 >> v1:172.21.15.87:6789/0 conn(0x7f35101590b0 legacy=0x7f35100c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.287+0000 7f350fe00640 1 -- 172.21.15.5:0/2234273829 >> v1:172.21.15.5:6789/0 conn(0x7f35100afca0 legacy=0x7f35101589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.287+0000 7f350fe00640 1 -- 172.21.15.5:0/2234273829 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35100ad760 con 0x7f35100acf10 2024-08-17T02:27:05.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.288+0000 7f350fe00640 1 --2- 172.21.15.5:0/2234273829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35100acf10 0x7f35100b0070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3508009e60 tx=0x7f3508009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0a8f4f4463352b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:05.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.289+0000 7f350e000640 1 -- 172.21.15.5:0/2234273829 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508007550 con 0x7f35100acf10 2024-08-17T02:27:05.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.289+0000 7f350e000640 1 -- 172.21.15.5:0/2234273829 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350802d050 con 0x7f35100acf10 2024-08-17T02:27:05.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.289+0000 7f350e000640 1 -- 172.21.15.5:0/2234273829 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508007900 con 0x7f35100acf10 2024-08-17T02:27:05.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.289+0000 7f3516400640 1 -- 172.21.15.5:0/2234273829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35100acf10 msgr2=0x7f35100b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.289+0000 7f3516400640 1 --2- 172.21.15.5:0/2234273829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35100acf10 0x7f35100b0070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3508009e60 tx=0x7f3508009780 comp rx=0 tx=0).stop 2024-08-17T02:27:05.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.289+0000 7f3516400640 1 -- 172.21.15.5:0/2234273829 shutdown_connections 2024-08-17T02:27:05.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.289+0000 7f3516400640 1 --2- 172.21.15.5:0/2234273829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35100acf10 0x7f35100b0070 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.289+0000 7f3516400640 1 -- 172.21.15.5:0/2234273829 >> 172.21.15.5:0/2234273829 conn(0x7f3510066e60 msgr2=0x7f3510067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:05.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.289+0000 7f3516400640 1 -- 172.21.15.5:0/2234273829 shutdown_connections 2024-08-17T02:27:05.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.289+0000 7f3516400640 1 -- 172.21.15.5:0/2234273829 wait complete. 2024-08-17T02:27:05.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.291+0000 7f3516400640 1 Processor -- start 2024-08-17T02:27:05.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.291+0000 7f3516400640 1 -- start start 2024-08-17T02:27:05.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.292+0000 7f3516400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35100acf10 0x7f35100c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.292+0000 7f3516400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35100afca0 0x7f351014a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.292+0000 7f3516400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35101590b0 0x7f351014a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.292+0000 7f3516400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351014d5a0 con 0x7f35100acf10 2024-08-17T02:27:05.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.292+0000 7f3516400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351014c990 con 0x7f35100afca0 2024-08-17T02:27:05.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.292+0000 7f3516400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351014cc70 con 0x7f35101590b0 2024-08-17T02:27:05.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.292+0000 7f350f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35100acf10 0x7f35100c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.292+0000 7f350f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35100acf10 0x7f35100c52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46012/0 (socket says 172.21.15.5:46012) 2024-08-17T02:27:05.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.292+0000 7f350f400640 1 -- 172.21.15.5:0/1980548855 learned_addr learned my addr 172.21.15.5:0/1980548855 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:05.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.293+0000 7f350fe00640 1 --2- 172.21.15.5:0/1980548855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35101590b0 0x7f351014a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.293+0000 7f350ea00640 1 --2- 172.21.15.5:0/1980548855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35100afca0 0x7f351014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.293+0000 7f350f400640 1 -- 172.21.15.5:0/1980548855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35101590b0 msgr2=0x7f351014a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.293+0000 7f350f400640 1 --2- 172.21.15.5:0/1980548855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35101590b0 0x7f351014a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.293+0000 7f350f400640 1 -- 172.21.15.5:0/1980548855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35100afca0 msgr2=0x7f351014a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.293+0000 7f350f400640 1 --2- 172.21.15.5:0/1980548855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35100afca0 0x7f351014a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.293+0000 7f350f400640 1 -- 172.21.15.5:0/1980548855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3508009a20 con 0x7f35100acf10 2024-08-17T02:27:05.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.293+0000 7f350fe00640 1 --2- 172.21.15.5:0/1980548855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35101590b0 0x7f351014a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:05.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.293+0000 7f350ea00640 1 --2- 172.21.15.5:0/1980548855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35100afca0 0x7f351014a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:05.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.293+0000 7f350f400640 1 --2- 172.21.15.5:0/1980548855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35100acf10 0x7f35100c52f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3500005840 tx=0x7f3500007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:05.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.293+0000 7f3506a00640 1 -- 172.21.15.5:0/1980548855 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500005aa0 con 0x7f35100acf10 2024-08-17T02:27:05.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.293+0000 7f3506a00640 1 -- 172.21.15.5:0/1980548855 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3500005c00 con 0x7f35100acf10 2024-08-17T02:27:05.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.293+0000 7f3506a00640 1 -- 172.21.15.5:0/1980548855 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35000070f0 con 0x7f35100acf10 2024-08-17T02:27:05.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.293+0000 7f3516400640 1 -- 172.21.15.5:0/1980548855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351014cf50 con 0x7f35100acf10 2024-08-17T02:27:05.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.294+0000 7f3516400640 1 -- 172.21.15.5:0/1980548855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3510168bd0 con 0x7f35100acf10 2024-08-17T02:27:05.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.295+0000 7f3516400640 1 -- 172.21.15.5:0/1980548855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3510063fb0 con 0x7f35100acf10 2024-08-17T02:27:05.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.295+0000 7f3506a00640 1 -- 172.21.15.5:0/1980548855 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3500007520 con 0x7f35100acf10 2024-08-17T02:27:05.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.296+0000 7f3506a00640 1 --2- 172.21.15.5:0/1980548855 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f34f0065150 0x7f34f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.296+0000 7f3506a00640 1 -- 172.21.15.5:0/1980548855 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f3500081ce0 con 0x7f35100acf10 2024-08-17T02:27:05.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.296+0000 7f350ea00640 1 --2- 172.21.15.5:0/1980548855 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f34f0065150 0x7f34f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.297+0000 7f350ea00640 1 --2- 172.21.15.5:0/1980548855 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f34f0065150 0x7f34f0067600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f34fc007fd0 tx=0x7f34fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:05.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.300+0000 7f3506a00640 1 -- 172.21.15.5:0/1980548855 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3500050020 con 0x7f35100acf10 2024-08-17T02:27:05.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.481+0000 7f3516400640 1 -- 172.21.15.5:0/1980548855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f351014d3d0 con 0x7f35100acf10 2024-08-17T02:27:05.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.482+0000 7f3506a00640 1 -- 172.21.15.5:0/1980548855 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+12295 (secure 0 0 0) 0x7f3500053640 con 0x7f35100acf10 2024-08-17T02:27:05.483 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:27:05.483 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":45,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:27:02.073999+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:6835/1739323622":"2024-08-18T02:26:58.917782+0000","172.21.15.87:6834/1739323622":"2024-08-18T02:26:58.917782+0000","172.21.15.5:6836/1918940200":"2024-08-18T02:26:51.946222+0000","172.21.15.5:6835/1918940200":"2024-08-18T02:26:51.946222+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.484+0000 7f3516400640 1 -- 172.21.15.5:0/1980548855 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f34f0065150 msgr2=0x7f34f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.484+0000 7f3516400640 1 --2- 172.21.15.5:0/1980548855 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f34f0065150 0x7f34f0067600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f34fc007fd0 tx=0x7f34fc009040 comp rx=0 tx=0).stop 2024-08-17T02:27:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.484+0000 7f3516400640 1 -- 172.21.15.5:0/1980548855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35100acf10 msgr2=0x7f35100c52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.484+0000 7f3516400640 1 --2- 172.21.15.5:0/1980548855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35100acf10 0x7f35100c52f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3500005840 tx=0x7f3500007e10 comp rx=0 tx=0).stop 2024-08-17T02:27:05.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.485+0000 7f3516400640 1 -- 172.21.15.5:0/1980548855 shutdown_connections 2024-08-17T02:27:05.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.485+0000 7f3516400640 1 --2- 172.21.15.5:0/1980548855 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f34f0065150 0x7f34f0067600 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.485+0000 7f3516400640 1 --2- 172.21.15.5:0/1980548855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35101590b0 0x7f351014a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.485+0000 7f3516400640 1 --2- 172.21.15.5:0/1980548855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35100afca0 0x7f351014a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.485+0000 7f3516400640 1 --2- 172.21.15.5:0/1980548855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35100acf10 0x7f35100c52f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.485+0000 7f3516400640 1 -- 172.21.15.5:0/1980548855 >> 172.21.15.5:0/1980548855 conn(0x7f3510066e60 msgr2=0x7f351014b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:05.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.485+0000 7f3516400640 1 -- 172.21.15.5:0/1980548855 shutdown_connections 2024-08-17T02:27:05.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.485+0000 7f3516400640 1 -- 172.21.15.5:0/1980548855 wait complete. 2024-08-17T02:27:05.501 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:27:05.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:05.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.652+0000 7f5943a00640 1 Processor -- start 2024-08-17T02:27:05.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.652+0000 7f5943a00640 1 -- start start 2024-08-17T02:27:05.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.653+0000 7f5943a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f593c0ad960 0x7f593c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.653+0000 7f5943a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593c15b5e0 con 0x7f593c0ca050 2024-08-17T02:27:05.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.653+0000 7f5943a00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593c0cb160 con 0x7f593c0add30 2024-08-17T02:27:05.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.653+0000 7f5943a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0b0d10 con 0x7f593c0ad960 2024-08-17T02:27:05.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.653+0000 7f593be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f593c0ca050 0x7f593c156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39180/0 (socket says 172.21.15.5:39180) 2024-08-17T02:27:05.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.653+0000 7f593be00640 1 -- 172.21.15.5:0/1455730306 learned_addr learned my addr 172.21.15.5:0/1455730306 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:05.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.654+0000 7f5941000640 1 --2- 172.21.15.5:0/1455730306 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f593c0ad960 0x7f593c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.654+0000 7f593b400640 1 -- 172.21.15.5:0/1455730306 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928958228 0 0) 0x7f5928001110 con 0x7f593c0ca050 2024-08-17T02:27:05.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.654+0000 7f593b400640 1 -- 172.21.15.5:0/1455730306 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59240034e0 con 0x7f593c0ca050 2024-08-17T02:27:05.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.654+0000 7f593b400640 1 -- 172.21.15.5:0/1455730306 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171491867 0 0) 0x7f593c0cb160 con 0x7f593c0add30 2024-08-17T02:27:05.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.654+0000 7f593b400640 1 -- 172.21.15.5:0/1455730306 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5928001110 con 0x7f593c0add30 2024-08-17T02:27:05.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.654+0000 7f5941000640 1 -- 172.21.15.5:0/1455730306 >> v1:172.21.15.87:6789/0 conn(0x7f593c0add30 legacy=0x7f593c0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.654+0000 7f5941000640 1 -- 172.21.15.5:0/1455730306 >> v1:172.21.15.5:6789/0 conn(0x7f593c0ca050 legacy=0x7f593c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.654+0000 7f593b400640 1 -- 172.21.15.5:0/1455730306 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1897175379 0 0) 0x7f59240034e0 con 0x7f593c0ca050 2024-08-17T02:27:05.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.654+0000 7f5941000640 1 -- 172.21.15.5:0/1455730306 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c0ca550 con 0x7f593c0ad960 2024-08-17T02:27:05.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.655+0000 7f5941000640 1 --2- 172.21.15.5:0/1455730306 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f593c0ad960 0x7f593c15b0a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5930009880 tx=0x7f59300090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=673f5badc43bfacd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:05.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.656+0000 7f593b400640 1 -- 172.21.15.5:0/1455730306 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5928001600 con 0x7f593c0ad960 2024-08-17T02:27:05.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.656+0000 7f593b400640 1 -- 172.21.15.5:0/1455730306 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593002ab50 con 0x7f593c0ad960 2024-08-17T02:27:05.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.656+0000 7f593b400640 1 -- 172.21.15.5:0/1455730306 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5930032440 con 0x7f593c0ad960 2024-08-17T02:27:05.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.656+0000 7f5943a00640 1 -- 172.21.15.5:0/1455730306 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f593c0ad960 msgr2=0x7f593c15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.656+0000 7f5943a00640 1 --2- 172.21.15.5:0/1455730306 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f593c0ad960 0x7f593c15b0a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5930009880 tx=0x7f59300090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.656+0000 7f5943a00640 1 -- 172.21.15.5:0/1455730306 shutdown_connections 2024-08-17T02:27:05.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.656+0000 7f5943a00640 1 --2- 172.21.15.5:0/1455730306 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f593c0ad960 0x7f593c15b0a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.656+0000 7f5943a00640 1 -- 172.21.15.5:0/1455730306 >> 172.21.15.5:0/1455730306 conn(0x7f593c066e60 msgr2=0x7f593c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:05.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.656+0000 7f5943a00640 1 -- 172.21.15.5:0/1455730306 shutdown_connections 2024-08-17T02:27:05.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.656+0000 7f5943a00640 1 -- 172.21.15.5:0/1455730306 wait complete. 2024-08-17T02:27:05.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.658+0000 7f5943a00640 1 Processor -- start 2024-08-17T02:27:05.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.658+0000 7f5943a00640 1 -- start start 2024-08-17T02:27:05.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.659+0000 7f5943a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f593c0ad960 0x7f593c0a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.659+0000 7f5943a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593c0add30 0x7f593c167b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.659+0000 7f5943a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f593c0ca050 0x7f593c1530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.659+0000 7f5943a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c1680b0 con 0x7f593c0add30 2024-08-17T02:27:05.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.659+0000 7f5943a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0a99a0 con 0x7f593c0ad960 2024-08-17T02:27:05.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.659+0000 7f5943a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0a9c80 con 0x7f593c0ca050 2024-08-17T02:27:05.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.659+0000 7f593be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593c0add30 0x7f593c167b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.659+0000 7f593be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593c0add30 0x7f593c167b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46016/0 (socket says 172.21.15.5:46016) 2024-08-17T02:27:05.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.659+0000 7f593be00640 1 -- 172.21.15.5:0/3446640514 learned_addr learned my addr 172.21.15.5:0/3446640514 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:05.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.659+0000 7f5941000640 1 --2- 172.21.15.5:0/3446640514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f593c0ad960 0x7f593c0a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.659+0000 7f5941a00640 1 --2- 172.21.15.5:0/3446640514 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f593c0ca050 0x7f593c1530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.659+0000 7f593be00640 1 -- 172.21.15.5:0/3446640514 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f593c0ca050 msgr2=0x7f593c1530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.659+0000 7f593be00640 1 --2- 172.21.15.5:0/3446640514 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f593c0ca050 0x7f593c1530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.659+0000 7f593be00640 1 -- 172.21.15.5:0/3446640514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f593c0ad960 msgr2=0x7f593c0a92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.659+0000 7f593be00640 1 --2- 172.21.15.5:0/3446640514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f593c0ad960 0x7f593c0a92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.659+0000 7f593be00640 1 -- 172.21.15.5:0/3446640514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5930009390 con 0x7f593c0add30 2024-08-17T02:27:05.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.660+0000 7f593be00640 1 --2- 172.21.15.5:0/3446640514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593c0add30 0x7f593c167b70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f592800cb40 tx=0x7f5928001be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:05.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.660+0000 7f592fe00640 1 -- 172.21.15.5:0/3446640514 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5928005aa0 con 0x7f593c0add30 2024-08-17T02:27:05.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.660+0000 7f592fe00640 1 -- 172.21.15.5:0/3446640514 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5928005c20 con 0x7f593c0add30 2024-08-17T02:27:05.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.660+0000 7f592fe00640 1 -- 172.21.15.5:0/3446640514 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59280070f0 con 0x7f593c0add30 2024-08-17T02:27:05.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.660+0000 7f5943a00640 1 -- 172.21.15.5:0/3446640514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593c0a9f60 con 0x7f593c0add30 2024-08-17T02:27:05.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.660+0000 7f5943a00640 1 -- 172.21.15.5:0/3446640514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593c168300 con 0x7f593c0add30 2024-08-17T02:27:05.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.661+0000 7f5943a00640 1 -- 172.21.15.5:0/3446640514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593c168520 con 0x7f593c0add30 2024-08-17T02:27:05.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.662+0000 7f592fe00640 1 -- 172.21.15.5:0/3446640514 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f59280074a0 con 0x7f593c0add30 2024-08-17T02:27:05.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.663+0000 7f592fe00640 1 --2- 172.21.15.5:0/3446640514 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f591c065150 0x7f591c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.663+0000 7f592fe00640 1 -- 172.21.15.5:0/3446640514 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5928081ff0 con 0x7f593c0add30 2024-08-17T02:27:05.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.663+0000 7f5941000640 1 --2- 172.21.15.5:0/3446640514 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f591c065150 0x7f591c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.664+0000 7f5941000640 1 --2- 172.21.15.5:0/3446640514 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f591c065150 0x7f591c067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5930034000 tx=0x7f5930032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:05.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.666+0000 7f592fe00640 1 -- 172.21.15.5:0/3446640514 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5928050330 con 0x7f593c0add30 2024-08-17T02:27:05.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.844+0000 7f5943a00640 1 -- 172.21.15.5:0/3446640514 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f593c15b5e0 con 0x7f591c065150 2024-08-17T02:27:05.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.846+0000 7f592fe00640 1 -- 172.21.15.5:0/3446640514 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51280 (secure 0 0 0) 0x7f593c15b5e0 con 0x7f591c065150 2024-08-17T02:27:05.847 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:27:05.848 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:27:05.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.848+0000 7f5943a00640 1 -- 172.21.15.5:0/3446640514 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f591c065150 msgr2=0x7f591c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.848+0000 7f5943a00640 1 --2- 172.21.15.5:0/3446640514 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f591c065150 0x7f591c067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5930034000 tx=0x7f5930032000 comp rx=0 tx=0).stop 2024-08-17T02:27:05.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.848+0000 7f5943a00640 1 -- 172.21.15.5:0/3446640514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593c0add30 msgr2=0x7f593c167b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.848+0000 7f5943a00640 1 --2- 172.21.15.5:0/3446640514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593c0add30 0x7f593c167b70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f592800cb40 tx=0x7f5928001be0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.848+0000 7f5943a00640 1 -- 172.21.15.5:0/3446640514 shutdown_connections 2024-08-17T02:27:05.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.848+0000 7f5943a00640 1 --2- 172.21.15.5:0/3446640514 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f591c065150 0x7f591c067600 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.848+0000 7f5943a00640 1 --2- 172.21.15.5:0/3446640514 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f593c0ca050 0x7f593c1530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.848+0000 7f5943a00640 1 --2- 172.21.15.5:0/3446640514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593c0add30 0x7f593c167b70 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.848+0000 7f5943a00640 1 --2- 172.21.15.5:0/3446640514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f593c0ad960 0x7f593c0a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.848+0000 7f5943a00640 1 -- 172.21.15.5:0/3446640514 >> 172.21.15.5:0/3446640514 conn(0x7f593c066e60 msgr2=0x7f593c155640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:05.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.849+0000 7f5943a00640 1 -- 172.21.15.5:0/3446640514 shutdown_connections 2024-08-17T02:27:05.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:05.849+0000 7f5943a00640 1 -- 172.21.15.5:0/3446640514 wait complete. 2024-08-17T02:27:05.865 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-08-17T02:27:04.772301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":2400724,"kb_used_data":5224,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752573996,"statfs":{"total":773094113280,"available":770635771904,"internally_reserved":0,"allocated":5349376,"data_stored":2915288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001246"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-17T02:26:59.794356+0000","last_change":"2024-08-17T02:23:30.651033+0000","last_active":"2024-08-17T02:26:59.794356+0000","last_peered":"2024-08-17T02:26:59.794356+0000","last_clean":"2024-08-17T02:26:59.794356+0000","last_became_active":"2024-08-17T02:23:30.649860+0000","last_became_peered":"2024-08-17T02:23:30.649860+0000","last_unstale":"2024-08-17T02:26:59.794356+0000","last_undegraded":"2024-08-17T02:26:59.794356+0000","last_fullsized":"2024-08-17T02:26:59.794356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.523857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:29:35.288625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542190,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1110016,"data_stored":805775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.66300000000000003,"15min":0.624},"min":{"1min":0.41499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97099999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67000000000000004,"15min":0.64300000000000002},"min":{"1min":0.54700000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89500000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.38300000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68799999999999994,"15min":0.66200000000000003},"min":{"1min":0.54300000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65600000000000003,"15min":0.63200000000000001},"min":{"1min":0.51700000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86899999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.47699999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.69999999999999996,"15min":0.66600000000000004},"min":{"1min":0.58999999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97299999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69099999999999995,"15min":0.67700000000000005},"min":{"1min":0.58099999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.64500000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69199999999999995,"15min":0.66800000000000004},"min":{"1min":0.55200000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":0.995,"15min":0.995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.72999999999999998,"15min":0.71399999999999997},"min":{"1min":0.66300000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.92600000000000005,"5min":1.032,"15min":1.032},"last":0.68200000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66700000000000004,"15min":0.68500000000000005},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.505}]},{"osd":5,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.64700000000000002,"15min":0.67000000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.73699999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.628},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.89700000000000002,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.75600000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.75800000000000001,"15min":0.78300000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95299999999999996,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.74199999999999999,"15min":0.76000000000000001},"min":{"1min":0.48299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95899999999999996,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.66300000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542191,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297880,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":532480,"data_stored":221055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.68000000000000005},"min":{"1min":0.57599999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84199999999999997,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.57199999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86399999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.76600000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.70399999999999996,"15min":0.68200000000000005},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94099999999999995,"5min":1.111,"15min":1.111},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91100000000000003,"5min":3.444,"15min":3.444},"last":0.96099999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.83299999999999996,"15min":0.85799999999999998},"min":{"1min":0.67100000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.878,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.84199999999999997,"15min":0.86599999999999999},"min":{"1min":0.65800000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97899999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":0.97799999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72699999999999998,"15min":0.71899999999999997},"min":{"1min":0.60899999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.86899999999999999,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.87},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.67400000000000004,"15min":0.64500000000000002},"min":{"1min":0.63300000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88800000000000001,"5min":1.087,"15min":1.087},"last":0.92400000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.624,"15min":0.61899999999999999},"min":{"1min":0.42999999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89800000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.52900000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81499999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.54500000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.52100000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78200000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.52800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.89000000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72499999999999998,"15min":0.73499999999999999},"min":{"1min":0.55800000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80500000000000005,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.71299999999999997,"15min":0.71899999999999997},"min":{"1min":0.54900000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.78900000000000003,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.80100000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542190,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297860,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":516096,"data_stored":215407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.56699999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88800000000000001,"5min":1.022,"15min":1.022},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68799999999999994,"15min":0.68100000000000005},"min":{"1min":0.58699999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.879,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60299999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.56299999999999994,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98399999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.67700000000000005,"15min":0.66100000000000003},"min":{"1min":0.57499999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90300000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.57599999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.61199999999999999,"5min":0.497,"15min":0.497},"max":{"1min":0.93100000000000005,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.75700000000000001,"15min":0.78500000000000003},"min":{"1min":0.59599999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91100000000000003,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":0.54900000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.63100000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88300000000000001,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.80900000000000005,"15min":0.84399999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96199999999999997,"5min":3.665,"15min":3.665},"last":0.74099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.62,"15min":0.63900000000000001},"min":{"1min":0.44500000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.752,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.66700000000000004},"min":{"1min":0.47899999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.76400000000000001,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.76100000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66900000000000004,"15min":0.68300000000000005},"min":{"1min":0.48899999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80900000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68100000000000005,"15min":0.69599999999999995},"min":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84899999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63600000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72699999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.53700000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93000000000000005,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.80900000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542190,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297880,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":532480,"data_stored":221055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67700000000000005,"15min":0.69199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.753,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.879},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.441,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.85699999999999998,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.84699999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81100000000000005,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.68000000000000005,"15min":0.67400000000000004},"min":{"1min":0.46100000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.88,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.82699999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76000000000000001,"15min":0.75800000000000001},"min":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.53300000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.75900000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90800000000000003,"5min":1.272,"15min":1.272},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.93400000000000005,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.92300000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.61599999999999999,"15min":0.65400000000000003},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68899999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.627,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73799999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.47399999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65000000000000002,"15min":0.66300000000000003},"min":{"1min":0.44400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.81999999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.69699999999999995,"15min":0.73099999999999998},"min":{"1min":0.45900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75700000000000001,"5min":1.018,"15min":1.018},"last":0.65600000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69499999999999995,"15min":0.70699999999999996},"min":{"1min":0.51400000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82199999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.51400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88500000000000001,"5min":1.004,"15min":1.004},"last":0.59999999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542190,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302024,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":516096,"data_stored":215407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66700000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45200000000000001,"15min":0.44},"min":{"1min":0.36699999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70399999999999996,"5min":0.755,"15min":0.755},"last":0.439}]},{"osd":1,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.59699999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.67500000000000004,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.60199999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.54200000000000004},"min":{"1min":0.38900000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73299999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.51200000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.76200000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.56100000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.79800000000000004,"15min":0.79600000000000004},"min":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0409999999999999,"5min":1.173,"15min":1.173},"last":0.83299999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96599999999999997,"5min":1.075,"15min":1.075},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.56299999999999994,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0189999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.85699999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.67400000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.03,"5min":1.179,"15min":1.179},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.78700000000000003,"15min":0.78600000000000003},"min":{"1min":0.53700000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0760000000000001,"5min":1.218,"15min":1.218},"last":0.84899999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79400000000000004,"15min":0.79100000000000004},"min":{"1min":0.58899999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.036,"5min":1.145,"15min":1.145},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.78900000000000003,"15min":0.78200000000000003},"min":{"1min":0.63800000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.0860000000000001,"5min":1.202,"15min":1.202},"last":0.97999999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":516096,"data_stored":215407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.34599999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.86799999999999999,"5min":1.855,"15min":1.855},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65100000000000002,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.44600000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.53400000000000003,"15min":0.55400000000000005},"min":{"1min":0.34899999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.60699999999999998,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.379},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.56599999999999995,"15min":0.54000000000000004},"min":{"1min":0.39900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90300000000000002,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.622}]},{"osd":3,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.36199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81200000000000006,"5min":2.302,"15min":2.302},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64900000000000002,"15min":0.63300000000000001},"min":{"1min":0.48899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93799999999999994,"5min":1.819,"15min":1.819},"last":0.57199999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79700000000000004,"15min":0.76700000000000002},"min":{"1min":0.61499999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0489999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84199999999999997,"15min":0.84899999999999998},"min":{"1min":0.61299999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0920000000000001,"5min":1.732,"15min":1.732},"last":0.64200000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.82399999999999995,"15min":0.82599999999999996},"min":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1919999999999999,"5min":1.474,"15min":1.474},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.83399999999999996,"15min":0.84399999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.075,"5min":2.198,"15min":2.198},"last":0.68000000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.88600000000000001,"15min":0.90200000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.224,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.84599999999999997,"15min":0.83199999999999996},"min":{"1min":0.67100000000000004,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1659999999999999,"5min":1.571,"15min":1.571},"last":0.66900000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.86299999999999999,"15min":0.86899999999999999},"min":{"1min":0.59099999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.089,"5min":1.675,"15min":1.675},"last":0.746},{"interface":"front","average":{"1min":0.874,"5min":0.92500000000000004,"15min":0.94299999999999995},"min":{"1min":0.64800000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.125,"5min":2.234,"15min":2.234},"last":0.65600000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542190,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302020,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":516096,"data_stored":215407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.501,"15min":0.53300000000000003},"min":{"1min":0.31,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55900000000000005,"5min":1.968,"15min":1.968},"last":0.503},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.5,"15min":0.497},"min":{"1min":0.34599999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.67300000000000004,"5min":1.28,"15min":1.28},"last":0.36299999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.56999999999999995,"15min":0.60699999999999998},"min":{"1min":0.36199999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69299999999999995,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.433},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.69899999999999995,"15min":0.753},"min":{"1min":0.38200000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82199999999999995,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":0.54200000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.65600000000000003,"15min":0.69799999999999995},"min":{"1min":0.42599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73099999999999998,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":0.52200000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.85799999999999998,"15min":0.89600000000000002},"min":{"1min":0.53100000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96999999999999997,"5min":2.544,"15min":2.544},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.92900000000000005,"15min":0.98299999999999998},"min":{"1min":0.65000000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0569999999999999,"5min":3.6480000000000001,"15min":3.6480000000000001},"last":0.85499999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80400000000000005,"15min":0.83399999999999996},"min":{"1min":0.63500000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98699999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.84399999999999997,"15min":0.879},"min":{"1min":0.64600000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0800000000000001,"5min":2.4630000000000001,"15min":2.4630000000000001},"last":0.72199999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.88200000000000001,"15min":0.93600000000000005},"min":{"1min":0.66400000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.997,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.85099999999999998,"15min":0.88500000000000001},"min":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.94999999999999996,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":0.749}]},{"osd":7,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.86699999999999999,"15min":0.89800000000000002},"min":{"1min":0.65600000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.04,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.88300000000000001,"15min":0.92100000000000004},"min":{"1min":0.68000000000000005,"5min":0.502,"15min":0.502},"max":{"1min":1.024,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.91300000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542190,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1110016,"data_stored":805775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.46500000000000002,"15min":0.48899999999999999},"min":{"1min":0.33100000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.44900000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.377,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.89500000000000002,"5min":2.254,"15min":2.254},"last":0.46600000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.57799999999999996,"15min":0.60399999999999998},"min":{"1min":0.41499999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63400000000000001,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63,"15min":0.65200000000000002},"min":{"1min":0.48499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.748,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.63300000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54400000000000004,"15min":0.56000000000000005},"min":{"1min":0.35799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.66200000000000003,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.498},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63900000000000001,"15min":0.64800000000000002},"min":{"1min":0.48699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82699999999999996,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":0.64700000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.754,"15min":0.749},"min":{"1min":0.60999999999999999,"5min":0.498,"15min":0.498},"max":{"1min":0.90400000000000003,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58899999999999997,"5min":0.432,"15min":0.432},"max":{"1min":0.99399999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.94199999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.69199999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":0.879,"5min":1.321,"15min":1.321},"last":0.999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.65100000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0289999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.0580000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.60099999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.90200000000000002,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.61899999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.89400000000000002,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.0760000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82999999999999996,"15min":0.84199999999999997},"min":{"1min":0.61399999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.99299999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.81799999999999995,"15min":0.82899999999999996},"min":{"1min":0.58299999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96099999999999997,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.77800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:05.867 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:06.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.017+0000 7f8687e00640 1 Processor -- start 2024-08-17T02:27:06.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.018+0000 7f8687e00640 1 -- start start 2024-08-17T02:27:06.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.019+0000 7f8687e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86880b0e30 0x7f86880b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.019+0000 7f8687e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f868815a590 0x7f868813fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.019+0000 7f8687e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868806d7c0 con 0x7f8688156f90 2024-08-17T02:27:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.019+0000 7f8687e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868815ab30 con 0x7f868815a590 2024-08-17T02:27:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.019+0000 7f8687e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868815ae10 con 0x7f86880b0e30 2024-08-17T02:27:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.019+0000 7f8687400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f868815a590 0x7f868813fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.019+0000 7f867fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8688156f90 0x7f86880cb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39184/0 (socket says 172.21.15.5:39184) 2024-08-17T02:27:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.019+0000 7f8687400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f868815a590 0x7f868813fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46026/0 (socket says 172.21.15.5:46026) 2024-08-17T02:27:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.019+0000 7f867fe00640 1 -- 172.21.15.5:0/3707652394 learned_addr learned my addr 172.21.15.5:0/3707652394 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.019+0000 7f8686a00640 1 --2- 172.21.15.5:0/3707652394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86880b0e30 0x7f86880b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.020+0000 7f8687400640 1 -- 172.21.15.5:0/3707652394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86880b0e30 msgr2=0x7f86880b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:06.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.020+0000 7f8687400640 1 --2- 172.21.15.5:0/3707652394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86880b0e30 0x7f86880b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.020+0000 7f8687400640 1 -- 172.21.15.5:0/3707652394 >> v1:172.21.15.5:6789/0 conn(0x7f8688156f90 legacy=0x7f86880cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.020+0000 7f8686000640 1 -- 172.21.15.5:0/3707652394 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114860790 0 0) 0x7f868806d7c0 con 0x7f8688156f90 2024-08-17T02:27:06.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.020+0000 7f8687400640 1 -- 172.21.15.5:0/3707652394 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868815b0f0 con 0x7f868815a590 2024-08-17T02:27:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.021+0000 7f8687400640 1 --2- 172.21.15.5:0/3707652394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f868815a590 0x7f868813fcc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8680009e60 tx=0x7f8680009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3548ad7097c36df9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.021+0000 7f8686000640 1 -- 172.21.15.5:0/3707652394 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680007550 con 0x7f868815a590 2024-08-17T02:27:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.021+0000 7f8686000640 1 -- 172.21.15.5:0/3707652394 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868002d050 con 0x7f868815a590 2024-08-17T02:27:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.021+0000 7f8686000640 1 -- 172.21.15.5:0/3707652394 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86800078e0 con 0x7f868815a590 2024-08-17T02:27:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.021+0000 7f8687e00640 1 -- 172.21.15.5:0/3707652394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f868815a590 msgr2=0x7f868813fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.021+0000 7f8687e00640 1 --2- 172.21.15.5:0/3707652394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f868815a590 0x7f868813fcc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8680009e60 tx=0x7f8680009780 comp rx=0 tx=0).stop 2024-08-17T02:27:06.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.022+0000 7f8687e00640 1 -- 172.21.15.5:0/3707652394 shutdown_connections 2024-08-17T02:27:06.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.022+0000 7f8687e00640 1 --2- 172.21.15.5:0/3707652394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f868815a590 0x7f868813fcc0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.022+0000 7f8687e00640 1 --2- 172.21.15.5:0/3707652394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86880b0e30 0x7f86880b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.022+0000 7f8687e00640 1 -- 172.21.15.5:0/3707652394 >> 172.21.15.5:0/3707652394 conn(0x7f8688062af0 msgr2=0x7f8688062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.022+0000 7f8687e00640 1 -- 172.21.15.5:0/3707652394 shutdown_connections 2024-08-17T02:27:06.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.022+0000 7f8687e00640 1 -- 172.21.15.5:0/3707652394 wait complete. 2024-08-17T02:27:06.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.023+0000 7f8687e00640 1 Processor -- start 2024-08-17T02:27:06.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.023+0000 7f8687e00640 1 -- start start 2024-08-17T02:27:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.024+0000 7f8687e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86880b0e30 0x7f86880c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.024+0000 7f8687e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688156f90 0x7f8688159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.024+0000 7f8687e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f868815a590 0x7f86880aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.024+0000 7f8687e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868815a250 con 0x7f8688156f90 2024-08-17T02:27:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.024+0000 7f8687e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8688157b70 con 0x7f868815a590 2024-08-17T02:27:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.024+0000 7f8687e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86881584e0 con 0x7f86880b0e30 2024-08-17T02:27:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.024+0000 7f867fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688156f90 0x7f8688159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.024+0000 7f867fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688156f90 0x7f8688159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46028/0 (socket says 172.21.15.5:46028) 2024-08-17T02:27:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.024+0000 7f867fe00640 1 -- 172.21.15.5:0/1526246062 learned_addr learned my addr 172.21.15.5:0/1526246062 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.024+0000 7f8686a00640 1 --2- 172.21.15.5:0/1526246062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86880b0e30 0x7f86880c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.025+0000 7f8687400640 1 --2- 172.21.15.5:0/1526246062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f868815a590 0x7f86880aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.025+0000 7f867fe00640 1 -- 172.21.15.5:0/1526246062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86880b0e30 msgr2=0x7f86880c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.025+0000 7f867fe00640 1 --2- 172.21.15.5:0/1526246062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86880b0e30 0x7f86880c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.025+0000 7f867fe00640 1 -- 172.21.15.5:0/1526246062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f868815a590 msgr2=0x7f86880aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.025+0000 7f867fe00640 1 --2- 172.21.15.5:0/1526246062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f868815a590 0x7f86880aec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.025+0000 7f867fe00640 1 -- 172.21.15.5:0/1526246062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8680009a20 con 0x7f8688156f90 2024-08-17T02:27:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.025+0000 7f8687400640 1 --2- 172.21.15.5:0/1526246062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f868815a590 0x7f86880aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.025+0000 7f867fe00640 1 --2- 172.21.15.5:0/1526246062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688156f90 0x7f8688159d10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f867000c5e0 tx=0x7f8670007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.025+0000 7f867e000640 1 -- 172.21.15.5:0/1526246062 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670005aa0 con 0x7f8688156f90 2024-08-17T02:27:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.025+0000 7f867e000640 1 -- 172.21.15.5:0/1526246062 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8670005c00 con 0x7f8688156f90 2024-08-17T02:27:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.025+0000 7f867e000640 1 -- 172.21.15.5:0/1526246062 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86700070f0 con 0x7f8688156f90 2024-08-17T02:27:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.025+0000 7f8687e00640 1 -- 172.21.15.5:0/1526246062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8688158200 con 0x7f8688156f90 2024-08-17T02:27:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.025+0000 7f8687e00640 1 -- 172.21.15.5:0/1526246062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8688157800 con 0x7f8688156f90 2024-08-17T02:27:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.027+0000 7f8687e00640 1 -- 172.21.15.5:0/1526246062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8688159a30 con 0x7f8688156f90 2024-08-17T02:27:06.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.027+0000 7f867e000640 1 -- 172.21.15.5:0/1526246062 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f86700074e0 con 0x7f8688156f90 2024-08-17T02:27:06.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.029+0000 7f867e000640 1 --2- 172.21.15.5:0/1526246062 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8664065150 0x7f8664067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.029+0000 7f867e000640 1 -- 172.21.15.5:0/1526246062 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f8670081c00 con 0x7f8688156f90 2024-08-17T02:27:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.029+0000 7f8686a00640 1 --2- 172.21.15.5:0/1526246062 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8664065150 0x7f8664067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.030+0000 7f8686a00640 1 --2- 172.21.15.5:0/1526246062 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8664065150 0x7f8664067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8678009d20 tx=0x7f86780090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.033+0000 7f867e000640 1 -- 172.21.15.5:0/1526246062 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8688159a30 con 0x7f8688156f90 2024-08-17T02:27:06.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.211+0000 7f8687e00640 1 -- 172.21.15.5:0/1526246062 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8688159a30 con 0x7f8664065150 2024-08-17T02:27:06.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.213+0000 7f867e000640 1 -- 172.21.15.5:0/1526246062 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51280 (secure 0 0 0) 0x7f8688159a30 con 0x7f8664065150 2024-08-17T02:27:06.214 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:27:06.214 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:27:06.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.215+0000 7f8687e00640 1 -- 172.21.15.5:0/1526246062 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8664065150 msgr2=0x7f8664067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.215+0000 7f8687e00640 1 --2- 172.21.15.5:0/1526246062 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8664065150 0x7f8664067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8678009d20 tx=0x7f86780090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.215+0000 7f8687e00640 1 -- 172.21.15.5:0/1526246062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688156f90 msgr2=0x7f8688159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.215+0000 7f8687e00640 1 --2- 172.21.15.5:0/1526246062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688156f90 0x7f8688159d10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f867000c5e0 tx=0x7f8670007d60 comp rx=0 tx=0).stop 2024-08-17T02:27:06.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.215+0000 7f8687e00640 1 -- 172.21.15.5:0/1526246062 shutdown_connections 2024-08-17T02:27:06.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.215+0000 7f8687e00640 1 --2- 172.21.15.5:0/1526246062 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8664065150 0x7f8664067600 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.215+0000 7f8687e00640 1 --2- 172.21.15.5:0/1526246062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f868815a590 0x7f86880aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.215+0000 7f8687e00640 1 --2- 172.21.15.5:0/1526246062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688156f90 0x7f8688159d10 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.215+0000 7f8687e00640 1 --2- 172.21.15.5:0/1526246062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86880b0e30 0x7f86880c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.215+0000 7f8687e00640 1 -- 172.21.15.5:0/1526246062 >> 172.21.15.5:0/1526246062 conn(0x7f8688062af0 msgr2=0x7f86880af640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.215+0000 7f8687e00640 1 -- 172.21.15.5:0/1526246062 shutdown_connections 2024-08-17T02:27:06.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.215+0000 7f8687e00640 1 -- 172.21.15.5:0/1526246062 wait complete. 2024-08-17T02:27:06.231 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-08-17T02:27:04.772301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":2400724,"kb_used_data":5224,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752573996,"statfs":{"total":773094113280,"available":770635771904,"internally_reserved":0,"allocated":5349376,"data_stored":2915288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001246"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-17T02:26:59.794356+0000","last_change":"2024-08-17T02:23:30.651033+0000","last_active":"2024-08-17T02:26:59.794356+0000","last_peered":"2024-08-17T02:26:59.794356+0000","last_clean":"2024-08-17T02:26:59.794356+0000","last_became_active":"2024-08-17T02:23:30.649860+0000","last_became_peered":"2024-08-17T02:23:30.649860+0000","last_unstale":"2024-08-17T02:26:59.794356+0000","last_undegraded":"2024-08-17T02:26:59.794356+0000","last_fullsized":"2024-08-17T02:26:59.794356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.523857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:29:35.288625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542190,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1110016,"data_stored":805775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.66300000000000003,"15min":0.624},"min":{"1min":0.41499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97099999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67000000000000004,"15min":0.64300000000000002},"min":{"1min":0.54700000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89500000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.38300000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68799999999999994,"15min":0.66200000000000003},"min":{"1min":0.54300000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65600000000000003,"15min":0.63200000000000001},"min":{"1min":0.51700000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86899999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.47699999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.69999999999999996,"15min":0.66600000000000004},"min":{"1min":0.58999999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97299999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69099999999999995,"15min":0.67700000000000005},"min":{"1min":0.58099999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.64500000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69199999999999995,"15min":0.66800000000000004},"min":{"1min":0.55200000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":0.995,"15min":0.995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.72999999999999998,"15min":0.71399999999999997},"min":{"1min":0.66300000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.92600000000000005,"5min":1.032,"15min":1.032},"last":0.68200000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66700000000000004,"15min":0.68500000000000005},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.505}]},{"osd":5,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.64700000000000002,"15min":0.67000000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.73699999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.628},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.89700000000000002,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.75600000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.75800000000000001,"15min":0.78300000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95299999999999996,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.74199999999999999,"15min":0.76000000000000001},"min":{"1min":0.48299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95899999999999996,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.66300000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542191,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297880,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":532480,"data_stored":221055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.68000000000000005},"min":{"1min":0.57599999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84199999999999997,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.57199999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86399999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.76600000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.70399999999999996,"15min":0.68200000000000005},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94099999999999995,"5min":1.111,"15min":1.111},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91100000000000003,"5min":3.444,"15min":3.444},"last":0.96099999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.83299999999999996,"15min":0.85799999999999998},"min":{"1min":0.67100000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.878,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.84199999999999997,"15min":0.86599999999999999},"min":{"1min":0.65800000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97899999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":0.97799999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72699999999999998,"15min":0.71899999999999997},"min":{"1min":0.60899999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.86899999999999999,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.87},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.67400000000000004,"15min":0.64500000000000002},"min":{"1min":0.63300000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88800000000000001,"5min":1.087,"15min":1.087},"last":0.92400000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.624,"15min":0.61899999999999999},"min":{"1min":0.42999999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89800000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.52900000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81499999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.54500000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.52100000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78200000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.52800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.89000000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72499999999999998,"15min":0.73499999999999999},"min":{"1min":0.55800000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80500000000000005,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.71299999999999997,"15min":0.71899999999999997},"min":{"1min":0.54900000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.78900000000000003,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.80100000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542190,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297860,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":516096,"data_stored":215407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.56699999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88800000000000001,"5min":1.022,"15min":1.022},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68799999999999994,"15min":0.68100000000000005},"min":{"1min":0.58699999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.879,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60299999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.56299999999999994,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98399999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.67700000000000005,"15min":0.66100000000000003},"min":{"1min":0.57499999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90300000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.57599999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.61199999999999999,"5min":0.497,"15min":0.497},"max":{"1min":0.93100000000000005,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.75700000000000001,"15min":0.78500000000000003},"min":{"1min":0.59599999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91100000000000003,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":0.54900000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.63100000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88300000000000001,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.80900000000000005,"15min":0.84399999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96199999999999997,"5min":3.665,"15min":3.665},"last":0.74099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.62,"15min":0.63900000000000001},"min":{"1min":0.44500000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.752,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.66700000000000004},"min":{"1min":0.47899999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.76400000000000001,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.76100000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66900000000000004,"15min":0.68300000000000005},"min":{"1min":0.48899999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80900000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68100000000000005,"15min":0.69599999999999995},"min":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84899999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63600000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72699999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.53700000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93000000000000005,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.80900000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542190,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297880,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":532480,"data_stored":221055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67700000000000005,"15min":0.69199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.753,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.879},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.441,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.85699999999999998,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.84699999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81100000000000005,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.68000000000000005,"15min":0.67400000000000004},"min":{"1min":0.46100000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.88,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.82699999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76000000000000001,"15min":0.75800000000000001},"min":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.53300000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.75900000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90800000000000003,"5min":1.272,"15min":1.272},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.93400000000000005,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.92300000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.61599999999999999,"15min":0.65400000000000003},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68899999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.627,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73799999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.47399999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65000000000000002,"15min":0.66300000000000003},"min":{"1min":0.44400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.81999999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.69699999999999995,"15min":0.73099999999999998},"min":{"1min":0.45900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75700000000000001,"5min":1.018,"15min":1.018},"last":0.65600000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69499999999999995,"15min":0.70699999999999996},"min":{"1min":0.51400000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82199999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.51400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88500000000000001,"5min":1.004,"15min":1.004},"last":0.59999999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542190,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302024,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":516096,"data_stored":215407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66700000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45200000000000001,"15min":0.44},"min":{"1min":0.36699999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70399999999999996,"5min":0.755,"15min":0.755},"last":0.439}]},{"osd":1,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.59699999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.67500000000000004,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.60199999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.54200000000000004},"min":{"1min":0.38900000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73299999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.51200000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.76200000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.56100000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.79800000000000004,"15min":0.79600000000000004},"min":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0409999999999999,"5min":1.173,"15min":1.173},"last":0.83299999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96599999999999997,"5min":1.075,"15min":1.075},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.56299999999999994,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0189999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.85699999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.67400000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.03,"5min":1.179,"15min":1.179},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.78700000000000003,"15min":0.78600000000000003},"min":{"1min":0.53700000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0760000000000001,"5min":1.218,"15min":1.218},"last":0.84899999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79400000000000004,"15min":0.79100000000000004},"min":{"1min":0.58899999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.036,"5min":1.145,"15min":1.145},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.78900000000000003,"15min":0.78200000000000003},"min":{"1min":0.63800000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.0860000000000001,"5min":1.202,"15min":1.202},"last":0.97999999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":516096,"data_stored":215407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.34599999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.86799999999999999,"5min":1.855,"15min":1.855},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65100000000000002,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.44600000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.53400000000000003,"15min":0.55400000000000005},"min":{"1min":0.34899999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.60699999999999998,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.379},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.56599999999999995,"15min":0.54000000000000004},"min":{"1min":0.39900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90300000000000002,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.622}]},{"osd":3,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.36199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81200000000000006,"5min":2.302,"15min":2.302},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64900000000000002,"15min":0.63300000000000001},"min":{"1min":0.48899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93799999999999994,"5min":1.819,"15min":1.819},"last":0.57199999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79700000000000004,"15min":0.76700000000000002},"min":{"1min":0.61499999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0489999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84199999999999997,"15min":0.84899999999999998},"min":{"1min":0.61299999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0920000000000001,"5min":1.732,"15min":1.732},"last":0.64200000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.82399999999999995,"15min":0.82599999999999996},"min":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1919999999999999,"5min":1.474,"15min":1.474},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.83399999999999996,"15min":0.84399999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.075,"5min":2.198,"15min":2.198},"last":0.68000000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.88600000000000001,"15min":0.90200000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.224,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.84599999999999997,"15min":0.83199999999999996},"min":{"1min":0.67100000000000004,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1659999999999999,"5min":1.571,"15min":1.571},"last":0.66900000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.86299999999999999,"15min":0.86899999999999999},"min":{"1min":0.59099999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.089,"5min":1.675,"15min":1.675},"last":0.746},{"interface":"front","average":{"1min":0.874,"5min":0.92500000000000004,"15min":0.94299999999999995},"min":{"1min":0.64800000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.125,"5min":2.234,"15min":2.234},"last":0.65600000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542190,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302020,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":516096,"data_stored":215407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.501,"15min":0.53300000000000003},"min":{"1min":0.31,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55900000000000005,"5min":1.968,"15min":1.968},"last":0.503},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.5,"15min":0.497},"min":{"1min":0.34599999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.67300000000000004,"5min":1.28,"15min":1.28},"last":0.36299999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.56999999999999995,"15min":0.60699999999999998},"min":{"1min":0.36199999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69299999999999995,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.433},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.69899999999999995,"15min":0.753},"min":{"1min":0.38200000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82199999999999995,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":0.54200000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.65600000000000003,"15min":0.69799999999999995},"min":{"1min":0.42599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73099999999999998,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":0.52200000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.85799999999999998,"15min":0.89600000000000002},"min":{"1min":0.53100000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96999999999999997,"5min":2.544,"15min":2.544},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.92900000000000005,"15min":0.98299999999999998},"min":{"1min":0.65000000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0569999999999999,"5min":3.6480000000000001,"15min":3.6480000000000001},"last":0.85499999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80400000000000005,"15min":0.83399999999999996},"min":{"1min":0.63500000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98699999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.84399999999999997,"15min":0.879},"min":{"1min":0.64600000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0800000000000001,"5min":2.4630000000000001,"15min":2.4630000000000001},"last":0.72199999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.88200000000000001,"15min":0.93600000000000005},"min":{"1min":0.66400000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.997,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.85099999999999998,"15min":0.88500000000000001},"min":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.94999999999999996,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":0.749}]},{"osd":7,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.86699999999999999,"15min":0.89800000000000002},"min":{"1min":0.65600000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.04,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.88300000000000001,"15min":0.92100000000000004},"min":{"1min":0.68000000000000005,"5min":0.502,"15min":0.502},"max":{"1min":1.024,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.91300000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542190,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1110016,"data_stored":805775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.46500000000000002,"15min":0.48899999999999999},"min":{"1min":0.33100000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.44900000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.377,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.89500000000000002,"5min":2.254,"15min":2.254},"last":0.46600000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.57799999999999996,"15min":0.60399999999999998},"min":{"1min":0.41499999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63400000000000001,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63,"15min":0.65200000000000002},"min":{"1min":0.48499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.748,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.63300000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54400000000000004,"15min":0.56000000000000005},"min":{"1min":0.35799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.66200000000000003,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.498},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63900000000000001,"15min":0.64800000000000002},"min":{"1min":0.48699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82699999999999996,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":0.64700000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.754,"15min":0.749},"min":{"1min":0.60999999999999999,"5min":0.498,"15min":0.498},"max":{"1min":0.90400000000000003,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58899999999999997,"5min":0.432,"15min":0.432},"max":{"1min":0.99399999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.94199999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.69199999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":0.879,"5min":1.321,"15min":1.321},"last":0.999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.65100000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0289999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.0580000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.60099999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.90200000000000002,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.61899999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.89400000000000002,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.0760000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82999999999999996,"15min":0.84199999999999997},"min":{"1min":0.61399999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.99299999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.81799999999999995,"15min":0.82899999999999996},"min":{"1min":0.58299999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96099999999999997,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.77800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:06.232 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:27:06.233 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.383+0000 7f90b1e00640 1 Processor -- start 2024-08-17T02:27:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.383+0000 7f90b1e00640 1 -- start start 2024-08-17T02:27:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.384+0000 7f90b1e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90ac0afca0 0x7f90ac0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.384+0000 7f90b1e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f90ac0acf10 0x7f90ac159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.385+0000 7f90b1e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ac15a4e0 con 0x7f90ac1589a0 2024-08-17T02:27:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.385+0000 7f90b1e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ac0b0980 con 0x7f90ac0afca0 2024-08-17T02:27:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.385+0000 7f90b1e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ac0c92b0 con 0x7f90ac0acf10 2024-08-17T02:27:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.385+0000 7f90aaa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90ac0afca0 0x7f90ac0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.385+0000 7f90aaa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90ac0afca0 0x7f90ac0b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46040/0 (socket says 172.21.15.5:46040) 2024-08-17T02:27:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.385+0000 7f90aaa00640 1 -- 172.21.15.5:0/2744314538 learned_addr learned my addr 172.21.15.5:0/2744314538 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:06.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.385+0000 7f90aaa00640 1 -- 172.21.15.5:0/2744314538 >> v2:172.21.15.87:3300/0 conn(0x7f90ac0acf10 msgr2=0x7f90ac159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:06.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.385+0000 7f90aaa00640 1 --2- 172.21.15.5:0/2744314538 >> v2:172.21.15.87:3300/0 conn(0x7f90ac0acf10 0x7f90ac159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.385+0000 7f90aaa00640 1 -- 172.21.15.5:0/2744314538 >> v1:172.21.15.87:6789/0 conn(0x7f90ac1589a0 legacy=0x7f90ac158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:06.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.385+0000 7f90aaa00640 1 -- 172.21.15.5:0/2744314538 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ac0ad480 con 0x7f90ac0afca0 2024-08-17T02:27:06.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.386+0000 7f90aaa00640 1 --2- 172.21.15.5:0/2744314538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac0afca0 0x7f90ac0b0070 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f90ac0c83b0 tx=0x7f909c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f459121039ae16 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.386+0000 7f90aa000640 1 -- 172.21.15.5:0/2744314538 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c02add0 con 0x7f90ac0afca0 2024-08-17T02:27:06.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.387+0000 7f90aa000640 1 -- 172.21.15.5:0/2744314538 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909c032440 con 0x7f90ac0afca0 2024-08-17T02:27:06.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.387+0000 7f90aa000640 1 -- 172.21.15.5:0/2744314538 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c032820 con 0x7f90ac0afca0 2024-08-17T02:27:06.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.387+0000 7f90b1e00640 1 -- 172.21.15.5:0/2744314538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac0afca0 msgr2=0x7f90ac0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.387+0000 7f90b1e00640 1 --2- 172.21.15.5:0/2744314538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac0afca0 0x7f90ac0b0070 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f90ac0c83b0 tx=0x7f909c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.387+0000 7f90b1e00640 1 -- 172.21.15.5:0/2744314538 shutdown_connections 2024-08-17T02:27:06.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.387+0000 7f90b1e00640 1 --2- 172.21.15.5:0/2744314538 >> v2:172.21.15.87:3300/0 conn(0x7f90ac0acf10 0x7f90ac159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.387+0000 7f90b1e00640 1 --2- 172.21.15.5:0/2744314538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac0afca0 0x7f90ac0b0070 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.387+0000 7f90b1e00640 1 -- 172.21.15.5:0/2744314538 >> 172.21.15.5:0/2744314538 conn(0x7f90ac066e60 msgr2=0x7f90ac067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.387+0000 7f90b1e00640 1 -- 172.21.15.5:0/2744314538 shutdown_connections 2024-08-17T02:27:06.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.387+0000 7f90b1e00640 1 -- 172.21.15.5:0/2744314538 wait complete. 2024-08-17T02:27:06.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.389+0000 7f90b1e00640 1 Processor -- start 2024-08-17T02:27:06.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.389+0000 7f90b1e00640 1 -- start start 2024-08-17T02:27:06.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.389+0000 7f90b1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac0acf10 0x7f90ac14dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.389+0000 7f90b1e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ac0afca0 0x7f90ac14bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.390+0000 7f90b1e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ac1589a0 0x7f90ac146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.390+0000 7f90b1e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac14d150 con 0x7f90ac0acf10 2024-08-17T02:27:06.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.390+0000 7f90b1e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac14f3e0 con 0x7f90ac1589a0 2024-08-17T02:27:06.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.390+0000 7f90b1e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac14f100 con 0x7f90ac0afca0 2024-08-17T02:27:06.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.390+0000 7f90aaa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac0acf10 0x7f90ac14dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.390+0000 7f90aaa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac0acf10 0x7f90ac14dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46048/0 (socket says 172.21.15.5:46048) 2024-08-17T02:27:06.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.390+0000 7f90aaa00640 1 -- 172.21.15.5:0/3581106092 learned_addr learned my addr 172.21.15.5:0/3581106092 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:06.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.390+0000 7f90ab400640 1 --2- 172.21.15.5:0/3581106092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ac1589a0 0x7f90ac146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.390+0000 7f90a3e00640 1 --2- 172.21.15.5:0/3581106092 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ac0afca0 0x7f90ac14bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.390+0000 7f90aaa00640 1 -- 172.21.15.5:0/3581106092 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ac0afca0 msgr2=0x7f90ac14bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.390+0000 7f90aaa00640 1 --2- 172.21.15.5:0/3581106092 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ac0afca0 0x7f90ac14bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.390+0000 7f90aaa00640 1 -- 172.21.15.5:0/3581106092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ac1589a0 msgr2=0x7f90ac146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.390+0000 7f90aaa00640 1 --2- 172.21.15.5:0/3581106092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ac1589a0 0x7f90ac146d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.390+0000 7f90aaa00640 1 -- 172.21.15.5:0/3581106092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c009450 con 0x7f90ac0acf10 2024-08-17T02:27:06.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.390+0000 7f90a3e00640 1 --2- 172.21.15.5:0/3581106092 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ac0afca0 0x7f90ac14bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:06.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.391+0000 7f90aaa00640 1 --2- 172.21.15.5:0/3581106092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac0acf10 0x7f90ac14dfd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f909c009940 tx=0x7f909c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.391+0000 7f90a2000640 1 -- 172.21.15.5:0/3581106092 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c031b30 con 0x7f90ac0acf10 2024-08-17T02:27:06.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.391+0000 7f90a2000640 1 -- 172.21.15.5:0/3581106092 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909c031c90 con 0x7f90ac0acf10 2024-08-17T02:27:06.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.391+0000 7f90a2000640 1 -- 172.21.15.5:0/3581106092 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c03e6a0 con 0x7f90ac0acf10 2024-08-17T02:27:06.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.391+0000 7f90b1e00640 1 -- 172.21.15.5:0/3581106092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ac14d4f0 con 0x7f90ac0acf10 2024-08-17T02:27:06.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.391+0000 7f90b1e00640 1 -- 172.21.15.5:0/3581106092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ac14d880 con 0x7f90ac0acf10 2024-08-17T02:27:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.392+0000 7f90b1e00640 1 -- 172.21.15.5:0/3581106092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ac14dcd0 con 0x7f90ac0acf10 2024-08-17T02:27:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.393+0000 7f90a2000640 1 -- 172.21.15.5:0/3581106092 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f909c03c400 con 0x7f90ac0acf10 2024-08-17T02:27:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.394+0000 7f90a2000640 1 --2- 172.21.15.5:0/3581106092 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9088065180 0x7f9088067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.394+0000 7f90a2000640 1 -- 172.21.15.5:0/3581106092 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f909c0a2270 con 0x7f90ac0acf10 2024-08-17T02:27:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.394+0000 7f90a3e00640 1 --2- 172.21.15.5:0/3581106092 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9088065180 0x7f9088067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.394+0000 7f90a3e00640 1 --2- 172.21.15.5:0/3581106092 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9088065180 0x7f9088067630 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f90ac158fc0 tx=0x7f9094008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.398+0000 7f90a2000640 1 -- 172.21.15.5:0/3581106092 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f909c0705e0 con 0x7f90ac0acf10 2024-08-17T02:27:06.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.576+0000 7f90b1e00640 1 -- 172.21.15.5:0/3581106092 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f90ac15a4e0 con 0x7f9088065180 2024-08-17T02:27:06.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.578+0000 7f90a2000640 1 -- 172.21.15.5:0/3581106092 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51280 (secure 0 0 0) 0x7f90ac15a4e0 con 0x7f9088065180 2024-08-17T02:27:06.579 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:27:06.579 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:27:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.580+0000 7f90b1e00640 1 -- 172.21.15.5:0/3581106092 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9088065180 msgr2=0x7f9088067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.580+0000 7f90b1e00640 1 --2- 172.21.15.5:0/3581106092 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9088065180 0x7f9088067630 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f90ac158fc0 tx=0x7f9094008040 comp rx=0 tx=0).stop 2024-08-17T02:27:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.580+0000 7f90b1e00640 1 -- 172.21.15.5:0/3581106092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac0acf10 msgr2=0x7f90ac14dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.580+0000 7f90b1e00640 1 --2- 172.21.15.5:0/3581106092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac0acf10 0x7f90ac14dfd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f909c009940 tx=0x7f909c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.580+0000 7f90b1e00640 1 -- 172.21.15.5:0/3581106092 shutdown_connections 2024-08-17T02:27:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.580+0000 7f90b1e00640 1 --2- 172.21.15.5:0/3581106092 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9088065180 0x7f9088067630 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.580+0000 7f90b1e00640 1 --2- 172.21.15.5:0/3581106092 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ac0afca0 0x7f90ac14bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.580+0000 7f90b1e00640 1 --2- 172.21.15.5:0/3581106092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ac1589a0 0x7f90ac146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.580+0000 7f90b1e00640 1 --2- 172.21.15.5:0/3581106092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac0acf10 0x7f90ac14dfd0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.580+0000 7f90b1e00640 1 -- 172.21.15.5:0/3581106092 >> 172.21.15.5:0/3581106092 conn(0x7f90ac066e60 msgr2=0x7f90ac0aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.580+0000 7f90b1e00640 1 -- 172.21.15.5:0/3581106092 shutdown_connections 2024-08-17T02:27:06.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.580+0000 7f90b1e00640 1 -- 172.21.15.5:0/3581106092 wait complete. 2024-08-17T02:27:06.596 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-08-17T02:27:04.772301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":2400724,"kb_used_data":5224,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752573996,"statfs":{"total":773094113280,"available":770635771904,"internally_reserved":0,"allocated":5349376,"data_stored":2915288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001246"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-17T02:26:59.794356+0000","last_change":"2024-08-17T02:23:30.651033+0000","last_active":"2024-08-17T02:26:59.794356+0000","last_peered":"2024-08-17T02:26:59.794356+0000","last_clean":"2024-08-17T02:26:59.794356+0000","last_became_active":"2024-08-17T02:23:30.649860+0000","last_became_peered":"2024-08-17T02:23:30.649860+0000","last_unstale":"2024-08-17T02:26:59.794356+0000","last_undegraded":"2024-08-17T02:26:59.794356+0000","last_fullsized":"2024-08-17T02:26:59.794356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.523857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:29:35.288625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542190,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1110016,"data_stored":805775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.66300000000000003,"15min":0.624},"min":{"1min":0.41499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97099999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67000000000000004,"15min":0.64300000000000002},"min":{"1min":0.54700000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89500000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.38300000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68799999999999994,"15min":0.66200000000000003},"min":{"1min":0.54300000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65600000000000003,"15min":0.63200000000000001},"min":{"1min":0.51700000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86899999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.47699999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.69999999999999996,"15min":0.66600000000000004},"min":{"1min":0.58999999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97299999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69099999999999995,"15min":0.67700000000000005},"min":{"1min":0.58099999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.64500000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69199999999999995,"15min":0.66800000000000004},"min":{"1min":0.55200000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":0.995,"15min":0.995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.72999999999999998,"15min":0.71399999999999997},"min":{"1min":0.66300000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.92600000000000005,"5min":1.032,"15min":1.032},"last":0.68200000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66700000000000004,"15min":0.68500000000000005},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.505}]},{"osd":5,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.64700000000000002,"15min":0.67000000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.73699999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.628},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.89700000000000002,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.75600000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.75800000000000001,"15min":0.78300000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95299999999999996,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.74199999999999999,"15min":0.76000000000000001},"min":{"1min":0.48299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95899999999999996,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.66300000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542191,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297880,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":532480,"data_stored":221055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.68000000000000005},"min":{"1min":0.57599999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84199999999999997,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.57199999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86399999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.76600000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.70399999999999996,"15min":0.68200000000000005},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94099999999999995,"5min":1.111,"15min":1.111},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91100000000000003,"5min":3.444,"15min":3.444},"last":0.96099999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.83299999999999996,"15min":0.85799999999999998},"min":{"1min":0.67100000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.878,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.84199999999999997,"15min":0.86599999999999999},"min":{"1min":0.65800000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97899999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":0.97799999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72699999999999998,"15min":0.71899999999999997},"min":{"1min":0.60899999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.86899999999999999,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.87},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.67400000000000004,"15min":0.64500000000000002},"min":{"1min":0.63300000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88800000000000001,"5min":1.087,"15min":1.087},"last":0.92400000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.624,"15min":0.61899999999999999},"min":{"1min":0.42999999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89800000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.52900000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81499999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.54500000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.52100000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78200000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.52800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.89000000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72499999999999998,"15min":0.73499999999999999},"min":{"1min":0.55800000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80500000000000005,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.71299999999999997,"15min":0.71899999999999997},"min":{"1min":0.54900000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.78900000000000003,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.80100000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542190,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297860,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":516096,"data_stored":215407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.56699999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88800000000000001,"5min":1.022,"15min":1.022},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68799999999999994,"15min":0.68100000000000005},"min":{"1min":0.58699999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.879,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60299999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.56299999999999994,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98399999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.67700000000000005,"15min":0.66100000000000003},"min":{"1min":0.57499999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90300000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.57599999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.61199999999999999,"5min":0.497,"15min":0.497},"max":{"1min":0.93100000000000005,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.75700000000000001,"15min":0.78500000000000003},"min":{"1min":0.59599999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91100000000000003,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":0.54900000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.63100000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88300000000000001,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.80900000000000005,"15min":0.84399999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96199999999999997,"5min":3.665,"15min":3.665},"last":0.74099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.62,"15min":0.63900000000000001},"min":{"1min":0.44500000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.752,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.66700000000000004},"min":{"1min":0.47899999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.76400000000000001,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.76100000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66900000000000004,"15min":0.68300000000000005},"min":{"1min":0.48899999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80900000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68100000000000005,"15min":0.69599999999999995},"min":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84899999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63600000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72699999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.53700000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93000000000000005,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.80900000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542190,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297880,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":532480,"data_stored":221055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67700000000000005,"15min":0.69199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.753,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.879},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.441,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.85699999999999998,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.84699999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81100000000000005,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.68000000000000005,"15min":0.67400000000000004},"min":{"1min":0.46100000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.88,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.82699999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76000000000000001,"15min":0.75800000000000001},"min":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.53300000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.75900000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90800000000000003,"5min":1.272,"15min":1.272},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.93400000000000005,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.92300000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.61599999999999999,"15min":0.65400000000000003},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68899999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.627,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73799999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.47399999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65000000000000002,"15min":0.66300000000000003},"min":{"1min":0.44400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.81999999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.69699999999999995,"15min":0.73099999999999998},"min":{"1min":0.45900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75700000000000001,"5min":1.018,"15min":1.018},"last":0.65600000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69499999999999995,"15min":0.70699999999999996},"min":{"1min":0.51400000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82199999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.51400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88500000000000001,"5min":1.004,"15min":1.004},"last":0.59999999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542190,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302024,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":516096,"data_stored":215407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66700000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45200000000000001,"15min":0.44},"min":{"1min":0.36699999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70399999999999996,"5min":0.755,"15min":0.755},"last":0.439}]},{"osd":1,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.59699999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.67500000000000004,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.60199999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.54200000000000004},"min":{"1min":0.38900000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73299999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.51200000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.76200000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.56100000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.79800000000000004,"15min":0.79600000000000004},"min":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0409999999999999,"5min":1.173,"15min":1.173},"last":0.83299999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96599999999999997,"5min":1.075,"15min":1.075},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.56299999999999994,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0189999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.85699999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.67400000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.03,"5min":1.179,"15min":1.179},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.78700000000000003,"15min":0.78600000000000003},"min":{"1min":0.53700000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0760000000000001,"5min":1.218,"15min":1.218},"last":0.84899999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79400000000000004,"15min":0.79100000000000004},"min":{"1min":0.58899999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.036,"5min":1.145,"15min":1.145},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.78900000000000003,"15min":0.78200000000000003},"min":{"1min":0.63800000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.0860000000000001,"5min":1.202,"15min":1.202},"last":0.97999999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":516096,"data_stored":215407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.34599999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.86799999999999999,"5min":1.855,"15min":1.855},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65100000000000002,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.44600000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.53400000000000003,"15min":0.55400000000000005},"min":{"1min":0.34899999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.60699999999999998,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.379},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.56599999999999995,"15min":0.54000000000000004},"min":{"1min":0.39900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90300000000000002,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.622}]},{"osd":3,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.36199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81200000000000006,"5min":2.302,"15min":2.302},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64900000000000002,"15min":0.63300000000000001},"min":{"1min":0.48899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93799999999999994,"5min":1.819,"15min":1.819},"last":0.57199999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79700000000000004,"15min":0.76700000000000002},"min":{"1min":0.61499999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0489999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84199999999999997,"15min":0.84899999999999998},"min":{"1min":0.61299999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0920000000000001,"5min":1.732,"15min":1.732},"last":0.64200000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.82399999999999995,"15min":0.82599999999999996},"min":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1919999999999999,"5min":1.474,"15min":1.474},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.83399999999999996,"15min":0.84399999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.075,"5min":2.198,"15min":2.198},"last":0.68000000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.88600000000000001,"15min":0.90200000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.224,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.84599999999999997,"15min":0.83199999999999996},"min":{"1min":0.67100000000000004,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1659999999999999,"5min":1.571,"15min":1.571},"last":0.66900000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.86299999999999999,"15min":0.86899999999999999},"min":{"1min":0.59099999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.089,"5min":1.675,"15min":1.675},"last":0.746},{"interface":"front","average":{"1min":0.874,"5min":0.92500000000000004,"15min":0.94299999999999995},"min":{"1min":0.64800000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.125,"5min":2.234,"15min":2.234},"last":0.65600000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542190,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302020,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":516096,"data_stored":215407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.501,"15min":0.53300000000000003},"min":{"1min":0.31,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55900000000000005,"5min":1.968,"15min":1.968},"last":0.503},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.5,"15min":0.497},"min":{"1min":0.34599999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.67300000000000004,"5min":1.28,"15min":1.28},"last":0.36299999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.56999999999999995,"15min":0.60699999999999998},"min":{"1min":0.36199999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69299999999999995,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.433},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.69899999999999995,"15min":0.753},"min":{"1min":0.38200000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82199999999999995,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":0.54200000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.65600000000000003,"15min":0.69799999999999995},"min":{"1min":0.42599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73099999999999998,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":0.52200000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.85799999999999998,"15min":0.89600000000000002},"min":{"1min":0.53100000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96999999999999997,"5min":2.544,"15min":2.544},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.92900000000000005,"15min":0.98299999999999998},"min":{"1min":0.65000000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0569999999999999,"5min":3.6480000000000001,"15min":3.6480000000000001},"last":0.85499999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80400000000000005,"15min":0.83399999999999996},"min":{"1min":0.63500000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98699999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.84399999999999997,"15min":0.879},"min":{"1min":0.64600000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0800000000000001,"5min":2.4630000000000001,"15min":2.4630000000000001},"last":0.72199999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.88200000000000001,"15min":0.93600000000000005},"min":{"1min":0.66400000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.997,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.85099999999999998,"15min":0.88500000000000001},"min":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.94999999999999996,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":0.749}]},{"osd":7,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.86699999999999999,"15min":0.89800000000000002},"min":{"1min":0.65600000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.04,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.88300000000000001,"15min":0.92100000000000004},"min":{"1min":0.68000000000000005,"5min":0.502,"15min":0.502},"max":{"1min":1.024,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.91300000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542190,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1110016,"data_stored":805775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.46500000000000002,"15min":0.48899999999999999},"min":{"1min":0.33100000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.44900000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.377,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.89500000000000002,"5min":2.254,"15min":2.254},"last":0.46600000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.57799999999999996,"15min":0.60399999999999998},"min":{"1min":0.41499999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63400000000000001,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63,"15min":0.65200000000000002},"min":{"1min":0.48499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.748,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.63300000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54400000000000004,"15min":0.56000000000000005},"min":{"1min":0.35799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.66200000000000003,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.498},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63900000000000001,"15min":0.64800000000000002},"min":{"1min":0.48699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82699999999999996,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":0.64700000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.754,"15min":0.749},"min":{"1min":0.60999999999999999,"5min":0.498,"15min":0.498},"max":{"1min":0.90400000000000003,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58899999999999997,"5min":0.432,"15min":0.432},"max":{"1min":0.99399999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.94199999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.69199999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":0.879,"5min":1.321,"15min":1.321},"last":0.999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.65100000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0289999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.0580000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.60099999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.90200000000000002,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.61899999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.89400000000000002,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.0760000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82999999999999996,"15min":0.84199999999999997},"min":{"1min":0.61399999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.99299999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.81799999999999995,"15min":0.82899999999999996},"min":{"1min":0.58299999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96099999999999997,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.77800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:06.597 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:06.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.749+0000 7f1a61800640 1 Processor -- start 2024-08-17T02:27:06.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.749+0000 7f1a61800640 1 -- start start 2024-08-17T02:27:06.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.750+0000 7f1a61800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a5c0afca0 0x7f1a5c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.750+0000 7f1a61800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1a5c1590b0 0x7f1a5c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.751+0000 7f1a61800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5c15a4e0 con 0x7f1a5c0acf10 2024-08-17T02:27:06.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.751+0000 7f1a61800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5c0b0980 con 0x7f1a5c0afca0 2024-08-17T02:27:06.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.751+0000 7f1a61800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5c0c92b0 con 0x7f1a5c1590b0 2024-08-17T02:27:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.751+0000 7f1a5aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a5c0afca0 0x7f1a5c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.751+0000 7f1a5a000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1a5c0acf10 0x7f1a5c1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39198/0 (socket says 172.21.15.5:39198) 2024-08-17T02:27:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.751+0000 7f1a5aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a5c0afca0 0x7f1a5c0b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46056/0 (socket says 172.21.15.5:46056) 2024-08-17T02:27:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.751+0000 7f1a5a000640 1 -- 172.21.15.5:0/3473762643 learned_addr learned my addr 172.21.15.5:0/3473762643 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.751+0000 7f1a5b400640 1 --2- 172.21.15.5:0/3473762643 >> v2:172.21.15.87:3300/0 conn(0x7f1a5c1590b0 0x7f1a5c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.751+0000 7f1a5aa00640 1 -- 172.21.15.5:0/3473762643 >> v2:172.21.15.87:3300/0 conn(0x7f1a5c1590b0 msgr2=0x7f1a5c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.751+0000 7f1a5aa00640 1 --2- 172.21.15.5:0/3473762643 >> v2:172.21.15.87:3300/0 conn(0x7f1a5c1590b0 0x7f1a5c159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.751+0000 7f1a5aa00640 1 -- 172.21.15.5:0/3473762643 >> v1:172.21.15.5:6789/0 conn(0x7f1a5c0acf10 legacy=0x7f1a5c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.751+0000 7f1a5aa00640 1 -- 172.21.15.5:0/3473762643 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c0ad480 con 0x7f1a5c0afca0 2024-08-17T02:27:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.751+0000 7f1a59600640 1 -- 172.21.15.5:0/3473762643 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179223467 0 0) 0x7f1a48001110 con 0x7f1a5c0acf10 2024-08-17T02:27:06.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.752+0000 7f1a5aa00640 1 --2- 172.21.15.5:0/3473762643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a5c0afca0 0x7f1a5c0b0070 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c0cb4a0 tx=0x7f1a4c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9151975cc26dea server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.753+0000 7f1a59600640 1 -- 172.21.15.5:0/3473762643 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c02adb0 con 0x7f1a5c0afca0 2024-08-17T02:27:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.753+0000 7f1a59600640 1 -- 172.21.15.5:0/3473762643 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c032440 con 0x7f1a5c0afca0 2024-08-17T02:27:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.753+0000 7f1a59600640 1 -- 172.21.15.5:0/3473762643 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c0327e0 con 0x7f1a5c0afca0 2024-08-17T02:27:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.753+0000 7f1a61800640 1 -- 172.21.15.5:0/3473762643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a5c0afca0 msgr2=0x7f1a5c0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.753+0000 7f1a61800640 1 --2- 172.21.15.5:0/3473762643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a5c0afca0 0x7f1a5c0b0070 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c0cb4a0 tx=0x7f1a4c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.753+0000 7f1a61800640 1 -- 172.21.15.5:0/3473762643 shutdown_connections 2024-08-17T02:27:06.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.753+0000 7f1a61800640 1 --2- 172.21.15.5:0/3473762643 >> v2:172.21.15.87:3300/0 conn(0x7f1a5c1590b0 0x7f1a5c159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.753+0000 7f1a61800640 1 --2- 172.21.15.5:0/3473762643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a5c0afca0 0x7f1a5c0b0070 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.753+0000 7f1a61800640 1 -- 172.21.15.5:0/3473762643 >> 172.21.15.5:0/3473762643 conn(0x7f1a5c066e60 msgr2=0x7f1a5c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.753+0000 7f1a61800640 1 -- 172.21.15.5:0/3473762643 shutdown_connections 2024-08-17T02:27:06.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.753+0000 7f1a61800640 1 -- 172.21.15.5:0/3473762643 wait complete. 2024-08-17T02:27:06.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.755+0000 7f1a61800640 1 Processor -- start 2024-08-17T02:27:06.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.755+0000 7f1a61800640 1 -- start start 2024-08-17T02:27:06.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.756+0000 7f1a61800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a5c0acf10 0x7f1a5c13dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.756+0000 7f1a61800640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a5c0afca0 0x7f1a5c156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.756+0000 7f1a61800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a5c1590b0 0x7f1a5c15b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.756+0000 7f1a61800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c0c5330 con 0x7f1a5c0acf10 2024-08-17T02:27:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.756+0000 7f1a61800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c0c5b90 con 0x7f1a5c1590b0 2024-08-17T02:27:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.756+0000 7f1a61800640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c06b480 con 0x7f1a5c0afca0 2024-08-17T02:27:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.756+0000 7f1a5aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a5c0acf10 0x7f1a5c13dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.756+0000 7f1a5aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a5c0acf10 0x7f1a5c13dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46064/0 (socket says 172.21.15.5:46064) 2024-08-17T02:27:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.756+0000 7f1a5aa00640 1 -- 172.21.15.5:0/2444703375 learned_addr learned my addr 172.21.15.5:0/2444703375 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.756+0000 7f1a5b400640 1 --2- 172.21.15.5:0/2444703375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a5c1590b0 0x7f1a5c15b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.756+0000 7f1a5a000640 1 --2- 172.21.15.5:0/2444703375 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a5c0afca0 0x7f1a5c156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.756+0000 7f1a5aa00640 1 -- 172.21.15.5:0/2444703375 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a5c0afca0 msgr2=0x7f1a5c156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.756+0000 7f1a5aa00640 1 --2- 172.21.15.5:0/2444703375 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a5c0afca0 0x7f1a5c156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.756+0000 7f1a5aa00640 1 -- 172.21.15.5:0/2444703375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a5c1590b0 msgr2=0x7f1a5c15b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.756+0000 7f1a5aa00640 1 --2- 172.21.15.5:0/2444703375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a5c1590b0 0x7f1a5c15b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.756+0000 7f1a5aa00640 1 -- 172.21.15.5:0/2444703375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c009390 con 0x7f1a5c0acf10 2024-08-17T02:27:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.756+0000 7f1a5b400640 1 --2- 172.21.15.5:0/2444703375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a5c1590b0 0x7f1a5c15b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.756+0000 7f1a5a000640 1 --2- 172.21.15.5:0/2444703375 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a5c0afca0 0x7f1a5c156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.757+0000 7f1a5aa00640 1 --2- 172.21.15.5:0/2444703375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a5c0acf10 0x7f1a5c13dda0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009360 tx=0x7f1a4c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.757+0000 7f1a52000640 1 -- 172.21.15.5:0/2444703375 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c031de0 con 0x7f1a5c0acf10 2024-08-17T02:27:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.757+0000 7f1a52000640 1 -- 172.21.15.5:0/2444703375 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c03d420 con 0x7f1a5c0acf10 2024-08-17T02:27:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.757+0000 7f1a52000640 1 -- 172.21.15.5:0/2444703375 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c03d7e0 con 0x7f1a5c0acf10 2024-08-17T02:27:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.757+0000 7f1a61800640 1 -- 172.21.15.5:0/2444703375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5c0c5540 con 0x7f1a5c0acf10 2024-08-17T02:27:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.757+0000 7f1a61800640 1 -- 172.21.15.5:0/2444703375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5c13e2e0 con 0x7f1a5c0acf10 2024-08-17T02:27:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.758+0000 7f1a61800640 1 -- 172.21.15.5:0/2444703375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5c063fb0 con 0x7f1a5c0acf10 2024-08-17T02:27:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.759+0000 7f1a52000640 1 -- 172.21.15.5:0/2444703375 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1a4c039040 con 0x7f1a5c0acf10 2024-08-17T02:27:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.760+0000 7f1a52000640 1 --2- 172.21.15.5:0/2444703375 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1a3c065150 0x7f1a3c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.760+0000 7f1a52000640 1 -- 172.21.15.5:0/2444703375 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f1a4c0a2270 con 0x7f1a5c0acf10 2024-08-17T02:27:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.761+0000 7f1a5a000640 1 --2- 172.21.15.5:0/2444703375 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1a3c065150 0x7f1a3c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.761+0000 7f1a5a000640 1 --2- 172.21.15.5:0/2444703375 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1a3c065150 0x7f1a3c067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1a48007fd0 tx=0x7f1a48009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.764+0000 7f1a52000640 1 -- 172.21.15.5:0/2444703375 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1a4c070530 con 0x7f1a5c0acf10 2024-08-17T02:27:06.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.947+0000 7f1a61800640 1 -- 172.21.15.5:0/2444703375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a5c067b70 con 0x7f1a5c0acf10 2024-08-17T02:27:06.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.948+0000 7f1a52000640 1 -- 172.21.15.5:0/2444703375 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+12295 (secure 0 0 0) 0x7f1a4c073b50 con 0x7f1a5c0acf10 2024-08-17T02:27:06.949 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:27:06.949 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":45,"fsid":"9411fcb4-b308-4a27-a404-b7a846d24e75","created":"2024-08-17T02:23:16.117113+0000","modified":"2024-08-17T02:27:02.073999+0000","last_up_change":"2024-08-17T02:23:27.519369+0000","last_in_change":"2024-08-17T02:23:19.320342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:23:28.773677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"681b5b50-2b3d-4686-b47b-27e725c8dc26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37117},{"type":"v1","addr":"172.21.15.5:6819","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":37117},{"type":"v1","addr":"172.21.15.5:6823","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37117},{"type":"v1","addr":"172.21.15.5:6831","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37117},{"type":"v1","addr":"172.21.15.5:6829","nonce":37117}]},"public_addr":"172.21.15.5:6819/37117","cluster_addr":"172.21.15.5:6823/37117","heartbeat_back_addr":"172.21.15.5:6831/37117","heartbeat_front_addr":"172.21.15.5:6829/37117","state":["exists","up"]},{"osd":1,"uuid":"284594a3-765f-4546-ac0e-06e2eb2b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37123},{"type":"v1","addr":"172.21.15.5:6809","nonce":37123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":37123},{"type":"v1","addr":"172.21.15.5:6811","nonce":37123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":37123},{"type":"v1","addr":"172.21.15.5:6815","nonce":37123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37123},{"type":"v1","addr":"172.21.15.5:6813","nonce":37123}]},"public_addr":"172.21.15.5:6809/37123","cluster_addr":"172.21.15.5:6811/37123","heartbeat_back_addr":"172.21.15.5:6815/37123","heartbeat_front_addr":"172.21.15.5:6813/37123","state":["exists","up"]},{"osd":2,"uuid":"3dbfdda7-1a5c-4f0b-ad83-bcd3707a3326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37114},{"type":"v1","addr":"172.21.15.5:6801","nonce":37114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37114},{"type":"v1","addr":"172.21.15.5:6803","nonce":37114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37114},{"type":"v1","addr":"172.21.15.5:6807","nonce":37114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37114},{"type":"v1","addr":"172.21.15.5:6805","nonce":37114}]},"public_addr":"172.21.15.5:6801/37114","cluster_addr":"172.21.15.5:6803/37114","heartbeat_back_addr":"172.21.15.5:6807/37114","heartbeat_front_addr":"172.21.15.5:6805/37114","state":["exists","up"]},{"osd":3,"uuid":"f85e35d3-ad8e-47fc-be7e-91ff326e2c65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37127},{"type":"v1","addr":"172.21.15.5:6818","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37127},{"type":"v1","addr":"172.21.15.5:6822","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":37127},{"type":"v1","addr":"172.21.15.5:6828","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37127},{"type":"v1","addr":"172.21.15.5:6825","nonce":37127}]},"public_addr":"172.21.15.5:6818/37127","cluster_addr":"172.21.15.5:6822/37127","heartbeat_back_addr":"172.21.15.5:6828/37127","heartbeat_front_addr":"172.21.15.5:6825/37127","state":["exists","up"]},{"osd":4,"uuid":"21451c33-466e-4b5e-a702-c5885e74efdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":37668},{"type":"v1","addr":"172.21.15.87:6825","nonce":37668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":37668},{"type":"v1","addr":"172.21.15.87:6827","nonce":37668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":37668},{"type":"v1","addr":"172.21.15.87:6831","nonce":37668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":37668},{"type":"v1","addr":"172.21.15.87:6829","nonce":37668}]},"public_addr":"172.21.15.87:6825/37668","cluster_addr":"172.21.15.87:6827/37668","heartbeat_back_addr":"172.21.15.87:6831/37668","heartbeat_front_addr":"172.21.15.87:6829/37668","state":["exists","up"]},{"osd":5,"uuid":"947f783e-9840-4139-9861-5d4bafdf0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":37666},{"type":"v1","addr":"172.21.15.87:6801","nonce":37666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":37666},{"type":"v1","addr":"172.21.15.87:6803","nonce":37666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":37666},{"type":"v1","addr":"172.21.15.87:6807","nonce":37666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":37666},{"type":"v1","addr":"172.21.15.87:6805","nonce":37666}]},"public_addr":"172.21.15.87:6801/37666","cluster_addr":"172.21.15.87:6803/37666","heartbeat_back_addr":"172.21.15.87:6807/37666","heartbeat_front_addr":"172.21.15.87:6805/37666","state":["exists","up"]},{"osd":6,"uuid":"40e2bc2d-f473-41bc-a9c5-e27fce4befc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":37667},{"type":"v1","addr":"172.21.15.87:6809","nonce":37667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":37667},{"type":"v1","addr":"172.21.15.87:6811","nonce":37667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":37667},{"type":"v1","addr":"172.21.15.87:6815","nonce":37667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":37667},{"type":"v1","addr":"172.21.15.87:6813","nonce":37667}]},"public_addr":"172.21.15.87:6809/37667","cluster_addr":"172.21.15.87:6811/37667","heartbeat_back_addr":"172.21.15.87:6815/37667","heartbeat_front_addr":"172.21.15.87:6813/37667","state":["exists","up"]},{"osd":7,"uuid":"8dde8102-4556-4322-9521-15076220af61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":37679},{"type":"v1","addr":"172.21.15.87:6817","nonce":37679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":37679},{"type":"v1","addr":"172.21.15.87:6819","nonce":37679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":37679},{"type":"v1","addr":"172.21.15.87:6823","nonce":37679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":37679},{"type":"v1","addr":"172.21.15.87:6821","nonce":37679}]},"public_addr":"172.21.15.87:6817/37679","cluster_addr":"172.21.15.87:6819/37679","heartbeat_back_addr":"172.21.15.87:6823/37679","heartbeat_front_addr":"172.21.15.87:6821/37679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.661003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.596370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.488067+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.634828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.752938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.605573+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.656587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:23:24.637772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:6835/1739323622":"2024-08-18T02:26:58.917782+0000","172.21.15.87:6834/1739323622":"2024-08-18T02:26:58.917782+0000","172.21.15.5:6836/1918940200":"2024-08-18T02:26:51.946222+0000","172.21.15.5:6835/1918940200":"2024-08-18T02:26:51.946222+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:06.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.951+0000 7f1a61800640 1 -- 172.21.15.5:0/2444703375 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1a3c065150 msgr2=0x7f1a3c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.951+0000 7f1a61800640 1 --2- 172.21.15.5:0/2444703375 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1a3c065150 0x7f1a3c067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1a48007fd0 tx=0x7f1a48009040 comp rx=0 tx=0).stop 2024-08-17T02:27:06.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.951+0000 7f1a61800640 1 -- 172.21.15.5:0/2444703375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a5c0acf10 msgr2=0x7f1a5c13dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.951+0000 7f1a61800640 1 --2- 172.21.15.5:0/2444703375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a5c0acf10 0x7f1a5c13dda0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009360 tx=0x7f1a4c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:06.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.951+0000 7f1a61800640 1 -- 172.21.15.5:0/2444703375 shutdown_connections 2024-08-17T02:27:06.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.951+0000 7f1a61800640 1 --2- 172.21.15.5:0/2444703375 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1a3c065150 0x7f1a3c067600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.951+0000 7f1a61800640 1 --2- 172.21.15.5:0/2444703375 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a5c0afca0 0x7f1a5c156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.951+0000 7f1a61800640 1 --2- 172.21.15.5:0/2444703375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a5c1590b0 0x7f1a5c15b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.951+0000 7f1a61800640 1 --2- 172.21.15.5:0/2444703375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a5c0acf10 0x7f1a5c13dda0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.951+0000 7f1a61800640 1 -- 172.21.15.5:0/2444703375 >> 172.21.15.5:0/2444703375 conn(0x7f1a5c066e60 msgr2=0x7f1a5c153f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.951+0000 7f1a61800640 1 -- 172.21.15.5:0/2444703375 shutdown_connections 2024-08-17T02:27:06.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:06.951+0000 7f1a61800640 1 -- 172.21.15.5:0/2444703375 wait complete. 2024-08-17T02:27:07.967 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:27:07.967 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:27:08.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.135+0000 7fe261c00640 1 Processor -- start 2024-08-17T02:27:08.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.136+0000 7fe261c00640 1 -- start start 2024-08-17T02:27:08.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.137+0000 7fe261c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe25c0cae20 0x7fe25c0adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.137+0000 7fe261c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe25c0ca060 con 0x7fe25c0ae6e0 2024-08-17T02:27:08.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.137+0000 7fe261c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe25c0ca340 con 0x7fe25c0ad780 2024-08-17T02:27:08.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.137+0000 7fe261c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c0ca620 con 0x7fe25c0cae20 2024-08-17T02:27:08.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.137+0000 7fe261200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe25c0ae6e0 0x7fe25c157100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39208/0 (socket says 172.21.15.5:39208) 2024-08-17T02:27:08.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.137+0000 7fe261200640 1 -- 172.21.15.5:0/3414611699 learned_addr learned my addr 172.21.15.5:0/3414611699 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:08.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.137+0000 7fe253e00640 1 --2- 172.21.15.5:0/3414611699 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe25c0cae20 0x7fe25c0adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.138+0000 7fe25b400640 1 -- 172.21.15.5:0/3414611699 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516728178 0 0) 0x7fe25c0ca060 con 0x7fe25c0ae6e0 2024-08-17T02:27:08.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.138+0000 7fe25b400640 1 -- 172.21.15.5:0/3414611699 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2400034e0 con 0x7fe25c0ae6e0 2024-08-17T02:27:08.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.138+0000 7fe25b400640 1 -- 172.21.15.5:0/3414611699 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581792985 0 0) 0x7fe25c0ca340 con 0x7fe25c0ad780 2024-08-17T02:27:08.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.138+0000 7fe25b400640 1 -- 172.21.15.5:0/3414611699 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe25c0ca060 con 0x7fe25c0ad780 2024-08-17T02:27:08.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.138+0000 7fe253e00640 1 -- 172.21.15.5:0/3414611699 >> v1:172.21.15.87:6789/0 conn(0x7fe25c0ad780 legacy=0x7fe25c0af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.138+0000 7fe253e00640 1 -- 172.21.15.5:0/3414611699 >> v1:172.21.15.5:6789/0 conn(0x7fe25c0ae6e0 legacy=0x7fe25c157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.138+0000 7fe253e00640 1 -- 172.21.15.5:0/3414611699 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c0ca900 con 0x7fe25c0cae20 2024-08-17T02:27:08.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.139+0000 7fe253e00640 1 --2- 172.21.15.5:0/3414611699 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe25c0cae20 0x7fe25c0adb50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe244009880 tx=0x7fe2440090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=739c85d883be38ea server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.139+0000 7fe25b400640 1 -- 172.21.15.5:0/3414611699 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24402ae10 con 0x7fe25c0cae20 2024-08-17T02:27:08.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.139+0000 7fe25b400640 1 -- 172.21.15.5:0/3414611699 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe244032440 con 0x7fe25c0cae20 2024-08-17T02:27:08.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.139+0000 7fe25b400640 1 -- 172.21.15.5:0/3414611699 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2440327c0 con 0x7fe25c0cae20 2024-08-17T02:27:08.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.140+0000 7fe261c00640 1 -- 172.21.15.5:0/3414611699 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe25c0cae20 msgr2=0x7fe25c0adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.140+0000 7fe261c00640 1 --2- 172.21.15.5:0/3414611699 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe25c0cae20 0x7fe25c0adb50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe244009880 tx=0x7fe2440090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.140+0000 7fe261c00640 1 -- 172.21.15.5:0/3414611699 shutdown_connections 2024-08-17T02:27:08.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.140+0000 7fe261c00640 1 --2- 172.21.15.5:0/3414611699 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe25c0cae20 0x7fe25c0adb50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.140+0000 7fe261c00640 1 -- 172.21.15.5:0/3414611699 >> 172.21.15.5:0/3414611699 conn(0x7fe25c066e60 msgr2=0x7fe25c067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.140+0000 7fe261c00640 1 -- 172.21.15.5:0/3414611699 shutdown_connections 2024-08-17T02:27:08.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.140+0000 7fe261c00640 1 -- 172.21.15.5:0/3414611699 wait complete. 2024-08-17T02:27:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.141+0000 7fe261c00640 1 Processor -- start 2024-08-17T02:27:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.142+0000 7fe261c00640 1 -- start start 2024-08-17T02:27:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.143+0000 7fe261c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe25c0ad780 0x7fe25c152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.143+0000 7fe261c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe25c0ae6e0 0x7fe25c0a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.143+0000 7fe261c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe25c0cae20 0x7fe25c0a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.143+0000 7fe261c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c158080 con 0x7fe25c0ad780 2024-08-17T02:27:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.143+0000 7fe261c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c169940 con 0x7fe25c0cae20 2024-08-17T02:27:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.143+0000 7fe261c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c157a30 con 0x7fe25c0ae6e0 2024-08-17T02:27:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.143+0000 7fe25be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe25c0ad780 0x7fe25c152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.143+0000 7fe25be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe25c0ad780 0x7fe25c152850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46072/0 (socket says 172.21.15.5:46072) 2024-08-17T02:27:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.143+0000 7fe25be00640 1 -- 172.21.15.5:0/3708723280 learned_addr learned my addr 172.21.15.5:0/3708723280 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.143+0000 7fe253e00640 1 --2- 172.21.15.5:0/3708723280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe25c0ae6e0 0x7fe25c0a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.143+0000 7fe261200640 1 --2- 172.21.15.5:0/3708723280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe25c0cae20 0x7fe25c0a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.143+0000 7fe25be00640 1 -- 172.21.15.5:0/3708723280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe25c0ae6e0 msgr2=0x7fe25c0a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.143+0000 7fe25be00640 1 --2- 172.21.15.5:0/3708723280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe25c0ae6e0 0x7fe25c0a98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.143+0000 7fe25be00640 1 -- 172.21.15.5:0/3708723280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe25c0cae20 msgr2=0x7fe25c0a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.143+0000 7fe25be00640 1 --2- 172.21.15.5:0/3708723280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe25c0cae20 0x7fe25c0a9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.143+0000 7fe25be00640 1 -- 172.21.15.5:0/3708723280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe244009390 con 0x7fe25c0ad780 2024-08-17T02:27:08.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.144+0000 7fe25be00640 1 --2- 172.21.15.5:0/3708723280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe25c0ad780 0x7fe25c152850 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00c590 tx=0x7fe24c007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.144+0000 7fe253400640 1 -- 172.21.15.5:0/3708723280 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c012630 con 0x7fe25c0ad780 2024-08-17T02:27:08.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.144+0000 7fe253400640 1 -- 172.21.15.5:0/3708723280 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24c0127b0 con 0x7fe25c0ad780 2024-08-17T02:27:08.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.144+0000 7fe253400640 1 -- 172.21.15.5:0/3708723280 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c012bb0 con 0x7fe25c0ad780 2024-08-17T02:27:08.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.144+0000 7fe261c00640 1 -- 172.21.15.5:0/3708723280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25c157d10 con 0x7fe25c0ad780 2024-08-17T02:27:08.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.144+0000 7fe261c00640 1 -- 172.21.15.5:0/3708723280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25c158510 con 0x7fe25c0ad780 2024-08-17T02:27:08.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.145+0000 7fe261c00640 1 -- 172.21.15.5:0/3708723280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe25c157890 con 0x7fe25c0ad780 2024-08-17T02:27:08.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.146+0000 7fe253400640 1 -- 172.21.15.5:0/3708723280 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe24c01a3b0 con 0x7fe25c0ad780 2024-08-17T02:27:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.147+0000 7fe253400640 1 --2- 172.21.15.5:0/3708723280 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe238065150 0x7fe238067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.147+0000 7fe253400640 1 -- 172.21.15.5:0/3708723280 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe24c081ff0 con 0x7fe25c0ad780 2024-08-17T02:27:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.147+0000 7fe253400640 1 --2- 172.21.15.5:0/3708723280 >> [v2:172.21.15.5:6817/37117,v1:172.21.15.5:6819/37117] conn(0x7fe23806b040 0x7fe23806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.147+0000 7fe253400640 1 -- 172.21.15.5:0/3708723280 --> [v2:172.21.15.5:6817/37117,v1:172.21.15.5:6819/37117] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe23806db00 con 0x7fe23806b040 2024-08-17T02:27:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.147+0000 7fe253400640 1 -- 172.21.15.5:0/3708723280 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe24c087520 con 0x7fe25c0ad780 2024-08-17T02:27:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.147+0000 7fe253e00640 1 --2- 172.21.15.5:0/3708723280 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe238065150 0x7fe238067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.147+0000 7fe261200640 1 --2- 172.21.15.5:0/3708723280 >> [v2:172.21.15.5:6817/37117,v1:172.21.15.5:6819/37117] conn(0x7fe23806b040 0x7fe23806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.148+0000 7fe253e00640 1 --2- 172.21.15.5:0/3708723280 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe238065150 0x7fe238067600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe244034000 tx=0x7fe244032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.148+0000 7fe261200640 1 --2- 172.21.15.5:0/3708723280 >> [v2:172.21.15.5:6817/37117,v1:172.21.15.5:6819/37117] conn(0x7fe23806b040 0x7fe23806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.149+0000 7fe253400640 1 -- 172.21.15.5:0/3708723280 <== osd.0 v2:172.21.15.5:6817/37117 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe23806db00 con 0x7fe23806b040 2024-08-17T02:27:08.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.161+0000 7fe261c00640 1 -- 172.21.15.5:0/3708723280 --> [v2:172.21.15.5:6817/37117,v1:172.21.15.5:6819/37117] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe25c063f10 con 0x7fe23806b040 2024-08-17T02:27:08.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.162+0000 7fe253400640 1 -- 172.21.15.5:0/3708723280 <== osd.0 v2:172.21.15.5:6817/37117 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe25c063f10 con 0x7fe23806b040 2024-08-17T02:27:08.163 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:27:08.163 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:27:08.163 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:27:08.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.162+0000 7fe261c00640 1 -- 172.21.15.5:0/3708723280 >> [v2:172.21.15.5:6817/37117,v1:172.21.15.5:6819/37117] conn(0x7fe23806b040 msgr2=0x7fe23806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.162+0000 7fe261c00640 1 --2- 172.21.15.5:0/3708723280 >> [v2:172.21.15.5:6817/37117,v1:172.21.15.5:6819/37117] conn(0x7fe23806b040 0x7fe23806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.162+0000 7fe261c00640 1 -- 172.21.15.5:0/3708723280 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe238065150 msgr2=0x7fe238067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.162+0000 7fe261c00640 1 --2- 172.21.15.5:0/3708723280 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe238065150 0x7fe238067600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe244034000 tx=0x7fe244032000 comp rx=0 tx=0).stop 2024-08-17T02:27:08.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.162+0000 7fe261c00640 1 -- 172.21.15.5:0/3708723280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe25c0ad780 msgr2=0x7fe25c152850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.162+0000 7fe261c00640 1 --2- 172.21.15.5:0/3708723280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe25c0ad780 0x7fe25c152850 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00c590 tx=0x7fe24c007d80 comp rx=0 tx=0).stop 2024-08-17T02:27:08.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.162+0000 7fe261200640 1 -- 172.21.15.5:0/3708723280 reap_dead start 2024-08-17T02:27:08.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.162+0000 7fe261c00640 1 -- 172.21.15.5:0/3708723280 shutdown_connections 2024-08-17T02:27:08.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.162+0000 7fe261c00640 1 -- 172.21.15.5:0/3708723280 >> 172.21.15.5:0/3708723280 conn(0x7fe25c066e60 msgr2=0x7fe25c0af570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.163+0000 7fe261c00640 1 -- 172.21.15.5:0/3708723280 shutdown_connections 2024-08-17T02:27:08.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.163+0000 7fe261c00640 1 -- 172.21.15.5:0/3708723280 wait complete. 2024-08-17T02:27:08.177 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:27:08.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.329+0000 7ff74de00640 1 Processor -- start 2024-08-17T02:27:08.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.329+0000 7ff74de00640 1 -- start start 2024-08-17T02:27:08.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.330+0000 7ff74de00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff7480aab40 0x7ff7480a9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.330+0000 7ff74de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff74815a4d0 0x7ff74815a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.330+0000 7ff74de00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7480a88e0 con 0x7ff748158bf0 2024-08-17T02:27:08.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.330+0000 7ff74de00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7480a9180 con 0x7ff74815a4d0 2024-08-17T02:27:08.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.330+0000 7ff74de00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74815a0e0 con 0x7ff7480aab40 2024-08-17T02:27:08.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.330+0000 7ff746a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff748158bf0 0x7ff7480aa430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39222/0 (socket says 172.21.15.5:39222) 2024-08-17T02:27:08.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.330+0000 7ff746a00640 1 -- 172.21.15.5:0/1303129270 learned_addr learned my addr 172.21.15.5:0/1303129270 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:08.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.330+0000 7ff747400640 1 --2- 172.21.15.5:0/1303129270 >> v2:172.21.15.5:3300/0 conn(0x7ff74815a4d0 0x7ff74815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.330+0000 7ff73fe00640 1 --2- 172.21.15.5:0/1303129270 >> v2:172.21.15.87:3300/0 conn(0x7ff7480aab40 0x7ff7480a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.331+0000 7ff746000640 1 -- 172.21.15.5:0/1303129270 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950354140 0 0) 0x7ff7480a88e0 con 0x7ff748158bf0 2024-08-17T02:27:08.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.331+0000 7ff746000640 1 -- 172.21.15.5:0/1303129270 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff72c0034e0 con 0x7ff748158bf0 2024-08-17T02:27:08.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.331+0000 7ff747400640 1 -- 172.21.15.5:0/1303129270 >> v2:172.21.15.87:3300/0 conn(0x7ff7480aab40 msgr2=0x7ff7480a9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.331+0000 7ff747400640 1 --2- 172.21.15.5:0/1303129270 >> v2:172.21.15.87:3300/0 conn(0x7ff7480aab40 0x7ff7480a9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.331+0000 7ff747400640 1 -- 172.21.15.5:0/1303129270 >> v1:172.21.15.5:6789/0 conn(0x7ff748158bf0 legacy=0x7ff7480aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.331+0000 7ff747400640 1 -- 172.21.15.5:0/1303129270 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7480a8b30 con 0x7ff74815a4d0 2024-08-17T02:27:08.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.332+0000 7ff747400640 1 --2- 172.21.15.5:0/1303129270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74815a4d0 0x7ff74815a900 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff7480aa110 tx=0x7ff740009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c96faa2c6097dd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.332+0000 7ff746000640 1 -- 172.21.15.5:0/1303129270 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff740007550 con 0x7ff74815a4d0 2024-08-17T02:27:08.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.332+0000 7ff746000640 1 -- 172.21.15.5:0/1303129270 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74002d050 con 0x7ff74815a4d0 2024-08-17T02:27:08.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.332+0000 7ff746000640 1 -- 172.21.15.5:0/1303129270 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff740007920 con 0x7ff74815a4d0 2024-08-17T02:27:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.333+0000 7ff74de00640 1 -- 172.21.15.5:0/1303129270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74815a4d0 msgr2=0x7ff74815a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.333+0000 7ff74de00640 1 --2- 172.21.15.5:0/1303129270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74815a4d0 0x7ff74815a900 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff7480aa110 tx=0x7ff740009780 comp rx=0 tx=0).stop 2024-08-17T02:27:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.333+0000 7ff74de00640 1 -- 172.21.15.5:0/1303129270 shutdown_connections 2024-08-17T02:27:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.333+0000 7ff74de00640 1 --2- 172.21.15.5:0/1303129270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74815a4d0 0x7ff74815a900 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.333+0000 7ff74de00640 1 --2- 172.21.15.5:0/1303129270 >> v2:172.21.15.87:3300/0 conn(0x7ff7480aab40 0x7ff7480a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.333+0000 7ff74de00640 1 -- 172.21.15.5:0/1303129270 >> 172.21.15.5:0/1303129270 conn(0x7ff748066e60 msgr2=0x7ff748067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.333+0000 7ff74de00640 1 -- 172.21.15.5:0/1303129270 shutdown_connections 2024-08-17T02:27:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.333+0000 7ff74de00640 1 -- 172.21.15.5:0/1303129270 wait complete. 2024-08-17T02:27:08.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.334+0000 7ff74de00640 1 Processor -- start 2024-08-17T02:27:08.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.334+0000 7ff74de00640 1 -- start start 2024-08-17T02:27:08.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.335+0000 7ff74de00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7480aab40 0x7ff74813da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.335+0000 7ff74de00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff748158bf0 0x7ff7480caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.335+0000 7ff74de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74815a4d0 0x7ff7480caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.335+0000 7ff74de00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7480b04c0 con 0x7ff74815a4d0 2024-08-17T02:27:08.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.335+0000 7ff74de00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7480cb530 con 0x7ff748158bf0 2024-08-17T02:27:08.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.335+0000 7ff74de00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7480c9630 con 0x7ff7480aab40 2024-08-17T02:27:08.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.336+0000 7ff747400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74815a4d0 0x7ff7480caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.336+0000 7ff747400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74815a4d0 0x7ff7480caff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46088/0 (socket says 172.21.15.5:46088) 2024-08-17T02:27:08.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.336+0000 7ff747400640 1 -- 172.21.15.5:0/3406013469 learned_addr learned my addr 172.21.15.5:0/3406013469 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:08.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.336+0000 7ff73fe00640 1 --2- 172.21.15.5:0/3406013469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff748158bf0 0x7ff7480caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.336+0000 7ff746a00640 1 --2- 172.21.15.5:0/3406013469 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7480aab40 0x7ff74813da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.336+0000 7ff747400640 1 -- 172.21.15.5:0/3406013469 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7480aab40 msgr2=0x7ff74813da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.336+0000 7ff747400640 1 --2- 172.21.15.5:0/3406013469 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7480aab40 0x7ff74813da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.336+0000 7ff747400640 1 -- 172.21.15.5:0/3406013469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff748158bf0 msgr2=0x7ff7480caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.336+0000 7ff747400640 1 --2- 172.21.15.5:0/3406013469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff748158bf0 0x7ff7480caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.336+0000 7ff747400640 1 -- 172.21.15.5:0/3406013469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff740009a20 con 0x7ff74815a4d0 2024-08-17T02:27:08.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.336+0000 7ff747400640 1 --2- 172.21.15.5:0/3406013469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74815a4d0 0x7ff7480caff0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff740009e90 tx=0x7ff740037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.337+0000 7ff73e000640 1 -- 172.21.15.5:0/3406013469 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff740031aa0 con 0x7ff74815a4d0 2024-08-17T02:27:08.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.337+0000 7ff73e000640 1 -- 172.21.15.5:0/3406013469 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff740031c00 con 0x7ff74815a4d0 2024-08-17T02:27:08.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.337+0000 7ff74de00640 1 -- 172.21.15.5:0/3406013469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7480afb90 con 0x7ff74815a4d0 2024-08-17T02:27:08.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.337+0000 7ff73e000640 1 -- 172.21.15.5:0/3406013469 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74003c420 con 0x7ff74815a4d0 2024-08-17T02:27:08.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.337+0000 7ff74de00640 1 -- 172.21.15.5:0/3406013469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7480b0150 con 0x7ff74815a4d0 2024-08-17T02:27:08.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.338+0000 7ff74de00640 1 -- 172.21.15.5:0/3406013469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7480b0630 con 0x7ff74815a4d0 2024-08-17T02:27:08.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.339+0000 7ff73e000640 1 -- 172.21.15.5:0/3406013469 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff74003c790 con 0x7ff74815a4d0 2024-08-17T02:27:08.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.340+0000 7ff73e000640 1 --2- 172.21.15.5:0/3406013469 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff724065150 0x7ff724067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.340+0000 7ff73e000640 1 -- 172.21.15.5:0/3406013469 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff7400a3900 con 0x7ff74815a4d0 2024-08-17T02:27:08.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.340+0000 7ff746a00640 1 --2- 172.21.15.5:0/3406013469 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff724065150 0x7ff724067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.341+0000 7ff746a00640 1 --2- 172.21.15.5:0/3406013469 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff724065150 0x7ff724067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff738005840 tx=0x7ff738009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.344+0000 7ff73e000640 1 -- 172.21.15.5:0/3406013469 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff740071c70 con 0x7ff74815a4d0 2024-08-17T02:27:08.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.525+0000 7ff74de00640 1 -- 172.21.15.5:0/3406013469 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff748063fb0 con 0x7ff724065150 2024-08-17T02:27:08.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.525+0000 7ff73e000640 1 -- 172.21.15.5:0/3406013469 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff748063fb0 con 0x7ff724065150 2024-08-17T02:27:08.526 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:27:08.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.527+0000 7ff74de00640 1 -- 172.21.15.5:0/3406013469 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff724065150 msgr2=0x7ff724067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.527+0000 7ff74de00640 1 --2- 172.21.15.5:0/3406013469 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff724065150 0x7ff724067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff738005840 tx=0x7ff738009040 comp rx=0 tx=0).stop 2024-08-17T02:27:08.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.527+0000 7ff74de00640 1 -- 172.21.15.5:0/3406013469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74815a4d0 msgr2=0x7ff7480caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.527+0000 7ff74de00640 1 --2- 172.21.15.5:0/3406013469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74815a4d0 0x7ff7480caff0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff740009e90 tx=0x7ff740037000 comp rx=0 tx=0).stop 2024-08-17T02:27:08.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.527+0000 7ff74de00640 1 -- 172.21.15.5:0/3406013469 shutdown_connections 2024-08-17T02:27:08.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.527+0000 7ff74de00640 1 --2- 172.21.15.5:0/3406013469 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff724065150 0x7ff724067600 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.527+0000 7ff74de00640 1 --2- 172.21.15.5:0/3406013469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74815a4d0 0x7ff7480caff0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.527+0000 7ff74de00640 1 --2- 172.21.15.5:0/3406013469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff748158bf0 0x7ff7480caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.527+0000 7ff74de00640 1 --2- 172.21.15.5:0/3406013469 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7480aab40 0x7ff74813da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.527+0000 7ff74de00640 1 -- 172.21.15.5:0/3406013469 >> 172.21.15.5:0/3406013469 conn(0x7ff748066e60 msgr2=0x7ff7480aa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.527+0000 7ff74de00640 1 -- 172.21.15.5:0/3406013469 shutdown_connections 2024-08-17T02:27:08.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.528+0000 7ff74de00640 1 -- 172.21.15.5:0/3406013469 wait complete. 2024-08-17T02:27:08.542 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:27:08.543 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:27:08.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.698+0000 7f3445e00640 1 Processor -- start 2024-08-17T02:27:08.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.698+0000 7f3445e00640 1 -- start start 2024-08-17T02:27:08.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.699+0000 7f3445e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3440156a90 0x7f34400ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.699+0000 7f3445e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f34400adba0 0x7f34400ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.699+0000 7f3445e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34400aed30 0x7f344006d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.699+0000 7f3445e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34400c9f80 con 0x7f3440156a90 2024-08-17T02:27:08.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.699+0000 7f3445e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34401582b0 con 0x7f34400adba0 2024-08-17T02:27:08.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.699+0000 7f3445e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34400ca110 con 0x7f34400aed30 2024-08-17T02:27:08.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.699+0000 7f343ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3440156a90 0x7f34400ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.700+0000 7f343ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3440156a90 0x7f34400ad660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46102/0 (socket says 172.21.15.5:46102) 2024-08-17T02:27:08.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.700+0000 7f343ea00640 1 -- 172.21.15.5:0/3337613165 learned_addr learned my addr 172.21.15.5:0/3337613165 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:08.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.700+0000 7f343f400640 1 --2- 172.21.15.5:0/3337613165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34400aed30 0x7f344006d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.700+0000 7f343e000640 1 --2- 172.21.15.5:0/3337613165 >> v2:172.21.15.87:3300/0 conn(0x7f34400adba0 0x7f34400ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.700+0000 7f343ea00640 1 -- 172.21.15.5:0/3337613165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34400aed30 msgr2=0x7f344006d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.700+0000 7f343ea00640 1 --2- 172.21.15.5:0/3337613165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34400aed30 0x7f344006d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.700+0000 7f343ea00640 1 -- 172.21.15.5:0/3337613165 >> v2:172.21.15.87:3300/0 conn(0x7f34400adba0 msgr2=0x7f34400ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.700+0000 7f343ea00640 1 --2- 172.21.15.5:0/3337613165 >> v2:172.21.15.87:3300/0 conn(0x7f34400adba0 0x7f34400ae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.700+0000 7f343ea00640 1 -- 172.21.15.5:0/3337613165 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34400adff0 con 0x7f3440156a90 2024-08-17T02:27:08.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.701+0000 7f343ea00640 1 --2- 172.21.15.5:0/3337613165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3440156a90 0x7f34400ad660 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3440158260 tx=0x7f34300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27d2f8c878757fa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.701+0000 7f343d600640 1 -- 172.21.15.5:0/3337613165 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343002add0 con 0x7f3440156a90 2024-08-17T02:27:08.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.701+0000 7f343d600640 1 -- 172.21.15.5:0/3337613165 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3430032440 con 0x7f3440156a90 2024-08-17T02:27:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.701+0000 7f343d600640 1 -- 172.21.15.5:0/3337613165 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430032820 con 0x7f3440156a90 2024-08-17T02:27:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.702+0000 7f3445e00640 1 -- 172.21.15.5:0/3337613165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3440156a90 msgr2=0x7f34400ad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.702+0000 7f3445e00640 1 --2- 172.21.15.5:0/3337613165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3440156a90 0x7f34400ad660 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3440158260 tx=0x7f34300091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.702+0000 7f3445e00640 1 -- 172.21.15.5:0/3337613165 shutdown_connections 2024-08-17T02:27:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.702+0000 7f3445e00640 1 --2- 172.21.15.5:0/3337613165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34400aed30 0x7f344006d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.702+0000 7f3445e00640 1 --2- 172.21.15.5:0/3337613165 >> v2:172.21.15.87:3300/0 conn(0x7f34400adba0 0x7f34400ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.702+0000 7f3445e00640 1 --2- 172.21.15.5:0/3337613165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3440156a90 0x7f34400ad660 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.702+0000 7f3445e00640 1 -- 172.21.15.5:0/3337613165 >> 172.21.15.5:0/3337613165 conn(0x7f3440066e60 msgr2=0x7f3440067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.702+0000 7f3445e00640 1 -- 172.21.15.5:0/3337613165 shutdown_connections 2024-08-17T02:27:08.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.702+0000 7f3445e00640 1 -- 172.21.15.5:0/3337613165 wait complete. 2024-08-17T02:27:08.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.703+0000 7f3445e00640 1 Processor -- start 2024-08-17T02:27:08.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.703+0000 7f3445e00640 1 -- start start 2024-08-17T02:27:08.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.704+0000 7f3445e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34400adba0 0x7f3440152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.704+0000 7f3445e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34400aed30 0x7f34400abe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.704+0000 7f3445e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3440156a90 0x7f344006aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.704+0000 7f3445e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34400ad450 con 0x7f34400aed30 2024-08-17T02:27:08.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.704+0000 7f3445e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34400ac840 con 0x7f34400adba0 2024-08-17T02:27:08.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.704+0000 7f3445e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34400acb20 con 0x7f3440156a90 2024-08-17T02:27:08.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.705+0000 7f343e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34400aed30 0x7f34400abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.705+0000 7f343ea00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34400adba0 0x7f3440152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.705+0000 7f343ea00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34400adba0 0x7f3440152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:51824/0 (socket says 172.21.15.5:51824) 2024-08-17T02:27:08.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.705+0000 7f343ea00640 1 -- 172.21.15.5:0/3732682763 learned_addr learned my addr 172.21.15.5:0/3732682763 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:08.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.705+0000 7f343f400640 1 --2- 172.21.15.5:0/3732682763 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3440156a90 0x7f344006aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.705+0000 7f343ea00640 1 -- 172.21.15.5:0/3732682763 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3440156a90 msgr2=0x7f344006aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.705+0000 7f343ea00640 1 --2- 172.21.15.5:0/3732682763 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3440156a90 0x7f344006aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.705+0000 7f343ea00640 1 -- 172.21.15.5:0/3732682763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34400aed30 msgr2=0x7f34400abe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.705+0000 7f343ea00640 1 --2- 172.21.15.5:0/3732682763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34400aed30 0x7f34400abe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.705+0000 7f343ea00640 1 -- 172.21.15.5:0/3732682763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3430009450 con 0x7f34400adba0 2024-08-17T02:27:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.705+0000 7f343ea00640 1 --2- 172.21.15.5:0/3732682763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34400adba0 0x7f3440152600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3430009210 tx=0x7f3430032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.706+0000 7f3436000640 1 -- 172.21.15.5:0/3732682763 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430031bb0 con 0x7f34400adba0 2024-08-17T02:27:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.706+0000 7f3436000640 1 -- 172.21.15.5:0/3732682763 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3430031d30 con 0x7f34400adba0 2024-08-17T02:27:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.706+0000 7f3436000640 1 -- 172.21.15.5:0/3732682763 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430031ea0 con 0x7f34400adba0 2024-08-17T02:27:08.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.706+0000 7f3445e00640 1 -- 172.21.15.5:0/3732682763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34400ace00 con 0x7f34400adba0 2024-08-17T02:27:08.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.706+0000 7f3445e00640 1 -- 172.21.15.5:0/3732682763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34400c1750 con 0x7f34400adba0 2024-08-17T02:27:08.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.707+0000 7f3445e00640 1 -- 172.21.15.5:0/3732682763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3440168d40 con 0x7f34400adba0 2024-08-17T02:27:08.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.708+0000 7f3436000640 1 -- 172.21.15.5:0/3732682763 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3430039040 con 0x7f34400adba0 2024-08-17T02:27:08.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.709+0000 7f3436000640 1 --2- 172.21.15.5:0/3732682763 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3420065150 0x7f3420067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.709+0000 7f3436000640 1 -- 172.21.15.5:0/3732682763 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f34300a27f0 con 0x7f34400adba0 2024-08-17T02:27:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.709+0000 7f3436000640 1 --2- 172.21.15.5:0/3732682763 >> [v2:172.21.15.5:6808/37123,v1:172.21.15.5:6809/37123] conn(0x7f342006b040 0x7f342006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.709+0000 7f3436000640 1 -- 172.21.15.5:0/3732682763 --> [v2:172.21.15.5:6808/37123,v1:172.21.15.5:6809/37123] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f342006db00 con 0x7f342006b040 2024-08-17T02:27:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.709+0000 7f3436000640 1 -- 172.21.15.5:0/3732682763 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34300a2ae0 con 0x7f34400adba0 2024-08-17T02:27:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.709+0000 7f343e000640 1 --2- 172.21.15.5:0/3732682763 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3420065150 0x7f3420067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.709+0000 7f343f400640 1 --2- 172.21.15.5:0/3732682763 >> [v2:172.21.15.5:6808/37123,v1:172.21.15.5:6809/37123] conn(0x7f342006b040 0x7f342006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.710+0000 7f343e000640 1 --2- 172.21.15.5:0/3732682763 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3420065150 0x7f3420067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3440159c50 tx=0x7f342c0090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.710+0000 7f343f400640 1 --2- 172.21.15.5:0/3732682763 >> [v2:172.21.15.5:6808/37123,v1:172.21.15.5:6809/37123] conn(0x7f342006b040 0x7f342006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.711+0000 7f3436000640 1 -- 172.21.15.5:0/3732682763 <== osd.1 v2:172.21.15.5:6808/37123 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f342006db00 con 0x7f342006b040 2024-08-17T02:27:08.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.723+0000 7f3445e00640 1 -- 172.21.15.5:0/3732682763 --> [v2:172.21.15.5:6808/37123,v1:172.21.15.5:6809/37123] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f34400ad280 con 0x7f342006b040 2024-08-17T02:27:08.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.724+0000 7f3436000640 1 -- 172.21.15.5:0/3732682763 <== osd.1 v2:172.21.15.5:6808/37123 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f34400ad280 con 0x7f342006b040 2024-08-17T02:27:08.724 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:27:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:27:08.725 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:27:08.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.724+0000 7f3445e00640 1 -- 172.21.15.5:0/3732682763 >> [v2:172.21.15.5:6808/37123,v1:172.21.15.5:6809/37123] conn(0x7f342006b040 msgr2=0x7f342006d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.724+0000 7f3445e00640 1 --2- 172.21.15.5:0/3732682763 >> [v2:172.21.15.5:6808/37123,v1:172.21.15.5:6809/37123] conn(0x7f342006b040 0x7f342006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.724+0000 7f3445e00640 1 -- 172.21.15.5:0/3732682763 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3420065150 msgr2=0x7f3420067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.724+0000 7f3445e00640 1 --2- 172.21.15.5:0/3732682763 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f3420065150 0x7f3420067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3440159c50 tx=0x7f342c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.724+0000 7f3445e00640 1 -- 172.21.15.5:0/3732682763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34400adba0 msgr2=0x7f3440152600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.724+0000 7f3445e00640 1 --2- 172.21.15.5:0/3732682763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34400adba0 0x7f3440152600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3430009210 tx=0x7f3430032000 comp rx=0 tx=0).stop 2024-08-17T02:27:08.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.724+0000 7f343f400640 1 -- 172.21.15.5:0/3732682763 reap_dead start 2024-08-17T02:27:08.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.724+0000 7f3445e00640 1 -- 172.21.15.5:0/3732682763 shutdown_connections 2024-08-17T02:27:08.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.724+0000 7f3445e00640 1 -- 172.21.15.5:0/3732682763 >> 172.21.15.5:0/3732682763 conn(0x7f3440066e60 msgr2=0x7f3440155db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.724+0000 7f3445e00640 1 -- 172.21.15.5:0/3732682763 shutdown_connections 2024-08-17T02:27:08.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.724+0000 7f3445e00640 1 -- 172.21.15.5:0/3732682763 wait complete. 2024-08-17T02:27:08.739 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:27:08.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.892+0000 7fe0c7400640 1 Processor -- start 2024-08-17T02:27:08.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.892+0000 7fe0c7400640 1 -- start start 2024-08-17T02:27:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.893+0000 7fe0c7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe0c01590b0 0x7fe0c00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.893+0000 7fe0c7400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe0c00acf10 0x7fe0c0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.893+0000 7fe0c7400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c015a4e0 con 0x7fe0c00afca0 2024-08-17T02:27:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.893+0000 7fe0c7400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c00b0980 con 0x7fe0c01590b0 2024-08-17T02:27:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.893+0000 7fe0c7400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c00c92b0 con 0x7fe0c00acf10 2024-08-17T02:27:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.894+0000 7fe0bfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe0c01590b0 0x7fe0c00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.894+0000 7fe0c4a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe0c00afca0 0x7fe0c01589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39238/0 (socket says 172.21.15.5:39238) 2024-08-17T02:27:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.894+0000 7fe0c4a00640 1 -- 172.21.15.5:0/1626881325 learned_addr learned my addr 172.21.15.5:0/1626881325 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.894+0000 7fe0c5400640 1 --2- 172.21.15.5:0/1626881325 >> v2:172.21.15.87:3300/0 conn(0x7fe0c00acf10 0x7fe0c0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.894+0000 7fe0bfe00640 1 -- 172.21.15.5:0/1626881325 >> v2:172.21.15.87:3300/0 conn(0x7fe0c00acf10 msgr2=0x7fe0c0159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.894+0000 7fe0bfe00640 1 --2- 172.21.15.5:0/1626881325 >> v2:172.21.15.87:3300/0 conn(0x7fe0c00acf10 0x7fe0c0159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.894+0000 7fe0bfe00640 1 -- 172.21.15.5:0/1626881325 >> v1:172.21.15.5:6789/0 conn(0x7fe0c00afca0 legacy=0x7fe0c01589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.894+0000 7fe0bfe00640 1 -- 172.21.15.5:0/1626881325 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00ad480 con 0x7fe0c01590b0 2024-08-17T02:27:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.895+0000 7fe0bfe00640 1 --2- 172.21.15.5:0/1626881325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c01590b0 0x7fe0c00b0070 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00cb4a0 tx=0x7fe0ac0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706df948c65c25ac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.895+0000 7fe0bf400640 1 -- 172.21.15.5:0/1626881325 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac02adb0 con 0x7fe0c01590b0 2024-08-17T02:27:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.896+0000 7fe0bf400640 1 -- 172.21.15.5:0/1626881325 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac032440 con 0x7fe0c01590b0 2024-08-17T02:27:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.896+0000 7fe0bf400640 1 -- 172.21.15.5:0/1626881325 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac032820 con 0x7fe0c01590b0 2024-08-17T02:27:08.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.896+0000 7fe0c7400640 1 -- 172.21.15.5:0/1626881325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c01590b0 msgr2=0x7fe0c00b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.896+0000 7fe0c7400640 1 --2- 172.21.15.5:0/1626881325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c01590b0 0x7fe0c00b0070 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00cb4a0 tx=0x7fe0ac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.896+0000 7fe0c7400640 1 -- 172.21.15.5:0/1626881325 shutdown_connections 2024-08-17T02:27:08.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.896+0000 7fe0c7400640 1 --2- 172.21.15.5:0/1626881325 >> v2:172.21.15.87:3300/0 conn(0x7fe0c00acf10 0x7fe0c0159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.896+0000 7fe0c7400640 1 --2- 172.21.15.5:0/1626881325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c01590b0 0x7fe0c00b0070 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.896+0000 7fe0c7400640 1 -- 172.21.15.5:0/1626881325 >> 172.21.15.5:0/1626881325 conn(0x7fe0c0066e60 msgr2=0x7fe0c0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.896+0000 7fe0c7400640 1 -- 172.21.15.5:0/1626881325 shutdown_connections 2024-08-17T02:27:08.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.896+0000 7fe0c7400640 1 -- 172.21.15.5:0/1626881325 wait complete. 2024-08-17T02:27:08.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.898+0000 7fe0c7400640 1 Processor -- start 2024-08-17T02:27:08.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.898+0000 7fe0c7400640 1 -- start start 2024-08-17T02:27:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.898+0000 7fe0c7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c00acf10 0x7fe0c0167bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.898+0000 7fe0c7400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0c00afca0 0x7fe0c0150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.899+0000 7fe0c7400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0c01590b0 0x7fe0c00c1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.899+0000 7fe0c7400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c0158050 con 0x7fe0c00acf10 2024-08-17T02:27:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.899+0000 7fe0c7400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c0168130 con 0x7fe0c01590b0 2024-08-17T02:27:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.899+0000 7fe0c7400640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c0157440 con 0x7fe0c00afca0 2024-08-17T02:27:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.899+0000 7fe0c4a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c00acf10 0x7fe0c0167bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.899+0000 7fe0c4a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c00acf10 0x7fe0c0167bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46134/0 (socket says 172.21.15.5:46134) 2024-08-17T02:27:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.899+0000 7fe0c4a00640 1 -- 172.21.15.5:0/2611502540 learned_addr learned my addr 172.21.15.5:0/2611502540 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.899+0000 7fe0c5400640 1 --2- 172.21.15.5:0/2611502540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0c01590b0 0x7fe0c00c1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.899+0000 7fe0bfe00640 1 --2- 172.21.15.5:0/2611502540 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0c00afca0 0x7fe0c0150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.899+0000 7fe0c4a00640 1 -- 172.21.15.5:0/2611502540 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0c00afca0 msgr2=0x7fe0c0150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.899+0000 7fe0c4a00640 1 --2- 172.21.15.5:0/2611502540 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0c00afca0 0x7fe0c0150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.899+0000 7fe0c4a00640 1 -- 172.21.15.5:0/2611502540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0c01590b0 msgr2=0x7fe0c00c1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.899+0000 7fe0c4a00640 1 --2- 172.21.15.5:0/2611502540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0c01590b0 0x7fe0c00c1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.899+0000 7fe0c4a00640 1 -- 172.21.15.5:0/2611502540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac009390 con 0x7fe0c00acf10 2024-08-17T02:27:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.900+0000 7fe0c4a00640 1 --2- 172.21.15.5:0/2611502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c00acf10 0x7fe0c0167bf0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400c590 tx=0x7fe0b4007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.900+0000 7fe0b3e00640 1 -- 172.21.15.5:0/2611502540 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4005aa0 con 0x7fe0c00acf10 2024-08-17T02:27:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.900+0000 7fe0b3e00640 1 -- 172.21.15.5:0/2611502540 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b4005c20 con 0x7fe0c00acf10 2024-08-17T02:27:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.900+0000 7fe0b3e00640 1 -- 172.21.15.5:0/2611502540 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b40070f0 con 0x7fe0c00acf10 2024-08-17T02:27:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.900+0000 7fe0c7400640 1 -- 172.21.15.5:0/2611502540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c0157720 con 0x7fe0c00acf10 2024-08-17T02:27:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.900+0000 7fe0c7400640 1 -- 172.21.15.5:0/2611502540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c0157ce0 con 0x7fe0c00acf10 2024-08-17T02:27:08.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.901+0000 7fe0c7400640 1 -- 172.21.15.5:0/2611502540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c0067b70 con 0x7fe0c00acf10 2024-08-17T02:27:08.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.902+0000 7fe0b3e00640 1 -- 172.21.15.5:0/2611502540 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe0b4007540 con 0x7fe0c00acf10 2024-08-17T02:27:08.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.903+0000 7fe0b3e00640 1 --2- 172.21.15.5:0/2611502540 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe0a0065150 0x7fe0a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.903+0000 7fe0b3e00640 1 -- 172.21.15.5:0/2611502540 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe0b4081160 con 0x7fe0c00acf10 2024-08-17T02:27:08.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.903+0000 7fe0bfe00640 1 --2- 172.21.15.5:0/2611502540 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe0a0065150 0x7fe0a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.904+0000 7fe0bfe00640 1 --2- 172.21.15.5:0/2611502540 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe0a0065150 0x7fe0a0067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac034000 tx=0x7fe0ac032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:08.907+0000 7fe0b3e00640 1 -- 172.21.15.5:0/2611502540 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe0b404f4a0 con 0x7fe0c00acf10 2024-08-17T02:27:09.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.090+0000 7fe0c7400640 1 -- 172.21.15.5:0/2611502540 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0c0158330 con 0x7fe0a0065150 2024-08-17T02:27:09.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.091+0000 7fe0b3e00640 1 -- 172.21.15.5:0/2611502540 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe0ac032770 con 0x7fe0a0065150 2024-08-17T02:27:09.092 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:27:09.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.093+0000 7fe0c7400640 1 -- 172.21.15.5:0/2611502540 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe0a0065150 msgr2=0x7fe0a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.093+0000 7fe0c7400640 1 --2- 172.21.15.5:0/2611502540 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe0a0065150 0x7fe0a0067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac034000 tx=0x7fe0ac032000 comp rx=0 tx=0).stop 2024-08-17T02:27:09.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.093+0000 7fe0c7400640 1 -- 172.21.15.5:0/2611502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c00acf10 msgr2=0x7fe0c0167bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.093+0000 7fe0c7400640 1 --2- 172.21.15.5:0/2611502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c00acf10 0x7fe0c0167bf0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400c590 tx=0x7fe0b4007ee0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.093+0000 7fe0c7400640 1 -- 172.21.15.5:0/2611502540 shutdown_connections 2024-08-17T02:27:09.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.093+0000 7fe0c7400640 1 --2- 172.21.15.5:0/2611502540 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fe0a0065150 0x7fe0a0067600 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.093+0000 7fe0c7400640 1 --2- 172.21.15.5:0/2611502540 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0c00afca0 0x7fe0c0150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.093+0000 7fe0c7400640 1 --2- 172.21.15.5:0/2611502540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0c01590b0 0x7fe0c00c1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.093+0000 7fe0c7400640 1 --2- 172.21.15.5:0/2611502540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c00acf10 0x7fe0c0167bf0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.093+0000 7fe0c7400640 1 -- 172.21.15.5:0/2611502540 >> 172.21.15.5:0/2611502540 conn(0x7fe0c0066e60 msgr2=0x7fe0c00cac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.093+0000 7fe0c7400640 1 -- 172.21.15.5:0/2611502540 shutdown_connections 2024-08-17T02:27:09.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.093+0000 7fe0c7400640 1 -- 172.21.15.5:0/2611502540 wait complete. 2024-08-17T02:27:09.110 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:27:09.110 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:27:09.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.264+0000 7f8638a00640 1 Processor -- start 2024-08-17T02:27:09.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.265+0000 7f8638a00640 1 -- start start 2024-08-17T02:27:09.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.266+0000 7f8638a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86340cae20 0x7f86340adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.266+0000 7f8638a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86340ca060 con 0x7f86340ae6e0 2024-08-17T02:27:09.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.266+0000 7f8638a00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86340ca340 con 0x7f86340ad780 2024-08-17T02:27:09.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.266+0000 7f8638a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86340ca620 con 0x7f86340cae20 2024-08-17T02:27:09.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.266+0000 7f8633e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f86340ae6e0 0x7f8634157100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39242/0 (socket says 172.21.15.5:39242) 2024-08-17T02:27:09.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.266+0000 7f8633e00640 1 -- 172.21.15.5:0/3270822480 learned_addr learned my addr 172.21.15.5:0/3270822480 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:09.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.266+0000 7f862be00640 1 --2- 172.21.15.5:0/3270822480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86340cae20 0x7f86340adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.267+0000 7f8632a00640 1 -- 172.21.15.5:0/3270822480 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650580926 0 0) 0x7f86340ca060 con 0x7f86340ae6e0 2024-08-17T02:27:09.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.267+0000 7f8632a00640 1 -- 172.21.15.5:0/3270822480 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86180034e0 con 0x7f86340ae6e0 2024-08-17T02:27:09.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.267+0000 7f8632a00640 1 -- 172.21.15.5:0/3270822480 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141790761 0 0) 0x7f86340ca340 con 0x7f86340ad780 2024-08-17T02:27:09.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.267+0000 7f8632a00640 1 -- 172.21.15.5:0/3270822480 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86340ca060 con 0x7f86340ad780 2024-08-17T02:27:09.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.267+0000 7f862be00640 1 -- 172.21.15.5:0/3270822480 >> v1:172.21.15.87:6789/0 conn(0x7f86340ad780 legacy=0x7f86340af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.267+0000 7f862be00640 1 -- 172.21.15.5:0/3270822480 >> v1:172.21.15.5:6789/0 conn(0x7f86340ae6e0 legacy=0x7f8634157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.267+0000 7f862be00640 1 -- 172.21.15.5:0/3270822480 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86340ca900 con 0x7f86340cae20 2024-08-17T02:27:09.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.268+0000 7f862be00640 1 --2- 172.21.15.5:0/3270822480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86340cae20 0x7f86340adb50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f861c009880 tx=0x7f861c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=180d006b9af97be5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.268+0000 7f8632a00640 1 -- 172.21.15.5:0/3270822480 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c02ae20 con 0x7f86340cae20 2024-08-17T02:27:09.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.268+0000 7f8632a00640 1 -- 172.21.15.5:0/3270822480 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861c032440 con 0x7f86340cae20 2024-08-17T02:27:09.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.268+0000 7f8632a00640 1 -- 172.21.15.5:0/3270822480 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c0327c0 con 0x7f86340cae20 2024-08-17T02:27:09.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.269+0000 7f8638a00640 1 -- 172.21.15.5:0/3270822480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86340cae20 msgr2=0x7f86340adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.269+0000 7f8638a00640 1 --2- 172.21.15.5:0/3270822480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86340cae20 0x7f86340adb50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f861c009880 tx=0x7f861c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.269+0000 7f8638a00640 1 -- 172.21.15.5:0/3270822480 shutdown_connections 2024-08-17T02:27:09.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.269+0000 7f8638a00640 1 --2- 172.21.15.5:0/3270822480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86340cae20 0x7f86340adb50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.269+0000 7f8638a00640 1 -- 172.21.15.5:0/3270822480 >> 172.21.15.5:0/3270822480 conn(0x7f8634066e60 msgr2=0x7f8634067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.269+0000 7f8638a00640 1 -- 172.21.15.5:0/3270822480 shutdown_connections 2024-08-17T02:27:09.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.269+0000 7f8638a00640 1 -- 172.21.15.5:0/3270822480 wait complete. 2024-08-17T02:27:09.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.271+0000 7f8638a00640 1 Processor -- start 2024-08-17T02:27:09.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.271+0000 7f8638a00640 1 -- start start 2024-08-17T02:27:09.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.272+0000 7f8638a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86340ad780 0x7f8634152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.272+0000 7f8638a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340ae6e0 0x7f86340a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.272+0000 7f8638a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86340cae20 0x7f86340a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.272+0000 7f8638a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8634158080 con 0x7f86340ae6e0 2024-08-17T02:27:09.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.272+0000 7f8638a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8634169940 con 0x7f86340ad780 2024-08-17T02:27:09.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.272+0000 7f8638a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8634157a30 con 0x7f86340cae20 2024-08-17T02:27:09.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.272+0000 7f862be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340ae6e0 0x7f86340a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.272+0000 7f862be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340ae6e0 0x7f86340a98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46150/0 (socket says 172.21.15.5:46150) 2024-08-17T02:27:09.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.272+0000 7f862be00640 1 -- 172.21.15.5:0/1093236234 learned_addr learned my addr 172.21.15.5:0/1093236234 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:09.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.272+0000 7f8633400640 1 --2- 172.21.15.5:0/1093236234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86340ad780 0x7f8634152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.272+0000 7f8633e00640 1 --2- 172.21.15.5:0/1093236234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86340cae20 0x7f86340a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.272+0000 7f862be00640 1 -- 172.21.15.5:0/1093236234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86340cae20 msgr2=0x7f86340a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.272+0000 7f862be00640 1 --2- 172.21.15.5:0/1093236234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86340cae20 0x7f86340a9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.272+0000 7f862be00640 1 -- 172.21.15.5:0/1093236234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86340ad780 msgr2=0x7f8634152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.272+0000 7f862be00640 1 --2- 172.21.15.5:0/1093236234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86340ad780 0x7f8634152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.272+0000 7f862be00640 1 -- 172.21.15.5:0/1093236234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c009390 con 0x7f86340ae6e0 2024-08-17T02:27:09.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.272+0000 7f8633400640 1 --2- 172.21.15.5:0/1093236234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86340ad780 0x7f8634152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:09.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.273+0000 7f862be00640 1 --2- 172.21.15.5:0/1093236234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340ae6e0 0x7f86340a98b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f861c009880 tx=0x7f861c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.273+0000 7f862aa00640 1 -- 172.21.15.5:0/1093236234 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c0317b0 con 0x7f86340ae6e0 2024-08-17T02:27:09.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.273+0000 7f862aa00640 1 -- 172.21.15.5:0/1093236234 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861c031910 con 0x7f86340ae6e0 2024-08-17T02:27:09.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.273+0000 7f862aa00640 1 -- 172.21.15.5:0/1093236234 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c031cb0 con 0x7f86340ae6e0 2024-08-17T02:27:09.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.273+0000 7f8638a00640 1 -- 172.21.15.5:0/1093236234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8634157d10 con 0x7f86340ae6e0 2024-08-17T02:27:09.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.273+0000 7f8638a00640 1 -- 172.21.15.5:0/1093236234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8634158510 con 0x7f86340ae6e0 2024-08-17T02:27:09.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.274+0000 7f8638a00640 1 -- 172.21.15.5:0/1093236234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8634157890 con 0x7f86340ae6e0 2024-08-17T02:27:09.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.275+0000 7f862aa00640 1 -- 172.21.15.5:0/1093236234 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f861c039050 con 0x7f86340ae6e0 2024-08-17T02:27:09.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.276+0000 7f862aa00640 1 --2- 172.21.15.5:0/1093236234 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8610065150 0x7f8610067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.276+0000 7f862aa00640 1 -- 172.21.15.5:0/1093236234 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f861c0a2b10 con 0x7f86340ae6e0 2024-08-17T02:27:09.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.276+0000 7f8633400640 1 --2- 172.21.15.5:0/1093236234 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8610065150 0x7f8610067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.276+0000 7f862aa00640 1 --2- 172.21.15.5:0/1093236234 >> [v2:172.21.15.5:6800/37114,v1:172.21.15.5:6801/37114] conn(0x7f861006b040 0x7f861006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.276+0000 7f862aa00640 1 -- 172.21.15.5:0/1093236234 --> [v2:172.21.15.5:6800/37114,v1:172.21.15.5:6801/37114] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f861006db00 con 0x7f861006b040 2024-08-17T02:27:09.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.276+0000 7f862aa00640 1 -- 172.21.15.5:0/1093236234 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f861c0a7220 con 0x7f86340ae6e0 2024-08-17T02:27:09.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.276+0000 7f8633e00640 1 --2- 172.21.15.5:0/1093236234 >> [v2:172.21.15.5:6800/37114,v1:172.21.15.5:6801/37114] conn(0x7f861006b040 0x7f861006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.277+0000 7f8633400640 1 --2- 172.21.15.5:0/1093236234 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8610065150 0x7f8610067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f86340c9410 tx=0x7f8624007cc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.277+0000 7f8633e00640 1 --2- 172.21.15.5:0/1093236234 >> [v2:172.21.15.5:6800/37114,v1:172.21.15.5:6801/37114] conn(0x7f861006b040 0x7f861006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.278+0000 7f862aa00640 1 -- 172.21.15.5:0/1093236234 <== osd.2 v2:172.21.15.5:6800/37114 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f861006db00 con 0x7f861006b040 2024-08-17T02:27:09.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.290+0000 7f8638a00640 1 -- 172.21.15.5:0/1093236234 --> [v2:172.21.15.5:6800/37114,v1:172.21.15.5:6801/37114] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8634157ea0 con 0x7f861006b040 2024-08-17T02:27:09.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.291+0000 7f862aa00640 1 -- 172.21.15.5:0/1093236234 <== osd.2 v2:172.21.15.5:6800/37114 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8634157ea0 con 0x7f861006b040 2024-08-17T02:27:09.292 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:27:09.292 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:27:09.292 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:27:09.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.291+0000 7f8638a00640 1 -- 172.21.15.5:0/1093236234 >> [v2:172.21.15.5:6800/37114,v1:172.21.15.5:6801/37114] conn(0x7f861006b040 msgr2=0x7f861006d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.291+0000 7f8638a00640 1 --2- 172.21.15.5:0/1093236234 >> [v2:172.21.15.5:6800/37114,v1:172.21.15.5:6801/37114] conn(0x7f861006b040 0x7f861006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.291+0000 7f8638a00640 1 -- 172.21.15.5:0/1093236234 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8610065150 msgr2=0x7f8610067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.291+0000 7f8638a00640 1 --2- 172.21.15.5:0/1093236234 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f8610065150 0x7f8610067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f86340c9410 tx=0x7f8624007cc0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.291+0000 7f8638a00640 1 -- 172.21.15.5:0/1093236234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340ae6e0 msgr2=0x7f86340a98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.291+0000 7f8638a00640 1 --2- 172.21.15.5:0/1093236234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340ae6e0 0x7f86340a98b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f861c009880 tx=0x7f861c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:09.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.291+0000 7f8633e00640 1 -- 172.21.15.5:0/1093236234 reap_dead start 2024-08-17T02:27:09.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.291+0000 7f8638a00640 1 -- 172.21.15.5:0/1093236234 shutdown_connections 2024-08-17T02:27:09.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.291+0000 7f8638a00640 1 -- 172.21.15.5:0/1093236234 >> 172.21.15.5:0/1093236234 conn(0x7f8634066e60 msgr2=0x7f86340af570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.291+0000 7f8638a00640 1 -- 172.21.15.5:0/1093236234 shutdown_connections 2024-08-17T02:27:09.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.292+0000 7f8638a00640 1 -- 172.21.15.5:0/1093236234 wait complete. 2024-08-17T02:27:09.305 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:27:09.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.458+0000 7f7b75e00640 1 Processor -- start 2024-08-17T02:27:09.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.459+0000 7f7b75e00640 1 -- start start 2024-08-17T02:27:09.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.460+0000 7f7b75e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b700abdf0 0x7f7b70159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.460+0000 7f7b75e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7b700ad370 0x7f7b700c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.460+0000 7f7b75e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b700c92b0 con 0x7f7b701599b0 2024-08-17T02:27:09.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.460+0000 7f7b75e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b700c8ca0 con 0x7f7b700abdf0 2024-08-17T02:27:09.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.460+0000 7f7b75e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b70159ec0 con 0x7f7b700ad370 2024-08-17T02:27:09.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.460+0000 7f7b74a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b700abdf0 0x7f7b70159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.460+0000 7f7b6fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7b701599b0 0x7f7b700acc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39250/0 (socket says 172.21.15.5:39250) 2024-08-17T02:27:09.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.460+0000 7f7b6fe00640 1 -- 172.21.15.5:0/1769171038 learned_addr learned my addr 172.21.15.5:0/1769171038 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:09.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.460+0000 7f7b75400640 1 --2- 172.21.15.5:0/1769171038 >> v2:172.21.15.87:3300/0 conn(0x7f7b700ad370 0x7f7b700c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.461+0000 7f7b74a00640 1 -- 172.21.15.5:0/1769171038 >> v2:172.21.15.87:3300/0 conn(0x7f7b700ad370 msgr2=0x7f7b700c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:09.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.461+0000 7f7b74a00640 1 --2- 172.21.15.5:0/1769171038 >> v2:172.21.15.87:3300/0 conn(0x7f7b700ad370 0x7f7b700c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.461+0000 7f7b74a00640 1 -- 172.21.15.5:0/1769171038 >> v1:172.21.15.5:6789/0 conn(0x7f7b701599b0 legacy=0x7f7b700acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.461+0000 7f7b74a00640 1 -- 172.21.15.5:0/1769171038 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7015a1a0 con 0x7f7b700abdf0 2024-08-17T02:27:09.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.461+0000 7f7b6f400640 1 -- 172.21.15.5:0/1769171038 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607362777 0 0) 0x7f7b700c92b0 con 0x7f7b701599b0 2024-08-17T02:27:09.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.462+0000 7f7b74a00640 1 --2- 172.21.15.5:0/1769171038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b700abdf0 0x7f7b70159470 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7b700ae7e0 tx=0x7f7b640090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc3faf604152c8a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.462+0000 7f7b6f400640 1 -- 172.21.15.5:0/1769171038 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6402adb0 con 0x7f7b700abdf0 2024-08-17T02:27:09.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.462+0000 7f7b6f400640 1 -- 172.21.15.5:0/1769171038 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b64032440 con 0x7f7b700abdf0 2024-08-17T02:27:09.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.462+0000 7f7b6f400640 1 -- 172.21.15.5:0/1769171038 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b640327e0 con 0x7f7b700abdf0 2024-08-17T02:27:09.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.462+0000 7f7b75e00640 1 -- 172.21.15.5:0/1769171038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b700abdf0 msgr2=0x7f7b70159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.462+0000 7f7b75e00640 1 --2- 172.21.15.5:0/1769171038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b700abdf0 0x7f7b70159470 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7b700ae7e0 tx=0x7f7b640090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.463+0000 7f7b75e00640 1 -- 172.21.15.5:0/1769171038 shutdown_connections 2024-08-17T02:27:09.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.463+0000 7f7b75e00640 1 --2- 172.21.15.5:0/1769171038 >> v2:172.21.15.87:3300/0 conn(0x7f7b700ad370 0x7f7b700c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.463+0000 7f7b75e00640 1 --2- 172.21.15.5:0/1769171038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b700abdf0 0x7f7b70159470 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.463+0000 7f7b75e00640 1 -- 172.21.15.5:0/1769171038 >> 172.21.15.5:0/1769171038 conn(0x7f7b70066e60 msgr2=0x7f7b70067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.463+0000 7f7b75e00640 1 -- 172.21.15.5:0/1769171038 shutdown_connections 2024-08-17T02:27:09.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.463+0000 7f7b75e00640 1 -- 172.21.15.5:0/1769171038 wait complete. 2024-08-17T02:27:09.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.464+0000 7f7b75e00640 1 Processor -- start 2024-08-17T02:27:09.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.464+0000 7f7b75e00640 1 -- start start 2024-08-17T02:27:09.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.465+0000 7f7b75e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b700abdf0 0x7f7b70157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.465+0000 7f7b75e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b700ad370 0x7f7b701473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.465+0000 7f7b75e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b701599b0 0x7f7b701570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.465+0000 7f7b75e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7014b260 con 0x7f7b700ad370 2024-08-17T02:27:09.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.465+0000 7f7b75e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7014bb00 con 0x7f7b700abdf0 2024-08-17T02:27:09.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.465+0000 7f7b75e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b70158590 con 0x7f7b701599b0 2024-08-17T02:27:09.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.465+0000 7f7b6fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b700ad370 0x7f7b701473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.465+0000 7f7b6fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b700ad370 0x7f7b701473f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46168/0 (socket says 172.21.15.5:46168) 2024-08-17T02:27:09.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.465+0000 7f7b6fe00640 1 -- 172.21.15.5:0/1304890239 learned_addr learned my addr 172.21.15.5:0/1304890239 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:09.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.465+0000 7f7b74a00640 1 --2- 172.21.15.5:0/1304890239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b700abdf0 0x7f7b70157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.466+0000 7f7b75400640 1 --2- 172.21.15.5:0/1304890239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b701599b0 0x7f7b701570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.466+0000 7f7b6fe00640 1 -- 172.21.15.5:0/1304890239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b701599b0 msgr2=0x7f7b701570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.466+0000 7f7b6fe00640 1 --2- 172.21.15.5:0/1304890239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b701599b0 0x7f7b701570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.466+0000 7f7b6fe00640 1 -- 172.21.15.5:0/1304890239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b700abdf0 msgr2=0x7f7b70157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.466+0000 7f7b6fe00640 1 --2- 172.21.15.5:0/1304890239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b700abdf0 0x7f7b70157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.466+0000 7f7b6fe00640 1 -- 172.21.15.5:0/1304890239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b64009390 con 0x7f7b700ad370 2024-08-17T02:27:09.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.466+0000 7f7b74a00640 1 --2- 172.21.15.5:0/1304890239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b700abdf0 0x7f7b70157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:09.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.466+0000 7f7b6fe00640 1 --2- 172.21.15.5:0/1304890239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b700ad370 0x7f7b701473f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00c540 tx=0x7f7b5c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.466+0000 7f7b63e00640 1 -- 172.21.15.5:0/1304890239 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c005aa0 con 0x7f7b700ad370 2024-08-17T02:27:09.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.466+0000 7f7b63e00640 1 -- 172.21.15.5:0/1304890239 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c005c20 con 0x7f7b700ad370 2024-08-17T02:27:09.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.466+0000 7f7b75e00640 1 -- 172.21.15.5:0/1304890239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7014b4b0 con 0x7f7b700ad370 2024-08-17T02:27:09.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.466+0000 7f7b63e00640 1 -- 172.21.15.5:0/1304890239 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c0070f0 con 0x7f7b700ad370 2024-08-17T02:27:09.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.467+0000 7f7b75e00640 1 -- 172.21.15.5:0/1304890239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7014bf90 con 0x7f7b700ad370 2024-08-17T02:27:09.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.468+0000 7f7b75e00640 1 -- 172.21.15.5:0/1304890239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b70070720 con 0x7f7b700ad370 2024-08-17T02:27:09.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.469+0000 7f7b63e00640 1 -- 172.21.15.5:0/1304890239 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7b5c007520 con 0x7f7b700ad370 2024-08-17T02:27:09.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.469+0000 7f7b63e00640 1 --2- 172.21.15.5:0/1304890239 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7b50065150 0x7f7b50067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.469+0000 7f7b63e00640 1 -- 172.21.15.5:0/1304890239 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7b5c081aa0 con 0x7f7b700ad370 2024-08-17T02:27:09.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.470+0000 7f7b74a00640 1 --2- 172.21.15.5:0/1304890239 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7b50065150 0x7f7b50067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.470+0000 7f7b74a00640 1 --2- 172.21.15.5:0/1304890239 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7b50065150 0x7f7b50067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7b64034000 tx=0x7f7b64032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.473+0000 7f7b63e00640 1 -- 172.21.15.5:0/1304890239 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7b5c04fe90 con 0x7f7b700ad370 2024-08-17T02:27:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.653+0000 7f7b75e00640 1 -- 172.21.15.5:0/1304890239 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b70067c80 con 0x7f7b50065150 2024-08-17T02:27:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.654+0000 7f7b63e00640 1 -- 172.21.15.5:0/1304890239 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7b70067c80 con 0x7f7b50065150 2024-08-17T02:27:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:27:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.656+0000 7f7b75e00640 1 -- 172.21.15.5:0/1304890239 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7b50065150 msgr2=0x7f7b50067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.656+0000 7f7b75e00640 1 --2- 172.21.15.5:0/1304890239 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7b50065150 0x7f7b50067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7b64034000 tx=0x7f7b64032000 comp rx=0 tx=0).stop 2024-08-17T02:27:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.656+0000 7f7b75e00640 1 -- 172.21.15.5:0/1304890239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b700ad370 msgr2=0x7f7b701473f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.656+0000 7f7b75e00640 1 --2- 172.21.15.5:0/1304890239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b700ad370 0x7f7b701473f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00c540 tx=0x7f7b5c00c940 comp rx=0 tx=0).stop 2024-08-17T02:27:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.656+0000 7f7b75e00640 1 -- 172.21.15.5:0/1304890239 shutdown_connections 2024-08-17T02:27:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.656+0000 7f7b75e00640 1 --2- 172.21.15.5:0/1304890239 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f7b50065150 0x7f7b50067600 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.656+0000 7f7b75e00640 1 --2- 172.21.15.5:0/1304890239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b701599b0 0x7f7b701570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.656+0000 7f7b75e00640 1 --2- 172.21.15.5:0/1304890239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b700ad370 0x7f7b701473f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.656+0000 7f7b75e00640 1 --2- 172.21.15.5:0/1304890239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b700abdf0 0x7f7b70157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.656+0000 7f7b75e00640 1 -- 172.21.15.5:0/1304890239 >> 172.21.15.5:0/1304890239 conn(0x7f7b70066e60 msgr2=0x7f7b70069580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.656+0000 7f7b75e00640 1 -- 172.21.15.5:0/1304890239 shutdown_connections 2024-08-17T02:27:09.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.656+0000 7f7b75e00640 1 -- 172.21.15.5:0/1304890239 wait complete. 2024-08-17T02:27:09.672 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:27:09.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:27:09.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:09.797 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:09.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.827+0000 7f25ef200640 1 Processor -- start 2024-08-17T02:27:09.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.827+0000 7f25ef200640 1 -- start start 2024-08-17T02:27:09.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.828+0000 7f25ef200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f015a2e0 0x7f25f0158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.828+0000 7f25ef200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f25f01591e0 0x7f25f0068590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.828+0000 7f25ef200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f00b5b20 con 0x7f25f01588d0 2024-08-17T02:27:09.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.828+0000 7f25ef200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f015b400 con 0x7f25f01591e0 2024-08-17T02:27:09.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.828+0000 7f25ef200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f015a7f0 con 0x7f25f015a2e0 2024-08-17T02:27:09.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.829+0000 7f25ede00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f25f01588d0 0x7f25f0156d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37496/0 (socket says 172.21.15.5:37496) 2024-08-17T02:27:09.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.829+0000 7f25ede00640 1 -- 172.21.15.5:0/4201415486 learned_addr learned my addr 172.21.15.5:0/4201415486 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:09.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.829+0000 7f25ee800640 1 --2- 172.21.15.5:0/4201415486 >> v2:172.21.15.87:3300/0 conn(0x7f25f01591e0 0x7f25f0068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.829+0000 7f25ed400640 1 --2- 172.21.15.5:0/4201415486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f015a2e0 0x7f25f0158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.829+0000 7f25eca00640 1 -- 172.21.15.5:0/4201415486 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359926252 0 0) 0x7f25f00b5b20 con 0x7f25f01588d0 2024-08-17T02:27:09.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.829+0000 7f25eca00640 1 -- 172.21.15.5:0/4201415486 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25d40034e0 con 0x7f25f01588d0 2024-08-17T02:27:09.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.829+0000 7f25ee800640 1 -- 172.21.15.5:0/4201415486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f015a2e0 msgr2=0x7f25f0158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:09.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.829+0000 7f25ee800640 1 --2- 172.21.15.5:0/4201415486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f015a2e0 0x7f25f0158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.829+0000 7f25ee800640 1 -- 172.21.15.5:0/4201415486 >> v1:172.21.15.5:6789/0 conn(0x7f25f01588d0 legacy=0x7f25f0156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.829+0000 7f25ee800640 1 -- 172.21.15.5:0/4201415486 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f015aad0 con 0x7f25f01591e0 2024-08-17T02:27:09.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.830+0000 7f25ee800640 1 --2- 172.21.15.5:0/4201415486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25f01591e0 0x7f25f0068590 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009e60 tx=0x7f25e8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73ee4937f25a9159 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.831+0000 7f25eca00640 1 -- 172.21.15.5:0/4201415486 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8007550 con 0x7f25f01591e0 2024-08-17T02:27:09.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.831+0000 7f25eca00640 1 -- 172.21.15.5:0/4201415486 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e802d050 con 0x7f25f01591e0 2024-08-17T02:27:09.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.831+0000 7f25eca00640 1 -- 172.21.15.5:0/4201415486 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8007920 con 0x7f25f01591e0 2024-08-17T02:27:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.831+0000 7f25ef200640 1 -- 172.21.15.5:0/4201415486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25f01591e0 msgr2=0x7f25f0068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.831+0000 7f25ef200640 1 --2- 172.21.15.5:0/4201415486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25f01591e0 0x7f25f0068590 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009e60 tx=0x7f25e8009780 comp rx=0 tx=0).stop 2024-08-17T02:27:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.831+0000 7f25ef200640 1 -- 172.21.15.5:0/4201415486 shutdown_connections 2024-08-17T02:27:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.831+0000 7f25ef200640 1 --2- 172.21.15.5:0/4201415486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25f01591e0 0x7f25f0068590 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.831+0000 7f25ef200640 1 --2- 172.21.15.5:0/4201415486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f015a2e0 0x7f25f0158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.831+0000 7f25ef200640 1 -- 172.21.15.5:0/4201415486 >> 172.21.15.5:0/4201415486 conn(0x7f25f0087a70 msgr2=0x7f25f006e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.831+0000 7f25ef200640 1 -- 172.21.15.5:0/4201415486 shutdown_connections 2024-08-17T02:27:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.831+0000 7f25ef200640 1 -- 172.21.15.5:0/4201415486 wait complete. 2024-08-17T02:27:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.833+0000 7f25ef200640 1 Processor -- start 2024-08-17T02:27:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.833+0000 7f25ef200640 1 -- start start 2024-08-17T02:27:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.834+0000 7f25ef200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25f01588d0 0x7f25f014e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.834+0000 7f25ef200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f01591e0 0x7f25f014f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.834+0000 7f25ef200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25f015a2e0 0x7f25f0151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.834+0000 7f25ef200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f0168d60 con 0x7f25f015a2e0 2024-08-17T02:27:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.834+0000 7f25ef200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f0150310 con 0x7f25f01588d0 2024-08-17T02:27:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.834+0000 7f25ef200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f01505f0 con 0x7f25f01591e0 2024-08-17T02:27:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.834+0000 7f25ee800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25f015a2e0 0x7f25f0151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.834+0000 7f25ee800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25f015a2e0 0x7f25f0151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60734/0 (socket says 172.21.15.5:60734) 2024-08-17T02:27:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.834+0000 7f25ee800640 1 -- 172.21.15.5:0/1514873125 learned_addr learned my addr 172.21.15.5:0/1514873125 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.834+0000 7f25ede00640 1 --2- 172.21.15.5:0/1514873125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25f01588d0 0x7f25f014e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.835+0000 7f25ee800640 1 -- 172.21.15.5:0/1514873125 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f01591e0 msgr2=0x7f25f014f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.835+0000 7f25ed400640 1 --2- 172.21.15.5:0/1514873125 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f01591e0 0x7f25f014f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.835+0000 7f25ee800640 1 --2- 172.21.15.5:0/1514873125 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f01591e0 0x7f25f014f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.835+0000 7f25ee800640 1 -- 172.21.15.5:0/1514873125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25f01588d0 msgr2=0x7f25f014e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.835+0000 7f25ee800640 1 --2- 172.21.15.5:0/1514873125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25f01588d0 0x7f25f014e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.835+0000 7f25ee800640 1 -- 172.21.15.5:0/1514873125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e8009a20 con 0x7f25f015a2e0 2024-08-17T02:27:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.835+0000 7f25ede00640 1 --2- 172.21.15.5:0/1514873125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25f01588d0 0x7f25f014e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.835+0000 7f25ed400640 1 --2- 172.21.15.5:0/1514873125 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f01591e0 0x7f25f014f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:09.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.835+0000 7f25ee800640 1 --2- 172.21.15.5:0/1514873125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25f015a2e0 0x7f25f0151730 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f25e80099f0 tx=0x7f25e8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.835+0000 7f25e5600640 1 -- 172.21.15.5:0/1514873125 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8031890 con 0x7f25f015a2e0 2024-08-17T02:27:09.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.835+0000 7f25e5600640 1 -- 172.21.15.5:0/1514873125 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e8040070 con 0x7f25f015a2e0 2024-08-17T02:27:09.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.835+0000 7f25e5600640 1 -- 172.21.15.5:0/1514873125 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8031c40 con 0x7f25f015a2e0 2024-08-17T02:27:09.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.835+0000 7f25ef200640 1 -- 172.21.15.5:0/1514873125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f01508d0 con 0x7f25f015a2e0 2024-08-17T02:27:09.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.836+0000 7f25ef200640 1 -- 172.21.15.5:0/1514873125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f014eb70 con 0x7f25f015a2e0 2024-08-17T02:27:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.837+0000 7f25ef200640 1 -- 172.21.15.5:0/1514873125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f25f014ed60 con 0x7f25f015a2e0 2024-08-17T02:27:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.837+0000 7f25e5600640 1 -- 172.21.15.5:0/1514873125 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f25e8042030 con 0x7f25f015a2e0 2024-08-17T02:27:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.838+0000 7f25e5600640 1 --2- 172.21.15.5:0/1514873125 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f25d0065150 0x7f25d0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.838+0000 7f25e5600640 1 -- 172.21.15.5:0/1514873125 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f25e80a38c0 con 0x7f25f015a2e0 2024-08-17T02:27:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.839+0000 7f25e5600640 1 --2- 172.21.15.5:0/1514873125 >> [v2:172.21.15.5:6816/37127,v1:172.21.15.5:6818/37127] conn(0x7f25d006b040 0x7f25d006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.839+0000 7f25ede00640 1 --2- 172.21.15.5:0/1514873125 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f25d0065150 0x7f25d0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.839+0000 7f25e5600640 1 -- 172.21.15.5:0/1514873125 --> [v2:172.21.15.5:6816/37127,v1:172.21.15.5:6818/37127] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25d006db00 con 0x7f25d006b040 2024-08-17T02:27:09.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.839+0000 7f25e5600640 1 -- 172.21.15.5:0/1514873125 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25e80a8240 con 0x7f25f015a2e0 2024-08-17T02:27:09.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.839+0000 7f25ed400640 1 --2- 172.21.15.5:0/1514873125 >> [v2:172.21.15.5:6816/37127,v1:172.21.15.5:6818/37127] conn(0x7f25d006b040 0x7f25d006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.839+0000 7f25ede00640 1 --2- 172.21.15.5:0/1514873125 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f25d0065150 0x7f25d0067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f25e0005840 tx=0x7f25e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.839+0000 7f25ed400640 1 --2- 172.21.15.5:0/1514873125 >> [v2:172.21.15.5:6816/37127,v1:172.21.15.5:6818/37127] conn(0x7f25d006b040 0x7f25d006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.840+0000 7f25e5600640 1 -- 172.21.15.5:0/1514873125 <== osd.3 v2:172.21.15.5:6816/37127 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f25d006db00 con 0x7f25d006b040 2024-08-17T02:27:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.854+0000 7f25ef200640 1 -- 172.21.15.5:0/1514873125 --> [v2:172.21.15.5:6816/37127,v1:172.21.15.5:6818/37127] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f25f0168ea0 con 0x7f25d006b040 2024-08-17T02:27:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.854+0000 7f25e5600640 1 -- 172.21.15.5:0/1514873125 <== osd.3 v2:172.21.15.5:6816/37127 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f25dc009d30 con 0x7f25d006b040 2024-08-17T02:27:09.855 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:27:09.855 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:27:09.855 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:27:09.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.855+0000 7f25ef200640 1 -- 172.21.15.5:0/1514873125 >> [v2:172.21.15.5:6816/37127,v1:172.21.15.5:6818/37127] conn(0x7f25d006b040 msgr2=0x7f25d006d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.855+0000 7f25ef200640 1 --2- 172.21.15.5:0/1514873125 >> [v2:172.21.15.5:6816/37127,v1:172.21.15.5:6818/37127] conn(0x7f25d006b040 0x7f25d006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.855+0000 7f25ef200640 1 -- 172.21.15.5:0/1514873125 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f25d0065150 msgr2=0x7f25d0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.855+0000 7f25ef200640 1 --2- 172.21.15.5:0/1514873125 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f25d0065150 0x7f25d0067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f25e0005840 tx=0x7f25e0009040 comp rx=0 tx=0).stop 2024-08-17T02:27:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.855+0000 7f25ef200640 1 -- 172.21.15.5:0/1514873125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25f015a2e0 msgr2=0x7f25f0151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.855+0000 7f25ef200640 1 --2- 172.21.15.5:0/1514873125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25f015a2e0 0x7f25f0151730 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f25e80099f0 tx=0x7f25e8037000 comp rx=0 tx=0).stop 2024-08-17T02:27:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.855+0000 7f25ee800640 1 -- 172.21.15.5:0/1514873125 reap_dead start 2024-08-17T02:27:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.855+0000 7f25ef200640 1 -- 172.21.15.5:0/1514873125 shutdown_connections 2024-08-17T02:27:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.855+0000 7f25ef200640 1 -- 172.21.15.5:0/1514873125 >> 172.21.15.5:0/1514873125 conn(0x7f25f0087a70 msgr2=0x7f25f00ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.855+0000 7f25ef200640 1 -- 172.21.15.5:0/1514873125 shutdown_connections 2024-08-17T02:27:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:09.855+0000 7f25ef200640 1 -- 172.21.15.5:0/1514873125 wait complete. 2024-08-17T02:27:09.869 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:27:10.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.102+0000 7f1aa5e00640 1 Processor -- start 2024-08-17T02:27:10.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.102+0000 7f1aa5e00640 1 -- start start 2024-08-17T02:27:10.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.103+0000 7f1aa5e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1aa0158b90 0x7f1aa00b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.103+0000 7f1aa5e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa00afd20 con 0x7f1aa00b2370 2024-08-17T02:27:10.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.103+0000 7f1aa5e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa00affe0 con 0x7f1aa00af130 2024-08-17T02:27:10.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.103+0000 7f1aa5e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa00b02c0 con 0x7f1aa0158b90 2024-08-17T02:27:10.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.104+0000 7f1a9ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1aa0158b90 0x7f1aa00b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.104+0000 7f1a9e000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1aa00b2370 0x7f1aa00aea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37500/0 (socket says 172.21.15.5:37500) 2024-08-17T02:27:10.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.104+0000 7f1a9e000640 1 -- 172.21.15.5:0/1376635213 learned_addr learned my addr 172.21.15.5:0/1376635213 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:10.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.104+0000 7f1a9ea00640 1 -- 172.21.15.5:0/1376635213 >> v1:172.21.15.87:6789/0 conn(0x7f1aa00af130 legacy=0x7f1aa00ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.104+0000 7f1a9ea00640 1 -- 172.21.15.5:0/1376635213 >> v1:172.21.15.5:6789/0 conn(0x7f1aa00b2370 legacy=0x7f1aa00aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.104+0000 7f1a9ea00640 1 -- 172.21.15.5:0/1376635213 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa00ca3c0 con 0x7f1aa0158b90 2024-08-17T02:27:10.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.104+0000 7f1a9d600640 1 -- 172.21.15.5:0/1376635213 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017132940 0 0) 0x7f1aa00afd20 con 0x7f1aa00b2370 2024-08-17T02:27:10.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.105+0000 7f1a9ea00640 1 --2- 172.21.15.5:0/1376635213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aa0158b90 0x7f1aa00b1e30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009850 tx=0x7f1a900090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57880ae7eb134dd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.105+0000 7f1a9d600640 1 -- 172.21.15.5:0/1376635213 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9002ae20 con 0x7f1aa0158b90 2024-08-17T02:27:10.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.105+0000 7f1a9d600640 1 -- 172.21.15.5:0/1376635213 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a90032440 con 0x7f1aa0158b90 2024-08-17T02:27:10.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.105+0000 7f1a9d600640 1 -- 172.21.15.5:0/1376635213 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a900327e0 con 0x7f1aa0158b90 2024-08-17T02:27:10.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.106+0000 7f1aa5e00640 1 -- 172.21.15.5:0/1376635213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aa0158b90 msgr2=0x7f1aa00b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.106+0000 7f1aa5e00640 1 --2- 172.21.15.5:0/1376635213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aa0158b90 0x7f1aa00b1e30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009850 tx=0x7f1a900090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.106+0000 7f1aa5e00640 1 -- 172.21.15.5:0/1376635213 shutdown_connections 2024-08-17T02:27:10.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.106+0000 7f1aa5e00640 1 --2- 172.21.15.5:0/1376635213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aa0158b90 0x7f1aa00b1e30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.106+0000 7f1aa5e00640 1 -- 172.21.15.5:0/1376635213 >> 172.21.15.5:0/1376635213 conn(0x7f1aa006e590 msgr2=0x7f1aa006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.106+0000 7f1aa5e00640 1 -- 172.21.15.5:0/1376635213 shutdown_connections 2024-08-17T02:27:10.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.106+0000 7f1aa5e00640 1 -- 172.21.15.5:0/1376635213 wait complete. 2024-08-17T02:27:10.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.107+0000 7f1aa5e00640 1 Processor -- start 2024-08-17T02:27:10.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.108+0000 7f1aa5e00640 1 -- start start 2024-08-17T02:27:10.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.108+0000 7f1aa5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aa00af130 0x7f1aa0158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.109+0000 7f1aa5e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1aa00b2370 0x7f1aa00c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.109+0000 7f1aa5e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1aa0158b90 0x7f1aa015af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.109+0000 7f1aa5e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00c8620 con 0x7f1aa00af130 2024-08-17T02:27:10.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.109+0000 7f1aa5e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00c8ff0 con 0x7f1aa00b2370 2024-08-17T02:27:10.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.109+0000 7f1aa5e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa015b450 con 0x7f1aa0158b90 2024-08-17T02:27:10.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.109+0000 7f1a9ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aa00af130 0x7f1aa0158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.109+0000 7f1a9ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aa00af130 0x7f1aa0158290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60754/0 (socket says 172.21.15.5:60754) 2024-08-17T02:27:10.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.109+0000 7f1a9ea00640 1 -- 172.21.15.5:0/4253444980 learned_addr learned my addr 172.21.15.5:0/4253444980 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:10.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.109+0000 7f1a9e000640 1 --2- 172.21.15.5:0/4253444980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1aa00b2370 0x7f1aa00c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.109+0000 7f1a9f400640 1 --2- 172.21.15.5:0/4253444980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1aa0158b90 0x7f1aa015af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.109+0000 7f1a9ea00640 1 -- 172.21.15.5:0/4253444980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1aa0158b90 msgr2=0x7f1aa015af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.109+0000 7f1a9ea00640 1 --2- 172.21.15.5:0/4253444980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1aa0158b90 0x7f1aa015af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.109+0000 7f1a9ea00640 1 -- 172.21.15.5:0/4253444980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1aa00b2370 msgr2=0x7f1aa00c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.109+0000 7f1a9ea00640 1 --2- 172.21.15.5:0/4253444980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1aa00b2370 0x7f1aa00c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.109+0000 7f1a9ea00640 1 -- 172.21.15.5:0/4253444980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a90009390 con 0x7f1aa00af130 2024-08-17T02:27:10.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.109+0000 7f1a9e000640 1 --2- 172.21.15.5:0/4253444980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1aa00b2370 0x7f1aa00c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:10.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.110+0000 7f1a9ea00640 1 --2- 172.21.15.5:0/4253444980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aa00af130 0x7f1aa0158290 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009850 tx=0x7f1a90032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.110+0000 7f1a96000640 1 -- 172.21.15.5:0/4253444980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a90031b30 con 0x7f1aa00af130 2024-08-17T02:27:10.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.110+0000 7f1a96000640 1 -- 172.21.15.5:0/4253444980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a90031cd0 con 0x7f1aa00af130 2024-08-17T02:27:10.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.110+0000 7f1aa5e00640 1 -- 172.21.15.5:0/4253444980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa00c7a10 con 0x7f1aa00af130 2024-08-17T02:27:10.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.110+0000 7f1a96000640 1 -- 172.21.15.5:0/4253444980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9003d670 con 0x7f1aa00af130 2024-08-17T02:27:10.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.110+0000 7f1aa5e00640 1 -- 172.21.15.5:0/4253444980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa00c7fd0 con 0x7f1aa00af130 2024-08-17T02:27:10.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.111+0000 7f1aa5e00640 1 -- 172.21.15.5:0/4253444980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa0063fb0 con 0x7f1aa00af130 2024-08-17T02:27:10.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.112+0000 7f1a96000640 1 -- 172.21.15.5:0/4253444980 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1a90039040 con 0x7f1aa00af130 2024-08-17T02:27:10.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.113+0000 7f1a96000640 1 --2- 172.21.15.5:0/4253444980 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1a80065150 0x7f1a80067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.113+0000 7f1a96000640 1 -- 172.21.15.5:0/4253444980 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f1a900a1f80 con 0x7f1aa00af130 2024-08-17T02:27:10.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.113+0000 7f1a9e000640 1 --2- 172.21.15.5:0/4253444980 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1a80065150 0x7f1a80067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.113+0000 7f1a9e000640 1 --2- 172.21.15.5:0/4253444980 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1a80065150 0x7f1a80067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00a6830 tx=0x7f1a8c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.117+0000 7f1a96000640 1 -- 172.21.15.5:0/4253444980 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1a90070240 con 0x7f1aa00af130 2024-08-17T02:27:10.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.299+0000 7f1aa5e00640 1 -- 172.21.15.5:0/4253444980 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1aa00c8760 con 0x7f1a80065150 2024-08-17T02:27:10.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.300+0000 7f1a96000640 1 -- 172.21.15.5:0/4253444980 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1a8c005890 con 0x7f1a80065150 2024-08-17T02:27:10.300 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:27:10.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.302+0000 7f1aa5e00640 1 -- 172.21.15.5:0/4253444980 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1a80065150 msgr2=0x7f1a80067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.302+0000 7f1aa5e00640 1 --2- 172.21.15.5:0/4253444980 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1a80065150 0x7f1a80067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00a6830 tx=0x7f1a8c009040 comp rx=0 tx=0).stop 2024-08-17T02:27:10.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.302+0000 7f1aa5e00640 1 -- 172.21.15.5:0/4253444980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aa00af130 msgr2=0x7f1aa0158290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.302+0000 7f1aa5e00640 1 --2- 172.21.15.5:0/4253444980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aa00af130 0x7f1aa0158290 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009850 tx=0x7f1a90032000 comp rx=0 tx=0).stop 2024-08-17T02:27:10.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.302+0000 7f1aa5e00640 1 -- 172.21.15.5:0/4253444980 shutdown_connections 2024-08-17T02:27:10.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.302+0000 7f1aa5e00640 1 --2- 172.21.15.5:0/4253444980 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1a80065150 0x7f1a80067600 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.302+0000 7f1aa5e00640 1 --2- 172.21.15.5:0/4253444980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1aa0158b90 0x7f1aa015af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.302+0000 7f1aa5e00640 1 --2- 172.21.15.5:0/4253444980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1aa00b2370 0x7f1aa00c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.302+0000 7f1aa5e00640 1 --2- 172.21.15.5:0/4253444980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aa00af130 0x7f1aa0158290 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.302+0000 7f1aa5e00640 1 -- 172.21.15.5:0/4253444980 >> 172.21.15.5:0/4253444980 conn(0x7f1aa006e590 msgr2=0x7f1aa00cb630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.302+0000 7f1aa5e00640 1 -- 172.21.15.5:0/4253444980 shutdown_connections 2024-08-17T02:27:10.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.302+0000 7f1aa5e00640 1 -- 172.21.15.5:0/4253444980 wait complete. 2024-08-17T02:27:10.318 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:27:10.318 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:27:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.475+0000 7f931ba00640 1 Processor -- start 2024-08-17T02:27:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.475+0000 7f931ba00640 1 -- start start 2024-08-17T02:27:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.476+0000 7f931ba00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9314158f60 0x7f93140aed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.476+0000 7f931ba00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9314069cd0 0x7f93140af240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.476+0000 7f931ba00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93140b0a70 con 0x7f9314067f70 2024-08-17T02:27:10.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.476+0000 7f931ba00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9314069980 con 0x7f9314069cd0 2024-08-17T02:27:10.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.476+0000 7f931ba00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93140b1450 con 0x7f9314158f60 2024-08-17T02:27:10.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.477+0000 7f9313e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9314069cd0 0x7f93140af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.477+0000 7f9319000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9314158f60 0x7f93140aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.477+0000 7f9319a00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9314067f70 0x7f93140a7d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:40772/0 (socket says 172.21.15.5:40772) 2024-08-17T02:27:10.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.477+0000 7f9319a00640 1 -- 172.21.15.5:0/3874158487 learned_addr learned my addr 172.21.15.5:0/3874158487 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:10.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.477+0000 7f9319000640 1 -- 172.21.15.5:0/3874158487 >> v2:172.21.15.87:3300/0 conn(0x7f9314069cd0 msgr2=0x7f93140af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:10.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.477+0000 7f9319000640 1 --2- 172.21.15.5:0/3874158487 >> v2:172.21.15.87:3300/0 conn(0x7f9314069cd0 0x7f93140af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.477+0000 7f9319000640 1 -- 172.21.15.5:0/3874158487 >> v1:172.21.15.87:6789/0 conn(0x7f9314067f70 legacy=0x7f93140a7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.477+0000 7f9319000640 1 -- 172.21.15.5:0/3874158487 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9314159330 con 0x7f9314158f60 2024-08-17T02:27:10.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.477+0000 7f9313e00640 1 --2- 172.21.15.5:0/3874158487 >> v2:172.21.15.87:3300/0 conn(0x7f9314069cd0 0x7f93140af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:10.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.478+0000 7f9319000640 1 --2- 172.21.15.5:0/3874158487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9314158f60 0x7f93140aed00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9308009850 tx=0x7f93080090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15262a44a4a99ca5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.478+0000 7f9313400640 1 -- 172.21.15.5:0/3874158487 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930802ae10 con 0x7f9314158f60 2024-08-17T02:27:10.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.479+0000 7f9313400640 1 -- 172.21.15.5:0/3874158487 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9308032440 con 0x7f9314158f60 2024-08-17T02:27:10.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.479+0000 7f9313400640 1 -- 172.21.15.5:0/3874158487 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9308032820 con 0x7f9314158f60 2024-08-17T02:27:10.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.479+0000 7f931ba00640 1 -- 172.21.15.5:0/3874158487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9314158f60 msgr2=0x7f93140aed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.479+0000 7f931ba00640 1 --2- 172.21.15.5:0/3874158487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9314158f60 0x7f93140aed00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9308009850 tx=0x7f93080090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.479+0000 7f931ba00640 1 -- 172.21.15.5:0/3874158487 shutdown_connections 2024-08-17T02:27:10.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.479+0000 7f931ba00640 1 --2- 172.21.15.5:0/3874158487 >> v2:172.21.15.87:3300/0 conn(0x7f9314069cd0 0x7f93140af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.479+0000 7f931ba00640 1 --2- 172.21.15.5:0/3874158487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9314158f60 0x7f93140aed00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.479+0000 7f931ba00640 1 -- 172.21.15.5:0/3874158487 >> 172.21.15.5:0/3874158487 conn(0x7f93140ce5e0 msgr2=0x7f9314095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.479+0000 7f931ba00640 1 -- 172.21.15.5:0/3874158487 shutdown_connections 2024-08-17T02:27:10.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.479+0000 7f931ba00640 1 -- 172.21.15.5:0/3874158487 wait complete. 2024-08-17T02:27:10.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.481+0000 7f931ba00640 1 Processor -- start 2024-08-17T02:27:10.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.481+0000 7f931ba00640 1 -- start start 2024-08-17T02:27:10.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.482+0000 7f931ba00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9314067f70 0x7f9314156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.482+0000 7f931ba00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9314069cd0 0x7f93140c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.482+0000 7f931ba00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9314158f60 0x7f93140c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.482+0000 7f931ba00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9314099520 con 0x7f9314067f70 2024-08-17T02:27:10.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.482+0000 7f931ba00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9314098910 con 0x7f9314069cd0 2024-08-17T02:27:10.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.482+0000 7f931ba00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9314098bf0 con 0x7f9314158f60 2024-08-17T02:27:10.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.482+0000 7f9319000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9314067f70 0x7f9314156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.482+0000 7f9313e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9314069cd0 0x7f93140c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.482+0000 7f9319000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9314067f70 0x7f9314156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60764/0 (socket says 172.21.15.5:60764) 2024-08-17T02:27:10.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.482+0000 7f9319000640 1 -- 172.21.15.5:0/1154146792 learned_addr learned my addr 172.21.15.5:0/1154146792 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:10.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.482+0000 7f9319a00640 1 --2- 172.21.15.5:0/1154146792 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9314158f60 0x7f93140c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.483+0000 7f9319000640 1 -- 172.21.15.5:0/1154146792 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9314158f60 msgr2=0x7f93140c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.483+0000 7f9319000640 1 --2- 172.21.15.5:0/1154146792 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9314158f60 0x7f93140c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.483+0000 7f9319000640 1 -- 172.21.15.5:0/1154146792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9314069cd0 msgr2=0x7f93140c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.483+0000 7f9319000640 1 --2- 172.21.15.5:0/1154146792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9314069cd0 0x7f93140c44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.483+0000 7f9319000640 1 -- 172.21.15.5:0/1154146792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9300009390 con 0x7f9314067f70 2024-08-17T02:27:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.483+0000 7f9313e00640 1 --2- 172.21.15.5:0/1154146792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9314069cd0 0x7f93140c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:10.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.483+0000 7f9319000640 1 --2- 172.21.15.5:0/1154146792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9314067f70 0x7f9314156060 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9308035040 tx=0x7f9308032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.483+0000 7f9307e00640 1 -- 172.21.15.5:0/1154146792 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9308000d10 con 0x7f9314067f70 2024-08-17T02:27:10.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.483+0000 7f9307e00640 1 -- 172.21.15.5:0/1154146792 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9308031e00 con 0x7f9314067f70 2024-08-17T02:27:10.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.483+0000 7f9307e00640 1 -- 172.21.15.5:0/1154146792 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930803e6a0 con 0x7f9314067f70 2024-08-17T02:27:10.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.483+0000 7f931ba00640 1 -- 172.21.15.5:0/1154146792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9308009390 con 0x7f9314067f70 2024-08-17T02:27:10.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.483+0000 7f931ba00640 1 -- 172.21.15.5:0/1154146792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93140991b0 con 0x7f9314067f70 2024-08-17T02:27:10.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.484+0000 7f931ba00640 1 -- 172.21.15.5:0/1154146792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9314063fb0 con 0x7f9314067f70 2024-08-17T02:27:10.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.485+0000 7f9307e00640 1 -- 172.21.15.5:0/1154146792 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f930803c400 con 0x7f9314067f70 2024-08-17T02:27:10.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.486+0000 7f9307e00640 1 --2- 172.21.15.5:0/1154146792 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f92f4065150 0x7f92f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.486+0000 7f9307e00640 1 -- 172.21.15.5:0/1154146792 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f93080a2700 con 0x7f9314067f70 2024-08-17T02:27:10.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.486+0000 7f9307e00640 1 --2- 172.21.15.5:0/1154146792 >> [v2:172.21.15.87:6824/37668,v1:172.21.15.87:6825/37668] conn(0x7f92f406aed0 0x7f92f406d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.486+0000 7f9307e00640 1 -- 172.21.15.5:0/1154146792 --> [v2:172.21.15.87:6824/37668,v1:172.21.15.87:6825/37668] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f92f406d990 con 0x7f92f406aed0 2024-08-17T02:27:10.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.486+0000 7f9307e00640 1 -- 172.21.15.5:0/1154146792 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93080a4c00 con 0x7f9314067f70 2024-08-17T02:27:10.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.486+0000 7f9313e00640 1 --2- 172.21.15.5:0/1154146792 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f92f4065150 0x7f92f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.487+0000 7f9319a00640 1 --2- 172.21.15.5:0/1154146792 >> [v2:172.21.15.87:6824/37668,v1:172.21.15.87:6825/37668] conn(0x7f92f406aed0 0x7f92f406d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.487+0000 7f9313e00640 1 --2- 172.21.15.5:0/1154146792 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f92f4065150 0x7f92f4067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f931406e4b0 tx=0x7f93000090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.487+0000 7f9319a00640 1 --2- 172.21.15.5:0/1154146792 >> [v2:172.21.15.87:6824/37668,v1:172.21.15.87:6825/37668] conn(0x7f92f406aed0 0x7f92f406d2e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.488+0000 7f9307e00640 1 -- 172.21.15.5:0/1154146792 <== osd.4 v2:172.21.15.87:6824/37668 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f92f406d990 con 0x7f92f406aed0 2024-08-17T02:27:10.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.501+0000 7f931ba00640 1 -- 172.21.15.5:0/1154146792 --> [v2:172.21.15.87:6824/37668,v1:172.21.15.87:6825/37668] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9314069600 con 0x7f92f406aed0 2024-08-17T02:27:10.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.501+0000 7f9307e00640 1 -- 172.21.15.5:0/1154146792 <== osd.4 v2:172.21.15.87:6824/37668 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9314069600 con 0x7f92f406aed0 2024-08-17T02:27:10.502 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:27:10.502 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:27:10.502 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:27:10.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.502+0000 7f931ba00640 1 -- 172.21.15.5:0/1154146792 >> [v2:172.21.15.87:6824/37668,v1:172.21.15.87:6825/37668] conn(0x7f92f406aed0 msgr2=0x7f92f406d2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.502+0000 7f931ba00640 1 --2- 172.21.15.5:0/1154146792 >> [v2:172.21.15.87:6824/37668,v1:172.21.15.87:6825/37668] conn(0x7f92f406aed0 0x7f92f406d2e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.502+0000 7f931ba00640 1 -- 172.21.15.5:0/1154146792 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f92f4065150 msgr2=0x7f92f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.502+0000 7f931ba00640 1 --2- 172.21.15.5:0/1154146792 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f92f4065150 0x7f92f4067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f931406e4b0 tx=0x7f93000090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.502+0000 7f931ba00640 1 -- 172.21.15.5:0/1154146792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9314067f70 msgr2=0x7f9314156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.502+0000 7f931ba00640 1 --2- 172.21.15.5:0/1154146792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9314067f70 0x7f9314156060 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9308035040 tx=0x7f9308032000 comp rx=0 tx=0).stop 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.502+0000 7f9319a00640 1 -- 172.21.15.5:0/1154146792 reap_dead start 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.502+0000 7f931ba00640 1 -- 172.21.15.5:0/1154146792 shutdown_connections 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.502+0000 7f931ba00640 1 -- 172.21.15.5:0/1154146792 >> 172.21.15.5:0/1154146792 conn(0x7f93140ce5e0 msgr2=0x7f9314157ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.502+0000 7f931ba00640 1 -- 172.21.15.5:0/1154146792 shutdown_connections 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.502+0000 7f931ba00640 1 -- 172.21.15.5:0/1154146792 wait complete. 2024-08-17T02:27:10.516 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:27:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.670+0000 7fd98a200640 1 Processor -- start 2024-08-17T02:27:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.670+0000 7fd98a200640 1 -- start start 2024-08-17T02:27:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.671+0000 7fd98a200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9840aea20 0x7fd9840aee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.671+0000 7fd98a200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9840af370 con 0x7fd9840ca8e0 2024-08-17T02:27:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.671+0000 7fd98a200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9840afd20 con 0x7fd984158b90 2024-08-17T02:27:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.671+0000 7fd98a200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9840affe0 con 0x7fd9840aea20 2024-08-17T02:27:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.672+0000 7fd983e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd9840ca8e0 0x7fd9840cad00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37506/0 (socket says 172.21.15.5:37506) 2024-08-17T02:27:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.672+0000 7fd983e00640 1 -- 172.21.15.5:0/1286837415 learned_addr learned my addr 172.21.15.5:0/1286837415 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.672+0000 7fd982a00640 1 --2- 172.21.15.5:0/1286837415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9840aea20 0x7fd9840aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.672+0000 7fd982a00640 1 -- 172.21.15.5:0/1286837415 >> v1:172.21.15.87:6789/0 conn(0x7fd984158b90 legacy=0x7fd9840b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.672+0000 7fd982000640 1 -- 172.21.15.5:0/1286837415 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338241385 0 0) 0x7fd9840af370 con 0x7fd9840ca8e0 2024-08-17T02:27:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.672+0000 7fd982a00640 1 -- 172.21.15.5:0/1286837415 >> v1:172.21.15.5:6789/0 conn(0x7fd9840ca8e0 legacy=0x7fd9840cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.672+0000 7fd982a00640 1 -- 172.21.15.5:0/1286837415 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9840b02c0 con 0x7fd9840aea20 2024-08-17T02:27:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.673+0000 7fd982a00640 1 --2- 172.21.15.5:0/1286837415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9840aea20 0x7fd9840aee30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd970009880 tx=0x7fd9700090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=598848949e8a9c82 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.673+0000 7fd982000640 1 -- 172.21.15.5:0/1286837415 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97002ae10 con 0x7fd9840aea20 2024-08-17T02:27:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.673+0000 7fd982000640 1 -- 172.21.15.5:0/1286837415 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd970032440 con 0x7fd9840aea20 2024-08-17T02:27:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.673+0000 7fd982000640 1 -- 172.21.15.5:0/1286837415 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9700327e0 con 0x7fd9840aea20 2024-08-17T02:27:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.674+0000 7fd98a200640 1 -- 172.21.15.5:0/1286837415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9840aea20 msgr2=0x7fd9840aee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.674+0000 7fd98a200640 1 --2- 172.21.15.5:0/1286837415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9840aea20 0x7fd9840aee30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd970009880 tx=0x7fd9700090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.674+0000 7fd98a200640 1 -- 172.21.15.5:0/1286837415 shutdown_connections 2024-08-17T02:27:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.674+0000 7fd98a200640 1 --2- 172.21.15.5:0/1286837415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9840aea20 0x7fd9840aee30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.674+0000 7fd98a200640 1 -- 172.21.15.5:0/1286837415 >> 172.21.15.5:0/1286837415 conn(0x7fd98406e590 msgr2=0x7fd98406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.674+0000 7fd98a200640 1 -- 172.21.15.5:0/1286837415 shutdown_connections 2024-08-17T02:27:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.674+0000 7fd98a200640 1 -- 172.21.15.5:0/1286837415 wait complete. 2024-08-17T02:27:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.675+0000 7fd98a200640 1 Processor -- start 2024-08-17T02:27:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.676+0000 7fd98a200640 1 -- start start 2024-08-17T02:27:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.676+0000 7fd98a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9840aea20 0x7fd984168910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.676+0000 7fd98a200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9840ca8e0 0x7fd9841699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.676+0000 7fd98a200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd984158b90 0x7fd9840b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.676+0000 7fd98a200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd984168e50 con 0x7fd9840aea20 2024-08-17T02:27:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.676+0000 7fd98a200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd984169ee0 con 0x7fd9840ca8e0 2024-08-17T02:27:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.676+0000 7fd98a200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9841592d0 con 0x7fd984158b90 2024-08-17T02:27:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.677+0000 7fd983400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9840aea20 0x7fd984168910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.677+0000 7fd982a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9840ca8e0 0x7fd9841699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.677+0000 7fd983e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd984158b90 0x7fd9840b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.677+0000 7fd983400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9840aea20 0x7fd984168910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60770/0 (socket says 172.21.15.5:60770) 2024-08-17T02:27:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.677+0000 7fd983400640 1 -- 172.21.15.5:0/1703517163 learned_addr learned my addr 172.21.15.5:0/1703517163 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.677+0000 7fd982a00640 1 -- 172.21.15.5:0/1703517163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd984158b90 msgr2=0x7fd9840b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.677+0000 7fd982a00640 1 --2- 172.21.15.5:0/1703517163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd984158b90 0x7fd9840b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.677+0000 7fd982a00640 1 -- 172.21.15.5:0/1703517163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9840aea20 msgr2=0x7fd984168910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.677+0000 7fd982a00640 1 --2- 172.21.15.5:0/1703517163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9840aea20 0x7fd984168910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.677+0000 7fd982a00640 1 -- 172.21.15.5:0/1703517163 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd970009390 con 0x7fd9840ca8e0 2024-08-17T02:27:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.677+0000 7fd983400640 1 --2- 172.21.15.5:0/1703517163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9840aea20 0x7fd984168910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.678+0000 7fd982a00640 1 --2- 172.21.15.5:0/1703517163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9840ca8e0 0x7fd9841699a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd984066ff0 tx=0x7fd970032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.678+0000 7fd97aa00640 1 -- 172.21.15.5:0/1703517163 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd970031b30 con 0x7fd9840ca8e0 2024-08-17T02:27:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.678+0000 7fd97aa00640 1 -- 172.21.15.5:0/1703517163 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd970031cb0 con 0x7fd9840ca8e0 2024-08-17T02:27:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.678+0000 7fd97aa00640 1 -- 172.21.15.5:0/1703517163 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97003d670 con 0x7fd9840ca8e0 2024-08-17T02:27:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.678+0000 7fd98a200640 1 -- 172.21.15.5:0/1703517163 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9841595b0 con 0x7fd9840ca8e0 2024-08-17T02:27:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.678+0000 7fd98a200640 1 -- 172.21.15.5:0/1703517163 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd984159b70 con 0x7fd9840ca8e0 2024-08-17T02:27:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.679+0000 7fd98a200640 1 -- 172.21.15.5:0/1703517163 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd984063fb0 con 0x7fd9840ca8e0 2024-08-17T02:27:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.680+0000 7fd97aa00640 1 -- 172.21.15.5:0/1703517163 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd970039040 con 0x7fd9840ca8e0 2024-08-17T02:27:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.681+0000 7fd97aa00640 1 --2- 172.21.15.5:0/1703517163 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fd964065150 0x7fd964067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.681+0000 7fd97aa00640 1 -- 172.21.15.5:0/1703517163 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fd9700a1e50 con 0x7fd9840ca8e0 2024-08-17T02:27:10.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.681+0000 7fd983400640 1 --2- 172.21.15.5:0/1703517163 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fd964065150 0x7fd964067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.682+0000 7fd983400640 1 --2- 172.21.15.5:0/1703517163 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fd964065150 0x7fd964067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd9840cc8f0 tx=0x7fd974009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.690+0000 7fd97aa00640 1 -- 172.21.15.5:0/1703517163 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd9700701c0 con 0x7fd9840ca8e0 2024-08-17T02:27:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.876+0000 7fd98a200640 1 -- 172.21.15.5:0/1703517163 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd984067690 con 0x7fd964065150 2024-08-17T02:27:10.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.876+0000 7fd97aa00640 1 -- 172.21.15.5:0/1703517163 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd984067690 con 0x7fd964065150 2024-08-17T02:27:10.877 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:27:10.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.879+0000 7fd98a200640 1 -- 172.21.15.5:0/1703517163 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fd964065150 msgr2=0x7fd964067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.879+0000 7fd98a200640 1 --2- 172.21.15.5:0/1703517163 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fd964065150 0x7fd964067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd9840cc8f0 tx=0x7fd974009040 comp rx=0 tx=0).stop 2024-08-17T02:27:10.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.879+0000 7fd98a200640 1 -- 172.21.15.5:0/1703517163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9840ca8e0 msgr2=0x7fd9841699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.879+0000 7fd98a200640 1 --2- 172.21.15.5:0/1703517163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9840ca8e0 0x7fd9841699a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd984066ff0 tx=0x7fd970032000 comp rx=0 tx=0).stop 2024-08-17T02:27:10.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.879+0000 7fd98a200640 1 -- 172.21.15.5:0/1703517163 shutdown_connections 2024-08-17T02:27:10.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.879+0000 7fd98a200640 1 --2- 172.21.15.5:0/1703517163 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fd964065150 0x7fd964067600 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.879+0000 7fd98a200640 1 --2- 172.21.15.5:0/1703517163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd984158b90 0x7fd9840b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.879+0000 7fd98a200640 1 --2- 172.21.15.5:0/1703517163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9840ca8e0 0x7fd9841699a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.879+0000 7fd98a200640 1 --2- 172.21.15.5:0/1703517163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9840aea20 0x7fd984168910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.879+0000 7fd98a200640 1 -- 172.21.15.5:0/1703517163 >> 172.21.15.5:0/1703517163 conn(0x7fd98406e590 msgr2=0x7fd9840aedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.879+0000 7fd98a200640 1 -- 172.21.15.5:0/1703517163 shutdown_connections 2024-08-17T02:27:10.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:10.879+0000 7fd98a200640 1 -- 172.21.15.5:0/1703517163 wait complete. 2024-08-17T02:27:10.894 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:27:10.895 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:27:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.065+0000 7fb910a00640 1 Processor -- start 2024-08-17T02:27:11.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.065+0000 7fb910a00640 1 -- start start 2024-08-17T02:27:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.066+0000 7fb910a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb90c0af410 0x7fb90c160570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.066+0000 7fb910a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb90c069cd0 0x7fb90c162ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.066+0000 7fb910a00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90c0b0a50 con 0x7fb90c159090 2024-08-17T02:27:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.066+0000 7fb910a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90c068e50 con 0x7fb90c069cd0 2024-08-17T02:27:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.066+0000 7fb910a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0b13e0 con 0x7fb90c0af410 2024-08-17T02:27:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.067+0000 7fb901400640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb90c0af410 0x7fb90c160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.067+0000 7fb90a800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb90c069cd0 0x7fb90c162ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.067+0000 7fb909e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb90c159090 0x7fb90c0aed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:40778/0 (socket says 172.21.15.5:40778) 2024-08-17T02:27:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.067+0000 7fb909e00640 1 -- 172.21.15.5:0/1734068731 learned_addr learned my addr 172.21.15.5:0/1734068731 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.067+0000 7fb901400640 1 --2- 172.21.15.5:0/1734068731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb90c0af410 0x7fb90c160570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:58570/0 (socket says 172.21.15.5:58570) 2024-08-17T02:27:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.067+0000 7fb901400640 1 -- 172.21.15.5:0/1734068731 >> v2:172.21.15.87:3300/0 conn(0x7fb90c069cd0 msgr2=0x7fb90c162ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.067+0000 7fb901400640 1 --2- 172.21.15.5:0/1734068731 >> v2:172.21.15.87:3300/0 conn(0x7fb90c069cd0 0x7fb90c162ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.067+0000 7fb901400640 1 -- 172.21.15.5:0/1734068731 >> v1:172.21.15.87:6789/0 conn(0x7fb90c159090 legacy=0x7fb90c0aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.067+0000 7fb901400640 1 -- 172.21.15.5:0/1734068731 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c0698d0 con 0x7fb90c0af410 2024-08-17T02:27:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.067+0000 7fb90a800640 1 --2- 172.21.15.5:0/1734068731 >> v2:172.21.15.87:3300/0 conn(0x7fb90c069cd0 0x7fb90c162ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.068+0000 7fb901400640 1 --2- 172.21.15.5:0/1734068731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb90c0af410 0x7fb90c160570 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009850 tx=0x7fb8f40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=918efb29bddd78fe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.069+0000 7fb909400640 1 -- 172.21.15.5:0/1734068731 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f402ae20 con 0x7fb90c0af410 2024-08-17T02:27:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.069+0000 7fb909400640 1 -- 172.21.15.5:0/1734068731 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f4032440 con 0x7fb90c0af410 2024-08-17T02:27:11.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.069+0000 7fb909400640 1 -- 172.21.15.5:0/1734068731 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4032820 con 0x7fb90c0af410 2024-08-17T02:27:11.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.069+0000 7fb910a00640 1 -- 172.21.15.5:0/1734068731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb90c0af410 msgr2=0x7fb90c160570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.069+0000 7fb910a00640 1 --2- 172.21.15.5:0/1734068731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb90c0af410 0x7fb90c160570 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009850 tx=0x7fb8f40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.069+0000 7fb910a00640 1 -- 172.21.15.5:0/1734068731 shutdown_connections 2024-08-17T02:27:11.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.069+0000 7fb910a00640 1 --2- 172.21.15.5:0/1734068731 >> v2:172.21.15.87:3300/0 conn(0x7fb90c069cd0 0x7fb90c162ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.069+0000 7fb910a00640 1 --2- 172.21.15.5:0/1734068731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb90c0af410 0x7fb90c160570 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.069+0000 7fb910a00640 1 -- 172.21.15.5:0/1734068731 >> 172.21.15.5:0/1734068731 conn(0x7fb90c0ce5e0 msgr2=0x7fb90c095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:11.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.069+0000 7fb910a00640 1 -- 172.21.15.5:0/1734068731 shutdown_connections 2024-08-17T02:27:11.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.070+0000 7fb910a00640 1 -- 172.21.15.5:0/1734068731 wait complete. 2024-08-17T02:27:11.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.071+0000 7fb910a00640 1 Processor -- start 2024-08-17T02:27:11.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.071+0000 7fb910a00640 1 -- start start 2024-08-17T02:27:11.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.072+0000 7fb910a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb90c069cd0 0x7fb90c156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.072+0000 7fb910a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb90c0af410 0x7fb90c0a7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.072+0000 7fb910a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb90c159090 0x7fb90c0a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.072+0000 7fb910a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c09a230 con 0x7fb90c0af410 2024-08-17T02:27:11.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.072+0000 7fb910a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0cc730 con 0x7fb90c069cd0 2024-08-17T02:27:11.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.072+0000 7fb910a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c09a4d0 con 0x7fb90c159090 2024-08-17T02:27:11.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.072+0000 7fb901400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb90c0af410 0x7fb90c0a7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.072+0000 7fb909e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb90c069cd0 0x7fb90c156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.072+0000 7fb901400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb90c0af410 0x7fb90c0a7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60776/0 (socket says 172.21.15.5:60776) 2024-08-17T02:27:11.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.072+0000 7fb901400640 1 -- 172.21.15.5:0/1946372131 learned_addr learned my addr 172.21.15.5:0/1946372131 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:11.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.072+0000 7fb90a800640 1 --2- 172.21.15.5:0/1946372131 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb90c159090 0x7fb90c0a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.073+0000 7fb901400640 1 -- 172.21.15.5:0/1946372131 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb90c159090 msgr2=0x7fb90c0a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.073+0000 7fb901400640 1 --2- 172.21.15.5:0/1946372131 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb90c159090 0x7fb90c0a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.073+0000 7fb901400640 1 -- 172.21.15.5:0/1946372131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb90c069cd0 msgr2=0x7fb90c156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.073+0000 7fb901400640 1 --2- 172.21.15.5:0/1946372131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb90c069cd0 0x7fb90c156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.073+0000 7fb901400640 1 -- 172.21.15.5:0/1946372131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb904009a20 con 0x7fb90c0af410 2024-08-17T02:27:11.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.073+0000 7fb909e00640 1 --2- 172.21.15.5:0/1946372131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb90c069cd0 0x7fb90c156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:11.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.073+0000 7fb901400640 1 --2- 172.21.15.5:0/1946372131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb90c0af410 0x7fb90c0a7f90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009360 tx=0x7fb8f4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.073+0000 7fb902000640 1 -- 172.21.15.5:0/1946372131 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4000d10 con 0x7fb90c0af410 2024-08-17T02:27:11.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.073+0000 7fb902000640 1 -- 172.21.15.5:0/1946372131 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f4031de0 con 0x7fb90c0af410 2024-08-17T02:27:11.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.073+0000 7fb910a00640 1 -- 172.21.15.5:0/1946372131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f4009390 con 0x7fb90c0af410 2024-08-17T02:27:11.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.073+0000 7fb902000640 1 -- 172.21.15.5:0/1946372131 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f403d670 con 0x7fb90c0af410 2024-08-17T02:27:11.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.073+0000 7fb910a00640 1 -- 172.21.15.5:0/1946372131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90c09aa90 con 0x7fb90c0af410 2024-08-17T02:27:11.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.074+0000 7fb910a00640 1 -- 172.21.15.5:0/1946372131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb90c063fb0 con 0x7fb90c0af410 2024-08-17T02:27:11.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.075+0000 7fb902000640 1 -- 172.21.15.5:0/1946372131 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb8f4039040 con 0x7fb90c0af410 2024-08-17T02:27:11.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.076+0000 7fb902000640 1 --2- 172.21.15.5:0/1946372131 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb8e8065180 0x7fb8e8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.076+0000 7fb902000640 1 -- 172.21.15.5:0/1946372131 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb8f40a2120 con 0x7fb90c0af410 2024-08-17T02:27:11.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.076+0000 7fb909e00640 1 --2- 172.21.15.5:0/1946372131 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb8e8065180 0x7fb8e8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.076+0000 7fb902000640 1 --2- 172.21.15.5:0/1946372131 >> [v2:172.21.15.87:6800/37666,v1:172.21.15.87:6801/37666] conn(0x7fb8e806af00 0x7fb8e806d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.077+0000 7fb902000640 1 -- 172.21.15.5:0/1946372131 --> [v2:172.21.15.87:6800/37666,v1:172.21.15.87:6801/37666] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb8e806d9c0 con 0x7fb8e806af00 2024-08-17T02:27:11.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.077+0000 7fb902000640 1 -- 172.21.15.5:0/1946372131 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8f40a4680 con 0x7fb90c0af410 2024-08-17T02:27:11.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.077+0000 7fb90a800640 1 --2- 172.21.15.5:0/1946372131 >> [v2:172.21.15.87:6800/37666,v1:172.21.15.87:6801/37666] conn(0x7fb8e806af00 0x7fb8e806d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.077+0000 7fb909e00640 1 --2- 172.21.15.5:0/1946372131 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb8e8065180 0x7fb8e8067630 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc007040 tx=0x7fb8fc007e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.077+0000 7fb90a800640 1 --2- 172.21.15.5:0/1946372131 >> [v2:172.21.15.87:6800/37666,v1:172.21.15.87:6801/37666] conn(0x7fb8e806af00 0x7fb8e806d310 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.078+0000 7fb902000640 1 -- 172.21.15.5:0/1946372131 <== osd.5 v2:172.21.15.87:6800/37666 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb8e806d9c0 con 0x7fb8e806af00 2024-08-17T02:27:11.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.091+0000 7fb910a00640 1 -- 172.21.15.5:0/1946372131 --> [v2:172.21.15.87:6800/37666,v1:172.21.15.87:6801/37666] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb90c0cca20 con 0x7fb8e806af00 2024-08-17T02:27:11.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.091+0000 7fb902000640 1 -- 172.21.15.5:0/1946372131 <== osd.5 v2:172.21.15.87:6800/37666 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb90c0cca20 con 0x7fb8e806af00 2024-08-17T02:27:11.092 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:27:11.092 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:27:11.092 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:27:11.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.092+0000 7fb910a00640 1 -- 172.21.15.5:0/1946372131 >> [v2:172.21.15.87:6800/37666,v1:172.21.15.87:6801/37666] conn(0x7fb8e806af00 msgr2=0x7fb8e806d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.092+0000 7fb910a00640 1 --2- 172.21.15.5:0/1946372131 >> [v2:172.21.15.87:6800/37666,v1:172.21.15.87:6801/37666] conn(0x7fb8e806af00 0x7fb8e806d310 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.092+0000 7fb910a00640 1 -- 172.21.15.5:0/1946372131 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb8e8065180 msgr2=0x7fb8e8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.092+0000 7fb910a00640 1 --2- 172.21.15.5:0/1946372131 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb8e8065180 0x7fb8e8067630 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc007040 tx=0x7fb8fc007e80 comp rx=0 tx=0).stop 2024-08-17T02:27:11.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.092+0000 7fb910a00640 1 -- 172.21.15.5:0/1946372131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb90c0af410 msgr2=0x7fb90c0a7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.092+0000 7fb910a00640 1 --2- 172.21.15.5:0/1946372131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb90c0af410 0x7fb90c0a7f90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009360 tx=0x7fb8f4032000 comp rx=0 tx=0).stop 2024-08-17T02:27:11.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.092+0000 7fb90a800640 1 -- 172.21.15.5:0/1946372131 reap_dead start 2024-08-17T02:27:11.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.092+0000 7fb910a00640 1 -- 172.21.15.5:0/1946372131 shutdown_connections 2024-08-17T02:27:11.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.092+0000 7fb910a00640 1 -- 172.21.15.5:0/1946372131 >> 172.21.15.5:0/1946372131 conn(0x7fb90c0ce5e0 msgr2=0x7fb90c15e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:11.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.092+0000 7fb910a00640 1 -- 172.21.15.5:0/1946372131 shutdown_connections 2024-08-17T02:27:11.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.092+0000 7fb910a00640 1 -- 172.21.15.5:0/1946372131 wait complete. 2024-08-17T02:27:11.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:27:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.261+0000 7f1b7ee00640 1 Processor -- start 2024-08-17T02:27:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.261+0000 7f1b7ee00640 1 -- start start 2024-08-17T02:27:11.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.263+0000 7f1b7ee00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b78158dd0 0x7f1b7806e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.263+0000 7f1b7ee00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1b7806ead0 0x7f1b780b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.263+0000 7f1b7ee00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b7806eed0 con 0x7f1b78158a00 2024-08-17T02:27:11.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.263+0000 7f1b7ee00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b78159230 con 0x7f1b78158dd0 2024-08-17T02:27:11.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.263+0000 7f1b7ee00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b780cbc50 con 0x7f1b7806ead0 2024-08-17T02:27:11.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.263+0000 7f1b7d000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b78158dd0 0x7f1b7806e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.263+0000 7f1b7d000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b78158dd0 0x7f1b7806e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60786/0 (socket says 172.21.15.5:60786) 2024-08-17T02:27:11.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.263+0000 7f1b7d000640 1 -- 172.21.15.5:0/3225175354 learned_addr learned my addr 172.21.15.5:0/3225175354 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:11.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.263+0000 7f1b7da00640 1 --1- 172.21.15.5:0/3225175354 >> v1:172.21.15.87:6789/0 conn(0x7f1b78158a00 0x7f1b780cb190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:40792/0 (socket says 172.21.15.5:40792) 2024-08-17T02:27:11.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.263+0000 7f1b7e400640 1 --2- 172.21.15.5:0/3225175354 >> v2:172.21.15.87:3300/0 conn(0x7f1b7806ead0 0x7f1b780b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.264+0000 7f1b7d000640 1 -- 172.21.15.5:0/3225175354 >> v2:172.21.15.87:3300/0 conn(0x7f1b7806ead0 msgr2=0x7f1b780b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:11.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.264+0000 7f1b7d000640 1 --2- 172.21.15.5:0/3225175354 >> v2:172.21.15.87:3300/0 conn(0x7f1b7806ead0 0x7f1b780b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.264+0000 7f1b7d000640 1 -- 172.21.15.5:0/3225175354 >> v1:172.21.15.87:6789/0 conn(0x7f1b78158a00 legacy=0x7f1b780cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.264+0000 7f1b7d000640 1 -- 172.21.15.5:0/3225175354 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b780cbf30 con 0x7f1b78158dd0 2024-08-17T02:27:11.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.264+0000 7f1b77e00640 1 -- 172.21.15.5:0/3225175354 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870516643 0 0) 0x7f1b7806eed0 con 0x7f1b78158a00 2024-08-17T02:27:11.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.265+0000 7f1b7d000640 1 --2- 172.21.15.5:0/3225175354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b78158dd0 0x7f1b7806e590 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1b780b0610 tx=0x7f1b640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f822391b3d21651c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.265+0000 7f1b77e00640 1 -- 172.21.15.5:0/3225175354 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6402ae80 con 0x7f1b78158dd0 2024-08-17T02:27:11.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.265+0000 7f1b77e00640 1 -- 172.21.15.5:0/3225175354 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b64032440 con 0x7f1b78158dd0 2024-08-17T02:27:11.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.265+0000 7f1b77e00640 1 -- 172.21.15.5:0/3225175354 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b640327c0 con 0x7f1b78158dd0 2024-08-17T02:27:11.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.266+0000 7f1b7ee00640 1 -- 172.21.15.5:0/3225175354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b78158dd0 msgr2=0x7f1b7806e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.266+0000 7f1b7ee00640 1 --2- 172.21.15.5:0/3225175354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b78158dd0 0x7f1b7806e590 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1b780b0610 tx=0x7f1b640091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.266+0000 7f1b7ee00640 1 -- 172.21.15.5:0/3225175354 shutdown_connections 2024-08-17T02:27:11.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.266+0000 7f1b7ee00640 1 --2- 172.21.15.5:0/3225175354 >> v2:172.21.15.87:3300/0 conn(0x7f1b7806ead0 0x7f1b780b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.266+0000 7f1b7ee00640 1 --2- 172.21.15.5:0/3225175354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b78158dd0 0x7f1b7806e590 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.266+0000 7f1b7ee00640 1 -- 172.21.15.5:0/3225175354 >> 172.21.15.5:0/3225175354 conn(0x7f1b780cfb80 msgr2=0x7f1b780cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:11.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.266+0000 7f1b7ee00640 1 -- 172.21.15.5:0/3225175354 shutdown_connections 2024-08-17T02:27:11.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.266+0000 7f1b7ee00640 1 -- 172.21.15.5:0/3225175354 wait complete. 2024-08-17T02:27:11.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.268+0000 7f1b7ee00640 1 Processor -- start 2024-08-17T02:27:11.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.268+0000 7f1b7ee00640 1 -- start start 2024-08-17T02:27:11.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.270+0000 7f1b7ee00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b7806ead0 0x7f1b780b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.270+0000 7f1b7ee00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b78158a00 0x7f1b780c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.270+0000 7f1b7ee00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b78158dd0 0x7f1b780c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.270+0000 7f1b7ee00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b78156ba0 con 0x7f1b7806ead0 2024-08-17T02:27:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.270+0000 7f1b7ee00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b78155f90 con 0x7f1b78158dd0 2024-08-17T02:27:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.270+0000 7f1b7ee00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b78156270 con 0x7f1b78158a00 2024-08-17T02:27:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.270+0000 7f1b7da00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b7806ead0 0x7f1b780b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.270+0000 7f1b7da00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b7806ead0 0x7f1b780b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60796/0 (socket says 172.21.15.5:60796) 2024-08-17T02:27:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.270+0000 7f1b7da00640 1 -- 172.21.15.5:0/392971910 learned_addr learned my addr 172.21.15.5:0/392971910 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.270+0000 7f1b7d000640 1 --2- 172.21.15.5:0/392971910 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b78158a00 0x7f1b780c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.270+0000 7f1b7e400640 1 --2- 172.21.15.5:0/392971910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b78158dd0 0x7f1b780c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.270+0000 7f1b7da00640 1 -- 172.21.15.5:0/392971910 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b78158a00 msgr2=0x7f1b780c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.270+0000 7f1b7da00640 1 --2- 172.21.15.5:0/392971910 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b78158a00 0x7f1b780c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.270+0000 7f1b7da00640 1 -- 172.21.15.5:0/392971910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b78158dd0 msgr2=0x7f1b780c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.270+0000 7f1b7da00640 1 --2- 172.21.15.5:0/392971910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b78158dd0 0x7f1b780c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.270+0000 7f1b7da00640 1 -- 172.21.15.5:0/392971910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b64009450 con 0x7f1b7806ead0 2024-08-17T02:27:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.271+0000 7f1b7da00640 1 --2- 172.21.15.5:0/392971910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b7806ead0 0x7f1b780b0100 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00c5e0 tx=0x7f1b6c007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.271+0000 7f1b74c00640 1 -- 172.21.15.5:0/392971910 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c007300 con 0x7f1b7806ead0 2024-08-17T02:27:11.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.271+0000 7f1b74c00640 1 -- 172.21.15.5:0/392971910 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6c007480 con 0x7f1b7806ead0 2024-08-17T02:27:11.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.271+0000 7f1b74c00640 1 -- 172.21.15.5:0/392971910 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c0049f0 con 0x7f1b7806ead0 2024-08-17T02:27:11.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.271+0000 7f1b7ee00640 1 -- 172.21.15.5:0/392971910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b78156550 con 0x7f1b7806ead0 2024-08-17T02:27:11.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.271+0000 7f1b7ee00640 1 -- 172.21.15.5:0/392971910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b780c8a20 con 0x7f1b7806ead0 2024-08-17T02:27:11.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.272+0000 7f1b7ee00640 1 -- 172.21.15.5:0/392971910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b78070720 con 0x7f1b7806ead0 2024-08-17T02:27:11.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.273+0000 7f1b74c00640 1 -- 172.21.15.5:0/392971910 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1b6c0113a0 con 0x7f1b7806ead0 2024-08-17T02:27:11.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.274+0000 7f1b74c00640 1 --2- 172.21.15.5:0/392971910 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1b58065150 0x7f1b58067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.275+0000 7f1b74c00640 1 -- 172.21.15.5:0/392971910 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f1b6c0812c0 con 0x7f1b7806ead0 2024-08-17T02:27:11.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.275+0000 7f1b7d000640 1 --2- 172.21.15.5:0/392971910 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1b58065150 0x7f1b58067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.276+0000 7f1b7d000640 1 --2- 172.21.15.5:0/392971910 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1b58065150 0x7f1b58067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1b64034000 tx=0x7f1b64032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.278+0000 7f1b74c00640 1 -- 172.21.15.5:0/392971910 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1b6c04f6b0 con 0x7f1b7806ead0 2024-08-17T02:27:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.461+0000 7f1b7ee00640 1 -- 172.21.15.5:0/392971910 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b78156ce0 con 0x7f1b58065150 2024-08-17T02:27:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.462+0000 7f1b74c00640 1 -- 172.21.15.5:0/392971910 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1b640326c0 con 0x7f1b58065150 2024-08-17T02:27:11.463 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:27:11.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.464+0000 7f1b7ee00640 1 -- 172.21.15.5:0/392971910 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1b58065150 msgr2=0x7f1b58067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.464+0000 7f1b7ee00640 1 --2- 172.21.15.5:0/392971910 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1b58065150 0x7f1b58067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1b64034000 tx=0x7f1b64032000 comp rx=0 tx=0).stop 2024-08-17T02:27:11.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.464+0000 7f1b7ee00640 1 -- 172.21.15.5:0/392971910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b7806ead0 msgr2=0x7f1b780b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.464+0000 7f1b7ee00640 1 --2- 172.21.15.5:0/392971910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b7806ead0 0x7f1b780b0100 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00c5e0 tx=0x7f1b6c007d00 comp rx=0 tx=0).stop 2024-08-17T02:27:11.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.464+0000 7f1b7ee00640 1 -- 172.21.15.5:0/392971910 shutdown_connections 2024-08-17T02:27:11.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.464+0000 7f1b7ee00640 1 --2- 172.21.15.5:0/392971910 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f1b58065150 0x7f1b58067600 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.464+0000 7f1b7ee00640 1 --2- 172.21.15.5:0/392971910 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b78158a00 0x7f1b780c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.464+0000 7f1b7ee00640 1 --2- 172.21.15.5:0/392971910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b78158dd0 0x7f1b780c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.464+0000 7f1b7ee00640 1 --2- 172.21.15.5:0/392971910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b7806ead0 0x7f1b780b0100 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.464+0000 7f1b7ee00640 1 -- 172.21.15.5:0/392971910 >> 172.21.15.5:0/392971910 conn(0x7f1b780cfb80 msgr2=0x7f1b780cd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:11.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.464+0000 7f1b7ee00640 1 -- 172.21.15.5:0/392971910 shutdown_connections 2024-08-17T02:27:11.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.464+0000 7f1b7ee00640 1 -- 172.21.15.5:0/392971910 wait complete. 2024-08-17T02:27:11.479 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:27:11.479 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:27:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.634+0000 7f9faf200640 1 Processor -- start 2024-08-17T02:27:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.634+0000 7f9faf200640 1 -- start start 2024-08-17T02:27:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.635+0000 7f9faf200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fa81588d0 0x7f9fa8156d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.635+0000 7f9faf200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9fa815a2e0 0x7f9fa8158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.635+0000 7f9faf200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9fa81591e0 0x7f9fa8068590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.635+0000 7f9faf200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa80b5b20 con 0x7f9fa81591e0 2024-08-17T02:27:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.635+0000 7f9faf200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa815b400 con 0x7f9fa815a2e0 2024-08-17T02:27:11.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.635+0000 7f9faf200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8157290 con 0x7f9fa81588d0 2024-08-17T02:27:11.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.635+0000 7f9fae800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9fa81591e0 0x7f9fa8068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.635+0000 7f9fae800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9fa81591e0 0x7f9fa8068590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60800/0 (socket says 172.21.15.5:60800) 2024-08-17T02:27:11.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.635+0000 7f9fae800640 1 -- 172.21.15.5:0/2998098918 learned_addr learned my addr 172.21.15.5:0/2998098918 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:11.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.635+0000 7f9fad400640 1 --2- 172.21.15.5:0/2998098918 >> v2:172.21.15.87:3300/0 conn(0x7f9fa815a2e0 0x7f9fa8158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.635+0000 7f9fade00640 1 --2- 172.21.15.5:0/2998098918 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fa81588d0 0x7f9fa8156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.636+0000 7f9fae800640 1 -- 172.21.15.5:0/2998098918 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fa81588d0 msgr2=0x7f9fa8156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.636+0000 7f9fae800640 1 --2- 172.21.15.5:0/2998098918 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fa81588d0 0x7f9fa8156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.636+0000 7f9fae800640 1 -- 172.21.15.5:0/2998098918 >> v2:172.21.15.87:3300/0 conn(0x7f9fa815a2e0 msgr2=0x7f9fa8158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.636+0000 7f9fae800640 1 --2- 172.21.15.5:0/2998098918 >> v2:172.21.15.87:3300/0 conn(0x7f9fa815a2e0 0x7f9fa8158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.636+0000 7f9fae800640 1 -- 172.21.15.5:0/2998098918 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa815a7f0 con 0x7f9fa81591e0 2024-08-17T02:27:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.637+0000 7f9fae800640 1 --2- 172.21.15.5:0/2998098918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa81591e0 0x7f9fa8068590 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80b2670 tx=0x7f9fa4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25920857167b97fc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.637+0000 7f9faca00640 1 -- 172.21.15.5:0/2998098918 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4031400 con 0x7f9fa81591e0 2024-08-17T02:27:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.637+0000 7f9faca00640 1 -- 172.21.15.5:0/2998098918 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa402d050 con 0x7f9fa81591e0 2024-08-17T02:27:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.637+0000 7f9faca00640 1 -- 172.21.15.5:0/2998098918 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa40317d0 con 0x7f9fa81591e0 2024-08-17T02:27:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.638+0000 7f9faf200640 1 -- 172.21.15.5:0/2998098918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa81591e0 msgr2=0x7f9fa8068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.638+0000 7f9faf200640 1 --2- 172.21.15.5:0/2998098918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa81591e0 0x7f9fa8068590 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80b2670 tx=0x7f9fa4009840 comp rx=0 tx=0).stop 2024-08-17T02:27:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.638+0000 7f9faf200640 1 -- 172.21.15.5:0/2998098918 shutdown_connections 2024-08-17T02:27:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.638+0000 7f9faf200640 1 --2- 172.21.15.5:0/2998098918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa81591e0 0x7f9fa8068590 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.638+0000 7f9faf200640 1 --2- 172.21.15.5:0/2998098918 >> v2:172.21.15.87:3300/0 conn(0x7f9fa815a2e0 0x7f9fa8158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.638+0000 7f9faf200640 1 --2- 172.21.15.5:0/2998098918 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fa81588d0 0x7f9fa8156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.638+0000 7f9faf200640 1 -- 172.21.15.5:0/2998098918 >> 172.21.15.5:0/2998098918 conn(0x7f9fa8087a70 msgr2=0x7f9fa806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.638+0000 7f9faf200640 1 -- 172.21.15.5:0/2998098918 shutdown_connections 2024-08-17T02:27:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.638+0000 7f9faf200640 1 -- 172.21.15.5:0/2998098918 wait complete. 2024-08-17T02:27:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.639+0000 7f9faf200640 1 Processor -- start 2024-08-17T02:27:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.639+0000 7f9faf200640 1 -- start start 2024-08-17T02:27:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.640+0000 7f9faf200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fa81588d0 0x7f9fa81481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.640+0000 7f9faf200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa81591e0 0x7f9fa80b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.640+0000 7f9faf200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa815a2e0 0x7f9fa80b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.640+0000 7f9faf200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8149d70 con 0x7f9fa815a2e0 2024-08-17T02:27:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.640+0000 7f9faf200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8149160 con 0x7f9fa81591e0 2024-08-17T02:27:11.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.640+0000 7f9faf200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8149440 con 0x7f9fa81588d0 2024-08-17T02:27:11.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.641+0000 7f9fae800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa815a2e0 0x7f9fa80b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.641+0000 7f9fad400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa81591e0 0x7f9fa80b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.641+0000 7f9fade00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fa81588d0 0x7f9fa81481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.641+0000 7f9fad400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa81591e0 0x7f9fa80b04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:33170/0 (socket says 172.21.15.5:33170) 2024-08-17T02:27:11.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.641+0000 7f9fad400640 1 -- 172.21.15.5:0/3904738062 learned_addr learned my addr 172.21.15.5:0/3904738062 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:11.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.641+0000 7f9fad400640 1 -- 172.21.15.5:0/3904738062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fa81588d0 msgr2=0x7f9fa81481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.641+0000 7f9fad400640 1 --2- 172.21.15.5:0/3904738062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fa81588d0 0x7f9fa81481e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.641+0000 7f9fad400640 1 -- 172.21.15.5:0/3904738062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa815a2e0 msgr2=0x7f9fa80b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.641+0000 7f9fad400640 1 --2- 172.21.15.5:0/3904738062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa815a2e0 0x7f9fa80b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.641+0000 7f9fad400640 1 -- 172.21.15.5:0/3904738062 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa4009ae0 con 0x7f9fa81591e0 2024-08-17T02:27:11.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.641+0000 7f9fade00640 1 --2- 172.21.15.5:0/3904738062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fa81588d0 0x7f9fa81481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:11.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.641+0000 7f9fae800640 1 --2- 172.21.15.5:0/3904738062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa815a2e0 0x7f9fa80b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.641+0000 7f9fad400640 1 --2- 172.21.15.5:0/3904738062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa81591e0 0x7f9fa80b04e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800e900 tx=0x7f9f980090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.642+0000 7f9fa1600640 1 -- 172.21.15.5:0/3904738062 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9800c8e0 con 0x7f9fa81591e0 2024-08-17T02:27:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.642+0000 7f9fa1600640 1 -- 172.21.15.5:0/3904738062 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9800ca40 con 0x7f9fa81591e0 2024-08-17T02:27:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.642+0000 7f9fa1600640 1 -- 172.21.15.5:0/3904738062 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9800cde0 con 0x7f9fa81591e0 2024-08-17T02:27:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.642+0000 7f9faf200640 1 -- 172.21.15.5:0/3904738062 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa8149720 con 0x7f9fa81591e0 2024-08-17T02:27:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.642+0000 7f9faf200640 1 -- 172.21.15.5:0/3904738062 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa8148720 con 0x7f9fa81591e0 2024-08-17T02:27:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.643+0000 7f9faf200640 1 -- 172.21.15.5:0/3904738062 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9fa8063f10 con 0x7f9fa81591e0 2024-08-17T02:27:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.644+0000 7f9fa1600640 1 -- 172.21.15.5:0/3904738062 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9f98013680 con 0x7f9fa81591e0 2024-08-17T02:27:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.644+0000 7f9fa1600640 1 --2- 172.21.15.5:0/3904738062 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9f8c065150 0x7f9f8c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.645+0000 7f9fa1600640 1 -- 172.21.15.5:0/3904738062 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9f98082300 con 0x7f9fa81591e0 2024-08-17T02:27:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.645+0000 7f9fade00640 1 --2- 172.21.15.5:0/3904738062 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9f8c065150 0x7f9f8c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.645+0000 7f9fa1600640 1 --2- 172.21.15.5:0/3904738062 >> [v2:172.21.15.87:6808/37667,v1:172.21.15.87:6809/37667] conn(0x7f9f8c06b040 0x7f9f8c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.645+0000 7f9fa1600640 1 -- 172.21.15.5:0/3904738062 --> [v2:172.21.15.87:6808/37667,v1:172.21.15.87:6809/37667] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f8c06db00 con 0x7f9f8c06b040 2024-08-17T02:27:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.645+0000 7f9fa1600640 1 -- 172.21.15.5:0/3904738062 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f98084860 con 0x7f9fa81591e0 2024-08-17T02:27:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.645+0000 7f9fae800640 1 --2- 172.21.15.5:0/3904738062 >> [v2:172.21.15.87:6808/37667,v1:172.21.15.87:6809/37667] conn(0x7f9f8c06b040 0x7f9f8c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.645+0000 7f9fade00640 1 --2- 172.21.15.5:0/3904738062 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9f8c065150 0x7f9f8c067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9fa814c5e0 tx=0x7f9f9c0090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.646+0000 7f9fae800640 1 --2- 172.21.15.5:0/3904738062 >> [v2:172.21.15.87:6808/37667,v1:172.21.15.87:6809/37667] conn(0x7f9f8c06b040 0x7f9f8c06d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.647+0000 7f9fa1600640 1 -- 172.21.15.5:0/3904738062 <== osd.6 v2:172.21.15.87:6808/37667 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f9f8c06db00 con 0x7f9f8c06b040 2024-08-17T02:27:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.659+0000 7f9faf200640 1 -- 172.21.15.5:0/3904738062 --> [v2:172.21.15.87:6808/37667,v1:172.21.15.87:6809/37667] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9fa80ccee0 con 0x7f9f8c06b040 2024-08-17T02:27:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.660+0000 7f9fa1600640 1 -- 172.21.15.5:0/3904738062 <== osd.6 v2:172.21.15.87:6808/37667 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9fa80ccee0 con 0x7f9f8c06b040 2024-08-17T02:27:11.660 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:27:11.661 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:27:11.661 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:27:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.660+0000 7f9faf200640 1 -- 172.21.15.5:0/3904738062 >> [v2:172.21.15.87:6808/37667,v1:172.21.15.87:6809/37667] conn(0x7f9f8c06b040 msgr2=0x7f9f8c06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.660+0000 7f9faf200640 1 --2- 172.21.15.5:0/3904738062 >> [v2:172.21.15.87:6808/37667,v1:172.21.15.87:6809/37667] conn(0x7f9f8c06b040 0x7f9f8c06d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.660+0000 7f9faf200640 1 -- 172.21.15.5:0/3904738062 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9f8c065150 msgr2=0x7f9f8c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.660+0000 7f9faf200640 1 --2- 172.21.15.5:0/3904738062 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f9f8c065150 0x7f9f8c067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9fa814c5e0 tx=0x7f9f9c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.660+0000 7f9faf200640 1 -- 172.21.15.5:0/3904738062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa81591e0 msgr2=0x7f9fa80b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.660+0000 7f9faf200640 1 --2- 172.21.15.5:0/3904738062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa81591e0 0x7f9fa80b04e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800e900 tx=0x7f9f980090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.660+0000 7f9fae800640 1 -- 172.21.15.5:0/3904738062 reap_dead start 2024-08-17T02:27:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.660+0000 7f9faf200640 1 -- 172.21.15.5:0/3904738062 shutdown_connections 2024-08-17T02:27:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.660+0000 7f9faf200640 1 -- 172.21.15.5:0/3904738062 >> 172.21.15.5:0/3904738062 conn(0x7f9fa8087a70 msgr2=0x7f9fa80b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.661+0000 7f9faf200640 1 -- 172.21.15.5:0/3904738062 shutdown_connections 2024-08-17T02:27:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.661+0000 7f9faf200640 1 -- 172.21.15.5:0/3904738062 wait complete. 2024-08-17T02:27:11.674 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:27:11.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.827+0000 7f6950600640 1 Processor -- start 2024-08-17T02:27:11.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.827+0000 7f6950600640 1 -- start start 2024-08-17T02:27:11.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.828+0000 7f6950600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69480adde0 0x7f69480b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.828+0000 7f6950600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6948156ea0 0x7f69480b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.828+0000 7f6950600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69480ae2a0 con 0x7f69480b15d0 2024-08-17T02:27:11.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.828+0000 7f6950600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69480ae580 con 0x7f6948156ea0 2024-08-17T02:27:11.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.828+0000 7f6950600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69480ae860 con 0x7f69480adde0 2024-08-17T02:27:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.829+0000 7f694d200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69480adde0 0x7f69480b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.829+0000 7f694e600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6948156ea0 0x7f69480b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.829+0000 7f694dc00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f69480b15d0 0x7f6948156790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.5:40808/0 (socket says 172.21.15.5:40808) 2024-08-17T02:27:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.829+0000 7f694dc00640 1 -- 172.21.15.5:0/1319647028 learned_addr learned my addr 172.21.15.5:0/1319647028 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.829+0000 7f694d200640 1 -- 172.21.15.5:0/1319647028 >> v2:172.21.15.87:3300/0 conn(0x7f6948156ea0 msgr2=0x7f69480b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.829+0000 7f694d200640 1 --2- 172.21.15.5:0/1319647028 >> v2:172.21.15.87:3300/0 conn(0x7f6948156ea0 0x7f69480b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.829+0000 7f694d200640 1 -- 172.21.15.5:0/1319647028 >> v1:172.21.15.87:6789/0 conn(0x7f69480b15d0 legacy=0x7f6948156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.829+0000 7f6947e00640 1 -- 172.21.15.5:0/1319647028 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770436266 0 0) 0x7f69480ae2a0 con 0x7f69480b15d0 2024-08-17T02:27:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.829+0000 7f694d200640 1 -- 172.21.15.5:0/1319647028 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69480aeb40 con 0x7f69480adde0 2024-08-17T02:27:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.830+0000 7f694d200640 1 --2- 172.21.15.5:0/1319647028 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69480adde0 0x7f69480b19a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6934009850 tx=0x7f69340090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17e6aeb1f413ef9f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.830+0000 7f6947e00640 1 -- 172.21.15.5:0/1319647028 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693402ad90 con 0x7f69480adde0 2024-08-17T02:27:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.831+0000 7f6947e00640 1 -- 172.21.15.5:0/1319647028 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6934032440 con 0x7f69480adde0 2024-08-17T02:27:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.831+0000 7f6947e00640 1 -- 172.21.15.5:0/1319647028 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69340327e0 con 0x7f69480adde0 2024-08-17T02:27:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.831+0000 7f6950600640 1 -- 172.21.15.5:0/1319647028 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69480adde0 msgr2=0x7f69480b19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.831+0000 7f6950600640 1 --2- 172.21.15.5:0/1319647028 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69480adde0 0x7f69480b19a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6934009850 tx=0x7f69340090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.831+0000 7f6950600640 1 -- 172.21.15.5:0/1319647028 shutdown_connections 2024-08-17T02:27:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.831+0000 7f6950600640 1 --2- 172.21.15.5:0/1319647028 >> v2:172.21.15.87:3300/0 conn(0x7f6948156ea0 0x7f69480b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.831+0000 7f6950600640 1 --2- 172.21.15.5:0/1319647028 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69480adde0 0x7f69480b19a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.831+0000 7f6950600640 1 -- 172.21.15.5:0/1319647028 >> 172.21.15.5:0/1319647028 conn(0x7f69480ce5e0 msgr2=0x7f6948095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.831+0000 7f6950600640 1 -- 172.21.15.5:0/1319647028 shutdown_connections 2024-08-17T02:27:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.831+0000 7f6950600640 1 -- 172.21.15.5:0/1319647028 wait complete. 2024-08-17T02:27:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.833+0000 7f6950600640 1 Processor -- start 2024-08-17T02:27:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.833+0000 7f6950600640 1 -- start start 2024-08-17T02:27:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.834+0000 7f6950600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69480adde0 0x7f69480c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.834+0000 7f6950600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69480b15d0 0x7f69480ac700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.834+0000 7f6950600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6948156ea0 0x7f6948167160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.834+0000 7f6950600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69480c5000 con 0x7f6948156ea0 2024-08-17T02:27:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.834+0000 7f6950600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69480acc40 con 0x7f69480b15d0 2024-08-17T02:27:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.834+0000 7f6950600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69480a9b30 con 0x7f69480adde0 2024-08-17T02:27:11.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.834+0000 7f694e600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6948156ea0 0x7f6948167160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.834+0000 7f694e600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6948156ea0 0x7f6948167160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60816/0 (socket says 172.21.15.5:60816) 2024-08-17T02:27:11.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.834+0000 7f694dc00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69480adde0 0x7f69480c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.834+0000 7f694e600640 1 -- 172.21.15.5:0/519747097 learned_addr learned my addr 172.21.15.5:0/519747097 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:11.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.834+0000 7f694d200640 1 --2- 172.21.15.5:0/519747097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69480b15d0 0x7f69480ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.835+0000 7f694e600640 1 -- 172.21.15.5:0/519747097 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69480adde0 msgr2=0x7f69480c4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.835+0000 7f694e600640 1 --2- 172.21.15.5:0/519747097 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69480adde0 0x7f69480c4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.835+0000 7f694e600640 1 -- 172.21.15.5:0/519747097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69480b15d0 msgr2=0x7f69480ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.835+0000 7f694e600640 1 --2- 172.21.15.5:0/519747097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69480b15d0 0x7f69480ac700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.835+0000 7f694e600640 1 -- 172.21.15.5:0/519747097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6934009390 con 0x7f6948156ea0 2024-08-17T02:27:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.835+0000 7f694e600640 1 --2- 172.21.15.5:0/519747097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6948156ea0 0x7f6948167160 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6940009e20 tx=0x7f694000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.835+0000 7f6944c00640 1 -- 172.21.15.5:0/519747097 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694000cd40 con 0x7f6948156ea0 2024-08-17T02:27:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.835+0000 7f6944c00640 1 -- 172.21.15.5:0/519747097 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694000f040 con 0x7f6948156ea0 2024-08-17T02:27:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.835+0000 7f6944c00640 1 -- 172.21.15.5:0/519747097 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69400146d0 con 0x7f6948156ea0 2024-08-17T02:27:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.835+0000 7f6950600640 1 -- 172.21.15.5:0/519747097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69480aa3d0 con 0x7f6948156ea0 2024-08-17T02:27:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.835+0000 7f6950600640 1 -- 172.21.15.5:0/519747097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69480aa060 con 0x7f6948156ea0 2024-08-17T02:27:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.837+0000 7f6950600640 1 -- 172.21.15.5:0/519747097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69480aa560 con 0x7f6948156ea0 2024-08-17T02:27:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.837+0000 7f6944c00640 1 -- 172.21.15.5:0/519747097 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6940014a80 con 0x7f6948156ea0 2024-08-17T02:27:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.838+0000 7f6944c00640 1 --2- 172.21.15.5:0/519747097 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6928065150 0x7f6928067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.839+0000 7f6944c00640 1 -- 172.21.15.5:0/519747097 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6940082b10 con 0x7f6948156ea0 2024-08-17T02:27:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.839+0000 7f694dc00640 1 --2- 172.21.15.5:0/519747097 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6928065150 0x7f6928067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.839+0000 7f694dc00640 1 --2- 172.21.15.5:0/519747097 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6928065150 0x7f6928067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f693c0011e0 tx=0x7f693c007ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:11.846+0000 7f6944c00640 1 -- 172.21.15.5:0/519747097 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6940050e80 con 0x7f6948156ea0 2024-08-17T02:27:12.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.031+0000 7f6950600640 1 -- 172.21.15.5:0/519747097 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f6948063fb0 con 0x7f6928065150 2024-08-17T02:27:12.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.031+0000 7f6944c00640 1 -- 172.21.15.5:0/519747097 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6948063fb0 con 0x7f6928065150 2024-08-17T02:27:12.032 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:27:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.034+0000 7f6950600640 1 -- 172.21.15.5:0/519747097 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6928065150 msgr2=0x7f6928067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.034+0000 7f6950600640 1 --2- 172.21.15.5:0/519747097 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6928065150 0x7f6928067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f693c0011e0 tx=0x7f693c007ca0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.034+0000 7f6950600640 1 -- 172.21.15.5:0/519747097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6948156ea0 msgr2=0x7f6948167160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.034+0000 7f6950600640 1 --2- 172.21.15.5:0/519747097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6948156ea0 0x7f6948167160 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6940009e20 tx=0x7f694000b040 comp rx=0 tx=0).stop 2024-08-17T02:27:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.034+0000 7f6950600640 1 -- 172.21.15.5:0/519747097 shutdown_connections 2024-08-17T02:27:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.034+0000 7f6950600640 1 --2- 172.21.15.5:0/519747097 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f6928065150 0x7f6928067600 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.034+0000 7f6950600640 1 --2- 172.21.15.5:0/519747097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6948156ea0 0x7f6948167160 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.034+0000 7f6950600640 1 --2- 172.21.15.5:0/519747097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69480b15d0 0x7f69480ac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.034+0000 7f6950600640 1 --2- 172.21.15.5:0/519747097 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69480adde0 0x7f69480c4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.034+0000 7f6950600640 1 -- 172.21.15.5:0/519747097 >> 172.21.15.5:0/519747097 conn(0x7f69480ce5e0 msgr2=0x7f69481561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:12.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.034+0000 7f6950600640 1 -- 172.21.15.5:0/519747097 shutdown_connections 2024-08-17T02:27:12.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.034+0000 7f6950600640 1 -- 172.21.15.5:0/519747097 wait complete. 2024-08-17T02:27:12.049 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:27:12.049 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:27:12.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.204+0000 7f0668e00640 1 Processor -- start 2024-08-17T02:27:12.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.205+0000 7f0668e00640 1 -- start start 2024-08-17T02:27:12.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.206+0000 7f0668e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06640af830 0x7f0664159b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.206+0000 7f0668e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06640ad560 con 0x7f06640af460 2024-08-17T02:27:12.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.206+0000 7f0668e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06640ad820 con 0x7f06640afde0 2024-08-17T02:27:12.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.206+0000 7f0668e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06640a8330 con 0x7f06640af830 2024-08-17T02:27:12.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.206+0000 7f0663400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f06640af460 0x7f06640a7c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37518/0 (socket says 172.21.15.5:37518) 2024-08-17T02:27:12.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.206+0000 7f0663400640 1 -- 172.21.15.5:0/2834822953 learned_addr learned my addr 172.21.15.5:0/2834822953 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:12.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.206+0000 7f0663e00640 1 --2- 172.21.15.5:0/2834822953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06640af830 0x7f0664159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.206+0000 7f0662a00640 1 -- 172.21.15.5:0/2834822953 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945836788 0 0) 0x7f06640ad560 con 0x7f06640af460 2024-08-17T02:27:12.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.207+0000 7f0662a00640 1 -- 172.21.15.5:0/2834822953 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06480034e0 con 0x7f06640af460 2024-08-17T02:27:12.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.207+0000 7f0662a00640 1 -- 172.21.15.5:0/2834822953 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840138946 0 0) 0x7f06640ad820 con 0x7f06640afde0 2024-08-17T02:27:12.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.207+0000 7f0663e00640 1 -- 172.21.15.5:0/2834822953 >> v1:172.21.15.87:6789/0 conn(0x7f06640afde0 legacy=0x7f06640cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.207+0000 7f0663e00640 1 -- 172.21.15.5:0/2834822953 >> v1:172.21.15.5:6789/0 conn(0x7f06640af460 legacy=0x7f06640a7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.207+0000 7f0663e00640 1 -- 172.21.15.5:0/2834822953 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06640adb00 con 0x7f06640af830 2024-08-17T02:27:12.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.208+0000 7f0663e00640 1 --2- 172.21.15.5:0/2834822953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06640af830 0x7f0664159b70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f065c009e90 tx=0x7f065c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ff988862f0015e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:12.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.208+0000 7f0662a00640 1 -- 172.21.15.5:0/2834822953 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c007550 con 0x7f06640af830 2024-08-17T02:27:12.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.208+0000 7f0662a00640 1 -- 172.21.15.5:0/2834822953 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065c02d050 con 0x7f06640af830 2024-08-17T02:27:12.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.208+0000 7f0662a00640 1 -- 172.21.15.5:0/2834822953 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c0078e0 con 0x7f06640af830 2024-08-17T02:27:12.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.208+0000 7f0668e00640 1 -- 172.21.15.5:0/2834822953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06640af830 msgr2=0x7f0664159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.208+0000 7f0668e00640 1 --2- 172.21.15.5:0/2834822953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06640af830 0x7f0664159b70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f065c009e90 tx=0x7f065c009780 comp rx=0 tx=0).stop 2024-08-17T02:27:12.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.209+0000 7f0668e00640 1 -- 172.21.15.5:0/2834822953 shutdown_connections 2024-08-17T02:27:12.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.209+0000 7f0668e00640 1 --2- 172.21.15.5:0/2834822953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06640af830 0x7f0664159b70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.209+0000 7f0668e00640 1 -- 172.21.15.5:0/2834822953 >> 172.21.15.5:0/2834822953 conn(0x7f0664066e60 msgr2=0x7f0664067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:12.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.209+0000 7f0668e00640 1 -- 172.21.15.5:0/2834822953 shutdown_connections 2024-08-17T02:27:12.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.209+0000 7f0668e00640 1 -- 172.21.15.5:0/2834822953 wait complete. 2024-08-17T02:27:12.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.210+0000 7f0668e00640 1 Processor -- start 2024-08-17T02:27:12.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.210+0000 7f0668e00640 1 -- start start 2024-08-17T02:27:12.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.211+0000 7f0668e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06640af460 0x7f0664168e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.211+0000 7f0668e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06640af830 0x7f0664097260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.211+0000 7f0668e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06640afde0 0x7f06640977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.211+0000 7f0668e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06641687b0 con 0x7f06640af830 2024-08-17T02:27:12.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.211+0000 7f0668e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0664097dd0 con 0x7f06640afde0 2024-08-17T02:27:12.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.211+0000 7f0668e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06640980b0 con 0x7f06640af460 2024-08-17T02:27:12.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.211+0000 7f065be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06640af830 0x7f0664097260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.211+0000 7f065be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06640af830 0x7f0664097260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60830/0 (socket says 172.21.15.5:60830) 2024-08-17T02:27:12.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.211+0000 7f065be00640 1 -- 172.21.15.5:0/2601434449 learned_addr learned my addr 172.21.15.5:0/2601434449 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:12.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.211+0000 7f0663400640 1 --2- 172.21.15.5:0/2601434449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06640af460 0x7f0664168e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.211+0000 7f0663e00640 1 --2- 172.21.15.5:0/2601434449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06640afde0 0x7f06640977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.212+0000 7f065be00640 1 -- 172.21.15.5:0/2601434449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06640af460 msgr2=0x7f0664168e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.212+0000 7f065be00640 1 --2- 172.21.15.5:0/2601434449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06640af460 0x7f0664168e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.212+0000 7f065be00640 1 -- 172.21.15.5:0/2601434449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06640afde0 msgr2=0x7f06640977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.212+0000 7f065be00640 1 --2- 172.21.15.5:0/2601434449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06640afde0 0x7f06640977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.212+0000 7f065be00640 1 -- 172.21.15.5:0/2601434449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c009a20 con 0x7f06640af830 2024-08-17T02:27:12.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.212+0000 7f065be00640 1 --2- 172.21.15.5:0/2601434449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06640af830 0x7f0664097260 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f064c00c5b0 tx=0x7f064c007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:12.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.212+0000 7f065aa00640 1 -- 172.21.15.5:0/2601434449 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c012630 con 0x7f06640af830 2024-08-17T02:27:12.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.212+0000 7f065aa00640 1 -- 172.21.15.5:0/2601434449 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c0127d0 con 0x7f06640af830 2024-08-17T02:27:12.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.212+0000 7f0668e00640 1 -- 172.21.15.5:0/2601434449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0664098390 con 0x7f06640af830 2024-08-17T02:27:12.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.212+0000 7f065aa00640 1 -- 172.21.15.5:0/2601434449 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c012b90 con 0x7f06640af830 2024-08-17T02:27:12.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.212+0000 7f0668e00640 1 -- 172.21.15.5:0/2601434449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0664098950 con 0x7f06640af830 2024-08-17T02:27:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.213+0000 7f0668e00640 1 -- 172.21.15.5:0/2601434449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0664063f10 con 0x7f06640af830 2024-08-17T02:27:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.214+0000 7f065aa00640 1 -- 172.21.15.5:0/2601434449 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f064c01b400 con 0x7f06640af830 2024-08-17T02:27:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.215+0000 7f065aa00640 1 --2- 172.21.15.5:0/2601434449 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0640065150 0x7f0640067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.215+0000 7f065aa00640 1 -- 172.21.15.5:0/2601434449 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f064c081d50 con 0x7f06640af830 2024-08-17T02:27:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.215+0000 7f0663400640 1 --2- 172.21.15.5:0/2601434449 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0640065150 0x7f0640067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.215+0000 7f065aa00640 1 --2- 172.21.15.5:0/2601434449 >> [v2:172.21.15.87:6816/37679,v1:172.21.15.87:6817/37679] conn(0x7f064006b040 0x7f064006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.215+0000 7f065aa00640 1 -- 172.21.15.5:0/2601434449 --> [v2:172.21.15.87:6816/37679,v1:172.21.15.87:6817/37679] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f064006db00 con 0x7f064006b040 2024-08-17T02:27:12.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.215+0000 7f065aa00640 1 -- 172.21.15.5:0/2601434449 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f064c0842b0 con 0x7f06640af830 2024-08-17T02:27:12.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.216+0000 7f0663e00640 1 --2- 172.21.15.5:0/2601434449 >> [v2:172.21.15.87:6816/37679,v1:172.21.15.87:6817/37679] conn(0x7f064006b040 0x7f064006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.216+0000 7f0663400640 1 --2- 172.21.15.5:0/2601434449 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0640065150 0x7f0640067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f06640697d0 tx=0x7f0654009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:12.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.216+0000 7f0663e00640 1 --2- 172.21.15.5:0/2601434449 >> [v2:172.21.15.87:6816/37679,v1:172.21.15.87:6817/37679] conn(0x7f064006b040 0x7f064006d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:12.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.217+0000 7f065aa00640 1 -- 172.21.15.5:0/2601434449 <== osd.7 v2:172.21.15.87:6816/37679 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f064006db00 con 0x7f064006b040 2024-08-17T02:27:12.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.230+0000 7f0668e00640 1 -- 172.21.15.5:0/2601434449 --> [v2:172.21.15.87:6816/37679,v1:172.21.15.87:6817/37679] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f06640b0e40 con 0x7f064006b040 2024-08-17T02:27:12.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.231+0000 7f065aa00640 1 -- 172.21.15.5:0/2601434449 <== osd.7 v2:172.21.15.87:6816/37679 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f06640b0e40 con 0x7f064006b040 2024-08-17T02:27:12.232 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:27:12.232 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:27:12.232 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:27:12.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.231+0000 7f0668e00640 1 -- 172.21.15.5:0/2601434449 >> [v2:172.21.15.87:6816/37679,v1:172.21.15.87:6817/37679] conn(0x7f064006b040 msgr2=0x7f064006d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.231+0000 7f0668e00640 1 --2- 172.21.15.5:0/2601434449 >> [v2:172.21.15.87:6816/37679,v1:172.21.15.87:6817/37679] conn(0x7f064006b040 0x7f064006d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.231+0000 7f0668e00640 1 -- 172.21.15.5:0/2601434449 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0640065150 msgr2=0x7f0640067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.231+0000 7f0668e00640 1 --2- 172.21.15.5:0/2601434449 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f0640065150 0x7f0640067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f06640697d0 tx=0x7f0654009040 comp rx=0 tx=0).stop 2024-08-17T02:27:12.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.231+0000 7f0668e00640 1 -- 172.21.15.5:0/2601434449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06640af830 msgr2=0x7f0664097260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.231+0000 7f0668e00640 1 --2- 172.21.15.5:0/2601434449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06640af830 0x7f0664097260 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f064c00c5b0 tx=0x7f064c007d60 comp rx=0 tx=0).stop 2024-08-17T02:27:12.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.231+0000 7f0663e00640 1 -- 172.21.15.5:0/2601434449 reap_dead start 2024-08-17T02:27:12.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.231+0000 7f0668e00640 1 -- 172.21.15.5:0/2601434449 shutdown_connections 2024-08-17T02:27:12.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.231+0000 7f0668e00640 1 -- 172.21.15.5:0/2601434449 >> 172.21.15.5:0/2601434449 conn(0x7f0664066e60 msgr2=0x7f06640b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:12.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.231+0000 7f0668e00640 1 -- 172.21.15.5:0/2601434449 shutdown_connections 2024-08-17T02:27:12.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.231+0000 7f0668e00640 1 -- 172.21.15.5:0/2601434449 wait complete. 2024-08-17T02:27:12.245 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:27:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.397+0000 7fb720000640 1 Processor -- start 2024-08-17T02:27:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.397+0000 7fb720000640 1 -- start start 2024-08-17T02:27:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.398+0000 7fb720000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7180add30 0x7fb718156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.398+0000 7fb720000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7180cb160 con 0x7fb7180ad960 2024-08-17T02:27:12.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.398+0000 7fb720000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7180b0d10 con 0x7fb7180ca050 2024-08-17T02:27:12.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.398+0000 7fb720000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180ca550 con 0x7fb7180add30 2024-08-17T02:27:12.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.398+0000 7fb71d600640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb7180ad960 0x7fb718156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37526/0 (socket says 172.21.15.5:37526) 2024-08-17T02:27:12.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.398+0000 7fb71d600640 1 -- 172.21.15.5:0/882330850 learned_addr learned my addr 172.21.15.5:0/882330850 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:12.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.398+0000 7fb71e000640 1 --2- 172.21.15.5:0/882330850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7180add30 0x7fb718156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.399+0000 7fb717e00640 1 -- 172.21.15.5:0/882330850 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222863729 0 0) 0x7fb7180cb160 con 0x7fb7180ad960 2024-08-17T02:27:12.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.399+0000 7fb717e00640 1 -- 172.21.15.5:0/882330850 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7000034e0 con 0x7fb7180ad960 2024-08-17T02:27:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.399+0000 7fb717e00640 1 -- 172.21.15.5:0/882330850 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011254750 0 0) 0x7fb7180b0d10 con 0x7fb7180ca050 2024-08-17T02:27:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.399+0000 7fb717e00640 1 -- 172.21.15.5:0/882330850 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7180cb160 con 0x7fb7180ca050 2024-08-17T02:27:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.399+0000 7fb71e000640 1 -- 172.21.15.5:0/882330850 >> v1:172.21.15.87:6789/0 conn(0x7fb7180ca050 legacy=0x7fb7180aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.399+0000 7fb71e000640 1 -- 172.21.15.5:0/882330850 >> v1:172.21.15.5:6789/0 conn(0x7fb7180ad960 legacy=0x7fb718156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.399+0000 7fb717e00640 1 -- 172.21.15.5:0/882330850 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2326565404 0 0) 0x7fb7000034e0 con 0x7fb7180ad960 2024-08-17T02:27:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.399+0000 7fb71e000640 1 -- 172.21.15.5:0/882330850 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7180ca830 con 0x7fb7180add30 2024-08-17T02:27:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.400+0000 7fb71e000640 1 --2- 172.21.15.5:0/882330850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7180add30 0x7fb718156b30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb710009e90 tx=0x7fb710009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd5145454ff46c91 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.401+0000 7fb717e00640 1 -- 172.21.15.5:0/882330850 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c001470 con 0x7fb7180add30 2024-08-17T02:27:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.401+0000 7fb717e00640 1 -- 172.21.15.5:0/882330850 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71002d050 con 0x7fb7180add30 2024-08-17T02:27:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.401+0000 7fb717e00640 1 -- 172.21.15.5:0/882330850 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710031630 con 0x7fb7180add30 2024-08-17T02:27:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.401+0000 7fb720000640 1 -- 172.21.15.5:0/882330850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7180add30 msgr2=0x7fb718156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.401+0000 7fb720000640 1 --2- 172.21.15.5:0/882330850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7180add30 0x7fb718156b30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb710009e90 tx=0x7fb710009780 comp rx=0 tx=0).stop 2024-08-17T02:27:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.401+0000 7fb720000640 1 -- 172.21.15.5:0/882330850 shutdown_connections 2024-08-17T02:27:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.401+0000 7fb720000640 1 --2- 172.21.15.5:0/882330850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7180add30 0x7fb718156b30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.401+0000 7fb720000640 1 -- 172.21.15.5:0/882330850 >> 172.21.15.5:0/882330850 conn(0x7fb718066e60 msgr2=0x7fb718067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.401+0000 7fb720000640 1 -- 172.21.15.5:0/882330850 shutdown_connections 2024-08-17T02:27:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.401+0000 7fb720000640 1 -- 172.21.15.5:0/882330850 wait complete. 2024-08-17T02:27:12.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.403+0000 7fb720000640 1 Processor -- start 2024-08-17T02:27:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.403+0000 7fb720000640 1 -- start start 2024-08-17T02:27:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.404+0000 7fb720000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7180ad960 0x7fb718169dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.404+0000 7fb720000640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7180add30 0x7fb71806a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.404+0000 7fb720000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7180ca050 0x7fb71806ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.404+0000 7fb720000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb718157240 con 0x7fb7180ca050 2024-08-17T02:27:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.404+0000 7fb720000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180a9760 con 0x7fb7180ad960 2024-08-17T02:27:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.404+0000 7fb720000640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180a9a40 con 0x7fb7180add30 2024-08-17T02:27:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.404+0000 7fb71e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7180ca050 0x7fb71806ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.404+0000 7fb71d600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7180ad960 0x7fb718169dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.404+0000 7fb71e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7180ca050 0x7fb71806ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60846/0 (socket says 172.21.15.5:60846) 2024-08-17T02:27:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.404+0000 7fb71d600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7180ad960 0x7fb718169dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.5:33200/0 (socket says 172.21.15.5:33200) 2024-08-17T02:27:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.404+0000 7fb71e000640 1 -- 172.21.15.5:0/899454046 learned_addr learned my addr 172.21.15.5:0/899454046 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.404+0000 7fb71cc00640 1 --2- 172.21.15.5:0/899454046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7180add30 0x7fb71806a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.404+0000 7fb71e000640 1 -- 172.21.15.5:0/899454046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7180add30 msgr2=0x7fb71806a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.405+0000 7fb71e000640 1 --2- 172.21.15.5:0/899454046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7180add30 0x7fb71806a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.405+0000 7fb71e000640 1 -- 172.21.15.5:0/899454046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7180ad960 msgr2=0x7fb718169dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.405+0000 7fb71e000640 1 --2- 172.21.15.5:0/899454046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7180ad960 0x7fb718169dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.405+0000 7fb71e000640 1 -- 172.21.15.5:0/899454046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710009a20 con 0x7fb7180ca050 2024-08-17T02:27:12.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.405+0000 7fb71d600640 1 --2- 172.21.15.5:0/899454046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7180ad960 0x7fb718169dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:12.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.405+0000 7fb71e000640 1 --2- 172.21.15.5:0/899454046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7180ca050 0x7fb71806ad40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb710009e90 tx=0x7fb710037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:12.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.405+0000 7fb714c00640 1 -- 172.21.15.5:0/899454046 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71003ba70 con 0x7fb7180ca050 2024-08-17T02:27:12.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.405+0000 7fb714c00640 1 -- 172.21.15.5:0/899454046 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb710040070 con 0x7fb7180ca050 2024-08-17T02:27:12.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.405+0000 7fb714c00640 1 -- 172.21.15.5:0/899454046 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71003be20 con 0x7fb7180ca050 2024-08-17T02:27:12.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.405+0000 7fb720000640 1 -- 172.21.15.5:0/899454046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7180a9d20 con 0x7fb7180ca050 2024-08-17T02:27:12.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.405+0000 7fb720000640 1 -- 172.21.15.5:0/899454046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7180a8a30 con 0x7fb7180ca050 2024-08-17T02:27:12.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.407+0000 7fb720000640 1 -- 172.21.15.5:0/899454046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7180a9b80 con 0x7fb7180ca050 2024-08-17T02:27:12.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.407+0000 7fb714c00640 1 -- 172.21.15.5:0/899454046 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb710047690 con 0x7fb7180ca050 2024-08-17T02:27:12.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.408+0000 7fb714c00640 1 --2- 172.21.15.5:0/899454046 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb6f8065150 0x7fb6f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.409+0000 7fb714c00640 1 -- 172.21.15.5:0/899454046 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb710042070 con 0x7fb7180ca050 2024-08-17T02:27:12.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.409+0000 7fb71d600640 1 --2- 172.21.15.5:0/899454046 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb6f8065150 0x7fb6f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.409+0000 7fb71d600640 1 --2- 172.21.15.5:0/899454046 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb6f8065150 0x7fb6f8067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb718154e90 tx=0x7fb70c001b00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:12.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.413+0000 7fb714c00640 1 -- 172.21.15.5:0/899454046 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb7180a9b80 con 0x7fb7180ca050 2024-08-17T02:27:12.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.594+0000 7fb720000640 1 -- 172.21.15.5:0/899454046 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7180a9b80 con 0x7fb6f8065150 2024-08-17T02:27:12.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.595+0000 7fb714c00640 1 -- 172.21.15.5:0/899454046 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb7180a9b80 con 0x7fb6f8065150 2024-08-17T02:27:12.596 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:27:12.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.597+0000 7fb720000640 1 -- 172.21.15.5:0/899454046 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb6f8065150 msgr2=0x7fb6f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.597+0000 7fb720000640 1 --2- 172.21.15.5:0/899454046 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb6f8065150 0x7fb6f8067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb718154e90 tx=0x7fb70c001b00 comp rx=0 tx=0).stop 2024-08-17T02:27:12.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.597+0000 7fb720000640 1 -- 172.21.15.5:0/899454046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7180ca050 msgr2=0x7fb71806ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.597+0000 7fb720000640 1 --2- 172.21.15.5:0/899454046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7180ca050 0x7fb71806ad40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb710009e90 tx=0x7fb710037000 comp rx=0 tx=0).stop 2024-08-17T02:27:12.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.597+0000 7fb720000640 1 -- 172.21.15.5:0/899454046 shutdown_connections 2024-08-17T02:27:12.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.597+0000 7fb720000640 1 --2- 172.21.15.5:0/899454046 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7fb6f8065150 0x7fb6f8067600 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.597+0000 7fb720000640 1 --2- 172.21.15.5:0/899454046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7180add30 0x7fb71806a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.597+0000 7fb720000640 1 --2- 172.21.15.5:0/899454046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7180ca050 0x7fb71806ad40 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.597+0000 7fb720000640 1 --2- 172.21.15.5:0/899454046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7180ad960 0x7fb718169dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.597+0000 7fb720000640 1 -- 172.21.15.5:0/899454046 >> 172.21.15.5:0/899454046 conn(0x7fb718066e60 msgr2=0x7fb7181515d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:12.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.597+0000 7fb720000640 1 -- 172.21.15.5:0/899454046 shutdown_connections 2024-08-17T02:27:12.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.597+0000 7fb720000640 1 -- 172.21.15.5:0/899454046 wait complete. 2024-08-17T02:27:12.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:12.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.765+0000 7f5b27200640 1 Processor -- start 2024-08-17T02:27:12.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.765+0000 7f5b27200640 1 -- start start 2024-08-17T02:27:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.766+0000 7f5b27200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5b2815a490 0x7f5b280ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.766+0000 7f5b27200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2815b6b0 con 0x7f5b280b1920 2024-08-17T02:27:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.766+0000 7f5b27200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2815aac0 con 0x7f5b28158c60 2024-08-17T02:27:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.766+0000 7f5b27200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b280b0540 con 0x7f5b2815a490 2024-08-17T02:27:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.766+0000 7f5b26800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5b280b1920 0x7f5b280b1d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37532/0 (socket says 172.21.15.5:37532) 2024-08-17T02:27:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.766+0000 7f5b26800640 1 -- 172.21.15.5:0/150416252 learned_addr learned my addr 172.21.15.5:0/150416252 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.767+0000 7f5b25400640 1 --2- 172.21.15.5:0/150416252 >> v2:172.21.15.87:3300/0 conn(0x7f5b2815a490 0x7f5b280ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.767+0000 7f5b24a00640 1 -- 172.21.15.5:0/150416252 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101519898 0 0) 0x7f5b2815b6b0 con 0x7f5b280b1920 2024-08-17T02:27:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.767+0000 7f5b24a00640 1 -- 172.21.15.5:0/150416252 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b0c0034e0 con 0x7f5b280b1920 2024-08-17T02:27:12.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.767+0000 7f5b24a00640 1 -- 172.21.15.5:0/150416252 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573687227 0 0) 0x7f5b2815aac0 con 0x7f5b28158c60 2024-08-17T02:27:12.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.767+0000 7f5b24a00640 1 -- 172.21.15.5:0/150416252 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b2815b6b0 con 0x7f5b28158c60 2024-08-17T02:27:12.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.767+0000 7f5b25400640 1 -- 172.21.15.5:0/150416252 >> v1:172.21.15.87:6789/0 conn(0x7f5b28158c60 legacy=0x7f5b28159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.767+0000 7f5b25400640 1 -- 172.21.15.5:0/150416252 >> v1:172.21.15.5:6789/0 conn(0x7f5b280b1920 legacy=0x7f5b280b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.767+0000 7f5b25400640 1 -- 172.21.15.5:0/150416252 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2815ad80 con 0x7f5b2815a490 2024-08-17T02:27:12.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.768+0000 7f5b25400640 1 --2- 172.21.15.5:0/150416252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b2815a490 0x7f5b280ca8b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009850 tx=0x7f5b140090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=813b45e32fe7acb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:12.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.769+0000 7f5b24a00640 1 -- 172.21.15.5:0/150416252 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1402ad90 con 0x7f5b2815a490 2024-08-17T02:27:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.769+0000 7f5b24a00640 1 -- 172.21.15.5:0/150416252 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b14032440 con 0x7f5b2815a490 2024-08-17T02:27:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.769+0000 7f5b24a00640 1 -- 172.21.15.5:0/150416252 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b140327c0 con 0x7f5b2815a490 2024-08-17T02:27:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.769+0000 7f5b27200640 1 -- 172.21.15.5:0/150416252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b2815a490 msgr2=0x7f5b280ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.769+0000 7f5b27200640 1 --2- 172.21.15.5:0/150416252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b2815a490 0x7f5b280ca8b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009850 tx=0x7f5b140090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.769+0000 7f5b27200640 1 -- 172.21.15.5:0/150416252 shutdown_connections 2024-08-17T02:27:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.769+0000 7f5b27200640 1 --2- 172.21.15.5:0/150416252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b2815a490 0x7f5b280ca8b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.769+0000 7f5b27200640 1 -- 172.21.15.5:0/150416252 >> 172.21.15.5:0/150416252 conn(0x7f5b2806e590 msgr2=0x7f5b2806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.769+0000 7f5b27200640 1 -- 172.21.15.5:0/150416252 shutdown_connections 2024-08-17T02:27:12.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.769+0000 7f5b27200640 1 -- 172.21.15.5:0/150416252 wait complete. 2024-08-17T02:27:12.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.771+0000 7f5b27200640 1 Processor -- start 2024-08-17T02:27:12.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.771+0000 7f5b27200640 1 -- start start 2024-08-17T02:27:12.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.772+0000 7f5b27200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b280b1920 0x7f5b2814a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.772+0000 7f5b27200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b28158c60 0x7f5b280c3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.772+0000 7f5b27200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2815a490 0x7f5b2815e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.772+0000 7f5b27200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2815dc00 con 0x7f5b2815a490 2024-08-17T02:27:12.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.772+0000 7f5b27200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2815dee0 con 0x7f5b28158c60 2024-08-17T02:27:12.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.772+0000 7f5b27200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2815e1c0 con 0x7f5b280b1920 2024-08-17T02:27:12.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.772+0000 7f5b26800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2815a490 0x7f5b2815e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.772+0000 7f5b26800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2815a490 0x7f5b2815e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60858/0 (socket says 172.21.15.5:60858) 2024-08-17T02:27:12.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.772+0000 7f5b26800640 1 -- 172.21.15.5:0/2195152168 learned_addr learned my addr 172.21.15.5:0/2195152168 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:12.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.772+0000 7f5b25400640 1 --2- 172.21.15.5:0/2195152168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b28158c60 0x7f5b280c3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.772+0000 7f5b25e00640 1 --2- 172.21.15.5:0/2195152168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b280b1920 0x7f5b2814a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.772+0000 7f5b26800640 1 -- 172.21.15.5:0/2195152168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b280b1920 msgr2=0x7f5b2814a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.772+0000 7f5b26800640 1 --2- 172.21.15.5:0/2195152168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b280b1920 0x7f5b2814a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.772+0000 7f5b26800640 1 -- 172.21.15.5:0/2195152168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b28158c60 msgr2=0x7f5b280c3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.772+0000 7f5b26800640 1 --2- 172.21.15.5:0/2195152168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b28158c60 0x7f5b280c3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.772+0000 7f5b26800640 1 -- 172.21.15.5:0/2195152168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b14009390 con 0x7f5b2815a490 2024-08-17T02:27:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.772+0000 7f5b25400640 1 --2- 172.21.15.5:0/2195152168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b28158c60 0x7f5b280c3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.773+0000 7f5b26800640 1 --2- 172.21.15.5:0/2195152168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2815a490 0x7f5b2815e9c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000cc80 tx=0x7f5b20001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.773+0000 7f5b1d600640 1 -- 172.21.15.5:0/2195152168 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2000cea0 con 0x7f5b2815a490 2024-08-17T02:27:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.773+0000 7f5b1d600640 1 -- 172.21.15.5:0/2195152168 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2000a850 con 0x7f5b2815a490 2024-08-17T02:27:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.773+0000 7f5b1d600640 1 -- 172.21.15.5:0/2195152168 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2000ac30 con 0x7f5b2815a490 2024-08-17T02:27:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.773+0000 7f5b27200640 1 -- 172.21.15.5:0/2195152168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2815e4a0 con 0x7f5b2815a490 2024-08-17T02:27:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.773+0000 7f5b27200640 1 -- 172.21.15.5:0/2195152168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b280c3ff0 con 0x7f5b2815a490 2024-08-17T02:27:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.774+0000 7f5b27200640 1 -- 172.21.15.5:0/2195152168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b280c4240 con 0x7f5b2815a490 2024-08-17T02:27:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.775+0000 7f5b1d600640 1 -- 172.21.15.5:0/2195152168 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5b20007300 con 0x7f5b2815a490 2024-08-17T02:27:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.776+0000 7f5b1d600640 1 --2- 172.21.15.5:0/2195152168 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5b08065150 0x7f5b08067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.776+0000 7f5b1d600640 1 -- 172.21.15.5:0/2195152168 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5b20082480 con 0x7f5b2815a490 2024-08-17T02:27:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.776+0000 7f5b25e00640 1 --2- 172.21.15.5:0/2195152168 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5b08065150 0x7f5b08067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.777+0000 7f5b25e00640 1 --2- 172.21.15.5:0/2195152168 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5b08065150 0x7f5b08067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5b18000c00 tx=0x7f5b18009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.780+0000 7f5b1d600640 1 -- 172.21.15.5:0/2195152168 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5b20050800 con 0x7f5b2815a490 2024-08-17T02:27:12.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.959+0000 7f5b27200640 1 -- 172.21.15.5:0/2195152168 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b2815e050 con 0x7f5b08065150 2024-08-17T02:27:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.961+0000 7f5b1d600640 1 -- 172.21.15.5:0/2195152168 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51305 (secure 0 0 0) 0x7f5b2815e050 con 0x7f5b08065150 2024-08-17T02:27:12.962 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:27:12.962 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:27:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.963+0000 7f5b27200640 1 -- 172.21.15.5:0/2195152168 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5b08065150 msgr2=0x7f5b08067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.963+0000 7f5b27200640 1 --2- 172.21.15.5:0/2195152168 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5b08065150 0x7f5b08067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5b18000c00 tx=0x7f5b18009040 comp rx=0 tx=0).stop 2024-08-17T02:27:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.963+0000 7f5b27200640 1 -- 172.21.15.5:0/2195152168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2815a490 msgr2=0x7f5b2815e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.963+0000 7f5b27200640 1 --2- 172.21.15.5:0/2195152168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2815a490 0x7f5b2815e9c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000cc80 tx=0x7f5b20001ae0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.963+0000 7f5b27200640 1 -- 172.21.15.5:0/2195152168 shutdown_connections 2024-08-17T02:27:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.963+0000 7f5b27200640 1 --2- 172.21.15.5:0/2195152168 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5b08065150 0x7f5b08067600 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.963+0000 7f5b27200640 1 --2- 172.21.15.5:0/2195152168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2815a490 0x7f5b2815e9c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.963+0000 7f5b27200640 1 --2- 172.21.15.5:0/2195152168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b28158c60 0x7f5b280c3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.963+0000 7f5b27200640 1 --2- 172.21.15.5:0/2195152168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b280b1920 0x7f5b2814a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.963+0000 7f5b27200640 1 -- 172.21.15.5:0/2195152168 >> 172.21.15.5:0/2195152168 conn(0x7f5b2806e590 msgr2=0x7f5b280cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.963+0000 7f5b27200640 1 -- 172.21.15.5:0/2195152168 shutdown_connections 2024-08-17T02:27:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:12.963+0000 7f5b27200640 1 -- 172.21.15.5:0/2195152168 wait complete. 2024-08-17T02:27:12.978 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-08-17T02:27:12.773512+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400828,"kb_used_data":5320,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752573892,"statfs":{"total":773094113280,"available":770635665408,"internally_reserved":0,"allocated":5447680,"data_stored":2949176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.697432"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-08-17T02:27:01.565727+0000","last_change":"2024-08-17T02:23:30.651033+0000","last_active":"2024-08-17T02:27:01.565727+0000","last_peered":"2024-08-17T02:27:01.565727+0000","last_clean":"2024-08-17T02:27:01.565727+0000","last_became_active":"2024-08-17T02:23:30.649860+0000","last_became_peered":"2024-08-17T02:23:30.649860+0000","last_unstale":"2024-08-17T02:27:01.565727+0000","last_undegraded":"2024-08-17T02:27:01.565727+0000","last_fullsized":"2024-08-17T02:27:01.565727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:29.523857+0000","last_clean_scrub_stamp":"2024-08-17T02:23:29.523857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:29:35.288625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542191,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298460,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073380,"statfs":{"total":96636764160,"available":96331141120,"internally_reserved":0,"allocated":1126400,"data_stored":811423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.66300000000000003,"15min":0.624},"min":{"1min":0.41499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97099999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.496},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67000000000000004,"15min":0.64300000000000002},"min":{"1min":0.54700000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89500000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.38200000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68799999999999994,"15min":0.66200000000000003},"min":{"1min":0.54300000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65600000000000003,"15min":0.63200000000000001},"min":{"1min":0.51700000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86899999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.54400000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.69999999999999996,"15min":0.66600000000000004},"min":{"1min":0.58999999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97299999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69099999999999995,"15min":0.67700000000000005},"min":{"1min":0.58099999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.51900000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69199999999999995,"15min":0.66800000000000004},"min":{"1min":0.55200000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":0.995,"15min":0.995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.72999999999999998,"15min":0.71399999999999997},"min":{"1min":0.66300000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.92600000000000005,"5min":1.032,"15min":1.032},"last":0.57899999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66700000000000004,"15min":0.68500000000000005},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.64700000000000002,"15min":0.67000000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.73699999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.89700000000000002,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.59299999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.75800000000000001,"15min":0.78300000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95299999999999996,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.74199999999999999,"15min":0.76000000000000001},"min":{"1min":0.48299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95899999999999996,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.68799999999999994}]}]},{"osd":6,"up_from":14,"seq":60129542192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297880,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":532480,"data_stored":221055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.68000000000000005},"min":{"1min":0.57599999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84199999999999997,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.57199999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86399999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.57699999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.70399999999999996,"15min":0.68200000000000005},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94099999999999995,"5min":1.111,"15min":1.111},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91100000000000003,"5min":3.444,"15min":3.444},"last":0.65100000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.83299999999999996,"15min":0.85799999999999998},"min":{"1min":0.67100000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.878,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.84199999999999997,"15min":0.86599999999999999},"min":{"1min":0.65800000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97899999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":0.67800000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72699999999999998,"15min":0.71899999999999997},"min":{"1min":0.60899999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.86899999999999999,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.67400000000000004,"15min":0.64500000000000002},"min":{"1min":0.63300000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88800000000000001,"5min":1.087,"15min":1.087},"last":0.51700000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.624,"15min":0.61899999999999999},"min":{"1min":0.42999999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89800000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.52900000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81499999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.82799999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.52100000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78200000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.52800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.89000000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.75800000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72499999999999998,"15min":0.73499999999999999},"min":{"1min":0.55800000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80500000000000005,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.71299999999999997,"15min":0.71899999999999997},"min":{"1min":0.54900000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.78900000000000003,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.81899999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":532480,"data_stored":221055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.56699999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88800000000000001,"5min":1.022,"15min":1.022},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68799999999999994,"15min":0.68100000000000005},"min":{"1min":0.58699999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.879,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.63200000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.56299999999999994,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98399999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.67700000000000005,"15min":0.66100000000000003},"min":{"1min":0.57499999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90300000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.66100000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.61199999999999999,"5min":0.497,"15min":0.497},"max":{"1min":0.93100000000000005,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.75700000000000001,"15min":0.78500000000000003},"min":{"1min":0.59599999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91100000000000003,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":0.69699999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.63100000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88300000000000001,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.80900000000000005,"15min":0.84399999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96199999999999997,"5min":3.665,"15min":3.665},"last":0.78700000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.62,"15min":0.63900000000000001},"min":{"1min":0.44500000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.752,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.66700000000000004},"min":{"1min":0.47899999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.76400000000000001,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.57399999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66900000000000004,"15min":0.68300000000000005},"min":{"1min":0.48899999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80900000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.755},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68100000000000005,"15min":0.69599999999999995},"min":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84899999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.82199999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72699999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.748},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.53700000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93000000000000005,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.83599999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542191,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297880,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":532480,"data_stored":221055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67700000000000005,"15min":0.69199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.753,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.441,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.85699999999999998,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81100000000000005,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.68000000000000005,"15min":0.67400000000000004},"min":{"1min":0.46100000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.88,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.50900000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76000000000000001,"15min":0.75800000000000001},"min":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.53300000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90800000000000003,"5min":1.272,"15min":1.272},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.93400000000000005,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.52500000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.61599999999999999,"15min":0.65400000000000003},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68899999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.627,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73799999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.46500000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65000000000000002,"15min":0.66300000000000003},"min":{"1min":0.44400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.81999999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.69699999999999995,"15min":0.73099999999999998},"min":{"1min":0.45900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75700000000000001,"5min":1.018,"15min":1.018},"last":0.495}]},{"osd":7,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69499999999999995,"15min":0.70699999999999996},"min":{"1min":0.51400000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82199999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.51400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88500000000000001,"5min":1.004,"15min":1.004},"last":0.48499999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302036,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069804,"statfs":{"total":96636764160,"available":96327479296,"internally_reserved":0,"allocated":532480,"data_stored":221055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66700000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45200000000000001,"15min":0.44},"min":{"1min":0.36699999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70399999999999996,"5min":0.755,"15min":0.755},"last":0.38300000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.59699999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.67500000000000004,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.46500000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.54200000000000004},"min":{"1min":0.38900000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73299999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.51200000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.76200000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.48999999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.79800000000000004,"15min":0.79600000000000004},"min":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0409999999999999,"5min":1.173,"15min":1.173},"last":0.56100000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96599999999999997,"5min":1.075,"15min":1.075},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.56299999999999994,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0189999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63600000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.67400000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.03,"5min":1.179,"15min":1.179},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.78700000000000003,"15min":0.78600000000000003},"min":{"1min":0.53700000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0760000000000001,"5min":1.218,"15min":1.218},"last":0.65200000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79400000000000004,"15min":0.79100000000000004},"min":{"1min":0.58899999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.036,"5min":1.145,"15min":1.145},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.78900000000000003,"15min":0.78200000000000003},"min":{"1min":0.63800000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.0860000000000001,"5min":1.202,"15min":1.202},"last":0.58599999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542191,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302040,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069800,"statfs":{"total":96636764160,"available":96327475200,"internally_reserved":0,"allocated":532480,"data_stored":221055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.34599999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.86799999999999999,"5min":1.855,"15min":1.855},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65100000000000002,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.42099999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.53400000000000003,"15min":0.55400000000000005},"min":{"1min":0.34899999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.60699999999999998,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.56599999999999995,"15min":0.54000000000000004},"min":{"1min":0.39900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90300000000000002,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.441}]},{"osd":3,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.36199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81200000000000006,"5min":2.302,"15min":2.302},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64900000000000002,"15min":0.63300000000000001},"min":{"1min":0.48899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93799999999999994,"5min":1.819,"15min":1.819},"last":0.49399999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79700000000000004,"15min":0.76700000000000002},"min":{"1min":0.61499999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0489999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84199999999999997,"15min":0.84899999999999998},"min":{"1min":0.61299999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0920000000000001,"5min":1.732,"15min":1.732},"last":0.58099999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.82399999999999995,"15min":0.82599999999999996},"min":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1919999999999999,"5min":1.474,"15min":1.474},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.83399999999999996,"15min":0.84399999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.075,"5min":2.198,"15min":2.198},"last":0.74199999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.88600000000000001,"15min":0.90200000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.224,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.84599999999999997,"15min":0.83199999999999996},"min":{"1min":0.67100000000000004,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1659999999999999,"5min":1.571,"15min":1.571},"last":0.80600000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:26:31 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.86299999999999999,"15min":0.86899999999999999},"min":{"1min":0.59099999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.089,"5min":1.675,"15min":1.675},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.874,"5min":0.92500000000000004,"15min":0.94299999999999995},"min":{"1min":0.64800000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.125,"5min":2.234,"15min":2.234},"last":0.81999999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302036,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069804,"statfs":{"total":96636764160,"available":96327479296,"internally_reserved":0,"allocated":532480,"data_stored":221055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.501,"15min":0.53300000000000003},"min":{"1min":0.31,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55900000000000005,"5min":1.968,"15min":1.968},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.5,"15min":0.497},"min":{"1min":0.34599999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.67300000000000004,"5min":1.28,"15min":1.28},"last":0.80100000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.56999999999999995,"15min":0.60699999999999998},"min":{"1min":0.36199999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69299999999999995,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.755},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.69899999999999995,"15min":0.753},"min":{"1min":0.38200000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82199999999999995,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":0.67000000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.65600000000000003,"15min":0.69799999999999995},"min":{"1min":0.42599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73099999999999998,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":0.47999999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.85799999999999998,"15min":0.89600000000000002},"min":{"1min":0.53100000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96999999999999997,"5min":2.544,"15min":2.544},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.92900000000000005,"15min":0.98299999999999998},"min":{"1min":0.65000000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0569999999999999,"5min":3.6480000000000001,"15min":3.6480000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80400000000000005,"15min":0.83399999999999996},"min":{"1min":0.63500000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98699999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.84399999999999997,"15min":0.879},"min":{"1min":0.64600000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0800000000000001,"5min":2.4630000000000001,"15min":2.4630000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.88200000000000001,"15min":0.93600000000000005},"min":{"1min":0.66400000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.997,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.85099999999999998,"15min":0.88500000000000001},"min":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.94999999999999996,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":0.61199999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.86699999999999999,"15min":0.89800000000000002},"min":{"1min":0.65600000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.04,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.88300000000000001,"15min":0.92100000000000004},"min":{"1min":0.68000000000000005,"5min":0.502,"15min":0.502},"max":{"1min":1.024,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.64400000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542192,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302620,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069220,"statfs":{"total":96636764160,"available":96326881280,"internally_reserved":0,"allocated":1126400,"data_stored":811423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.46500000000000002,"15min":0.48899999999999999},"min":{"1min":0.33100000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.44900000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.377,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.89500000000000002,"5min":2.254,"15min":2.254},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.57799999999999996,"15min":0.60399999999999998},"min":{"1min":0.41499999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63400000000000001,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63,"15min":0.65200000000000002},"min":{"1min":0.48499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.748,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.59299999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54400000000000004,"15min":0.56000000000000005},"min":{"1min":0.35799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.66200000000000003,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63900000000000001,"15min":0.64800000000000002},"min":{"1min":0.48699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82699999999999996,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":0.66600000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.754,"15min":0.749},"min":{"1min":0.60999999999999999,"5min":0.498,"15min":0.498},"max":{"1min":0.90400000000000003,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58899999999999997,"5min":0.432,"15min":0.432},"max":{"1min":0.99399999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.84099999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.69199999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":0.879,"5min":1.321,"15min":1.321},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.65100000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0289999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.60099999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.90200000000000002,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.61899999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.89400000000000002,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82999999999999996,"15min":0.84199999999999997},"min":{"1min":0.61399999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.99299999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.81799999999999995,"15min":0.82899999999999996},"min":{"1min":0.58299999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96099999999999997,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.76900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:12.982 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:23:29.523857+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=23, tm_sec=29, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=27, tm_sec=6, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:27:12.983 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:27:32.984 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:33.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.147+0000 7f4dbf200640 1 Processor -- start 2024-08-17T02:27:33.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.147+0000 7f4dbf200640 1 -- start start 2024-08-17T02:27:33.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.148+0000 7f4dbf200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4dc015a490 0x7f4dc00ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.148+0000 7f4dbf200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4dc00b1920 0x7f4dc00b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.148+0000 7f4dbf200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc015a880 con 0x7f4dc0158c60 2024-08-17T02:27:33.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.148+0000 7f4dbf200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc00b0540 con 0x7f4dc00b1920 2024-08-17T02:27:33.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.148+0000 7f4dbf200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc015b6b0 con 0x7f4dc015a490 2024-08-17T02:27:33.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.148+0000 7f4dbde00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4dc0158c60 0x7f4dc0159030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59428/0 (socket says 172.21.15.5:59428) 2024-08-17T02:27:33.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.148+0000 7f4dbde00640 1 -- 172.21.15.5:0/2280713388 learned_addr learned my addr 172.21.15.5:0/2280713388 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:27:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.148+0000 7f4dbe800640 1 --2- 172.21.15.5:0/2280713388 >> v2:172.21.15.87:3300/0 conn(0x7f4dc00b1920 0x7f4dc00b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.148+0000 7f4dbd400640 1 --2- 172.21.15.5:0/2280713388 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4dc015a490 0x7f4dc00ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.149+0000 7f4dbca00640 1 -- 172.21.15.5:0/2280713388 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945139942 0 0) 0x7f4db0001110 con 0x7f4dc0158c60 2024-08-17T02:27:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.149+0000 7f4dbca00640 1 -- 172.21.15.5:0/2280713388 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4da40034e0 con 0x7f4dc0158c60 2024-08-17T02:27:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.149+0000 7f4dbe800640 1 -- 172.21.15.5:0/2280713388 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4dc015a490 msgr2=0x7f4dc00ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.149+0000 7f4dbe800640 1 --2- 172.21.15.5:0/2280713388 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4dc015a490 0x7f4dc00ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.149+0000 7f4dbe800640 1 -- 172.21.15.5:0/2280713388 >> v1:172.21.15.5:6789/0 conn(0x7f4dc0158c60 legacy=0x7f4dc0159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.149+0000 7f4dbe800640 1 -- 172.21.15.5:0/2280713388 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc015aac0 con 0x7f4dc00b1920 2024-08-17T02:27:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.149+0000 7f4dbd400640 1 --2- 172.21.15.5:0/2280713388 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4dc015a490 0x7f4dc00ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.150+0000 7f4dbe800640 1 --2- 172.21.15.5:0/2280713388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dc00b1920 0x7f4dc00b1d60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009e60 tx=0x7f4db8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=139e4eb4ae097373 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.150+0000 7f4dbca00640 1 -- 172.21.15.5:0/2280713388 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db8007550 con 0x7f4dc00b1920 2024-08-17T02:27:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.151+0000 7f4dbca00640 1 -- 172.21.15.5:0/2280713388 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db802d050 con 0x7f4dc00b1920 2024-08-17T02:27:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.151+0000 7f4dbca00640 1 -- 172.21.15.5:0/2280713388 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db8007920 con 0x7f4dc00b1920 2024-08-17T02:27:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.151+0000 7f4dbf200640 1 -- 172.21.15.5:0/2280713388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dc00b1920 msgr2=0x7f4dc00b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.151+0000 7f4dbf200640 1 --2- 172.21.15.5:0/2280713388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dc00b1920 0x7f4dc00b1d60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009e60 tx=0x7f4db8009780 comp rx=0 tx=0).stop 2024-08-17T02:27:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.151+0000 7f4dbf200640 1 -- 172.21.15.5:0/2280713388 shutdown_connections 2024-08-17T02:27:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.151+0000 7f4dbf200640 1 --2- 172.21.15.5:0/2280713388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dc00b1920 0x7f4dc00b1d60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.151+0000 7f4dbf200640 1 --2- 172.21.15.5:0/2280713388 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4dc015a490 0x7f4dc00ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.151+0000 7f4dbf200640 1 -- 172.21.15.5:0/2280713388 >> 172.21.15.5:0/2280713388 conn(0x7f4dc006e590 msgr2=0x7f4dc006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.151+0000 7f4dbf200640 1 -- 172.21.15.5:0/2280713388 shutdown_connections 2024-08-17T02:27:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.151+0000 7f4dbf200640 1 -- 172.21.15.5:0/2280713388 wait complete. 2024-08-17T02:27:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.153+0000 7f4dbf200640 1 Processor -- start 2024-08-17T02:27:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.153+0000 7f4dbf200640 1 -- start start 2024-08-17T02:27:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.154+0000 7f4dbf200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dc00b1920 0x7f4dc00cf480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.154+0000 7f4dbf200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dc0158c60 0x7f4dc0169620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.154+0000 7f4dbf200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4dc015a490 0x7f4dc00c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.154+0000 7f4dbf200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc00d0700 con 0x7f4dc00b1920 2024-08-17T02:27:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.154+0000 7f4dbf200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc00cfaf0 con 0x7f4dc0158c60 2024-08-17T02:27:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.154+0000 7f4dbf200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc00cfdd0 con 0x7f4dc015a490 2024-08-17T02:27:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.154+0000 7f4dbde00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dc00b1920 0x7f4dc00cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.154+0000 7f4dbde00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dc00b1920 0x7f4dc00cf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34312/0 (socket says 172.21.15.5:34312) 2024-08-17T02:27:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.154+0000 7f4dbde00640 1 -- 172.21.15.5:0/86298775 learned_addr learned my addr 172.21.15.5:0/86298775 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.155+0000 7f4dbd400640 1 --2- 172.21.15.5:0/86298775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dc0158c60 0x7f4dc0169620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.155+0000 7f4dbe800640 1 --2- 172.21.15.5:0/86298775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4dc015a490 0x7f4dc00c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.155+0000 7f4dbde00640 1 -- 172.21.15.5:0/86298775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4dc015a490 msgr2=0x7f4dc00c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.155+0000 7f4dbde00640 1 --2- 172.21.15.5:0/86298775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4dc015a490 0x7f4dc00c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.155+0000 7f4dbde00640 1 -- 172.21.15.5:0/86298775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dc0158c60 msgr2=0x7f4dc0169620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.155+0000 7f4dbde00640 1 --2- 172.21.15.5:0/86298775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dc0158c60 0x7f4dc0169620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.155+0000 7f4dbde00640 1 -- 172.21.15.5:0/86298775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac009390 con 0x7f4dc00b1920 2024-08-17T02:27:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.155+0000 7f4dbe800640 1 --2- 172.21.15.5:0/86298775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4dc015a490 0x7f4dc00c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.155+0000 7f4dbde00640 1 --2- 172.21.15.5:0/86298775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dc00b1920 0x7f4dc00cf480 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4db000c7c0 tx=0x7f4db0007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.155+0000 7f4db5600640 1 -- 172.21.15.5:0/86298775 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db000ce90 con 0x7f4dc00b1920 2024-08-17T02:27:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.156+0000 7f4db5600640 1 -- 172.21.15.5:0/86298775 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db0005870 con 0x7f4dc00b1920 2024-08-17T02:27:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.156+0000 7f4dbf200640 1 -- 172.21.15.5:0/86298775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db8009a20 con 0x7f4dc00b1920 2024-08-17T02:27:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.156+0000 7f4db5600640 1 -- 172.21.15.5:0/86298775 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db0005c90 con 0x7f4dc00b1920 2024-08-17T02:27:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.156+0000 7f4dbf200640 1 -- 172.21.15.5:0/86298775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc00d0390 con 0x7f4dc00b1920 2024-08-17T02:27:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.157+0000 7f4dbf200640 1 -- 172.21.15.5:0/86298775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc0070720 con 0x7f4dc00b1920 2024-08-17T02:27:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.157+0000 7f4db5600640 1 -- 172.21.15.5:0/86298775 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4db0007300 con 0x7f4dc00b1920 2024-08-17T02:27:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.158+0000 7f4db5600640 1 --2- 172.21.15.5:0/86298775 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4da0065150 0x7f4da0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.158+0000 7f4db5600640 1 -- 172.21.15.5:0/86298775 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f4db0081b10 con 0x7f4dc00b1920 2024-08-17T02:27:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.159+0000 7f4dbd400640 1 --2- 172.21.15.5:0/86298775 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4da0065150 0x7f4da0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.159+0000 7f4dbd400640 1 --2- 172.21.15.5:0/86298775 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4da0065150 0x7f4da0067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00c50c0 tx=0x7f4dac0090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.162+0000 7f4db5600640 1 -- 172.21.15.5:0/86298775 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4db004fe50 con 0x7f4dc00b1920 2024-08-17T02:27:33.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.340+0000 7f4dbf200640 1 -- 172.21.15.5:0/86298775 --> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4dc00d0840 con 0x7f4da0065150 2024-08-17T02:27:33.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.342+0000 7f4db5600640 1 -- 172.21.15.5:0/86298775 <== mgr.4101 v2:172.21.15.5:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51264 (secure 0 0 0) 0x7f4dac01a030 con 0x7f4da0065150 2024-08-17T02:27:33.343 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:27:33.344 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:27:33.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.344+0000 7f4dbf200640 1 -- 172.21.15.5:0/86298775 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4da0065150 msgr2=0x7f4da0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.344+0000 7f4dbf200640 1 --2- 172.21.15.5:0/86298775 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4da0065150 0x7f4da0067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00c50c0 tx=0x7f4dac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.344+0000 7f4dbf200640 1 -- 172.21.15.5:0/86298775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dc00b1920 msgr2=0x7f4dc00cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.344+0000 7f4dbf200640 1 --2- 172.21.15.5:0/86298775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dc00b1920 0x7f4dc00cf480 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4db000c7c0 tx=0x7f4db0007be0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.344+0000 7f4dbf200640 1 -- 172.21.15.5:0/86298775 shutdown_connections 2024-08-17T02:27:33.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.344+0000 7f4dbf200640 1 --2- 172.21.15.5:0/86298775 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f4da0065150 0x7f4da0067600 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.344+0000 7f4dbf200640 1 --2- 172.21.15.5:0/86298775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4dc015a490 0x7f4dc00c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.344+0000 7f4dbf200640 1 --2- 172.21.15.5:0/86298775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dc0158c60 0x7f4dc0169620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.344+0000 7f4dbf200640 1 --2- 172.21.15.5:0/86298775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dc00b1920 0x7f4dc00cf480 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.344+0000 7f4dbf200640 1 -- 172.21.15.5:0/86298775 >> 172.21.15.5:0/86298775 conn(0x7f4dc006e590 msgr2=0x7f4dc01548c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.345+0000 7f4dbf200640 1 -- 172.21.15.5:0/86298775 shutdown_connections 2024-08-17T02:27:33.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.345+0000 7f4dbf200640 1 -- 172.21.15.5:0/86298775 wait complete. 2024-08-17T02:27:33.360 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-08-17T02:27:32.777445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400812,"kb_used_data":5320,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752573908,"statfs":{"total":773094113280,"available":770635681792,"internally_reserved":0,"allocated":5447680,"data_stored":2949176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002305"},"pg_stats":[{"pgid":"1.0","version":"45'119","reported_seq":195,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-08-17T02:27:12.894899+0000","last_change":"2024-08-17T02:27:12.894821+0000","last_active":"2024-08-17T02:27:12.894899+0000","last_peered":"2024-08-17T02:27:12.894899+0000","last_clean":"2024-08-17T02:27:12.894899+0000","last_became_active":"2024-08-17T02:23:30.649860+0000","last_became_peered":"2024-08-17T02:23:30.649860+0000","last_unstale":"2024-08-17T02:27:12.894899+0000","last_undegraded":"2024-08-17T02:27:12.894899+0000","last_fullsized":"2024-08-17T02:27:12.894899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'119","last_scrub_stamp":"2024-08-17T02:27:12.894675+0000","last_deep_scrub":"45'119","last_deep_scrub_stamp":"2024-08-17T02:27:12.894675+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.894675+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:48:10.771945+0000","scrub_duration":0.0059722639999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1126400,"data_stored":811423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.66300000000000003,"15min":0.624},"min":{"1min":0.41499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97099999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67000000000000004,"15min":0.64300000000000002},"min":{"1min":0.54700000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89500000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.621}]},{"osd":1,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68799999999999994,"15min":0.66200000000000003},"min":{"1min":0.54300000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65600000000000003,"15min":0.63200000000000001},"min":{"1min":0.51700000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86899999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.60499999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.69999999999999996,"15min":0.66600000000000004},"min":{"1min":0.58999999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97299999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69099999999999995,"15min":0.67700000000000005},"min":{"1min":0.58099999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69899999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69199999999999995,"15min":0.66800000000000004},"min":{"1min":0.55200000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":0.995,"15min":0.995},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.72999999999999998,"15min":0.71399999999999997},"min":{"1min":0.66300000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.92600000000000005,"5min":1.032,"15min":1.032},"last":0.63500000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66700000000000004,"15min":0.68500000000000005},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.51000000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.64700000000000002,"15min":0.67000000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.73699999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.89700000000000002,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.56999999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.75800000000000001,"15min":0.78300000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95299999999999996,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.74199999999999999,"15min":0.76000000000000001},"min":{"1min":0.48299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95899999999999996,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.58499999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297880,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":532480,"data_stored":221055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.68000000000000005},"min":{"1min":0.57599999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84199999999999997,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.57199999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86399999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69499999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.70399999999999996,"15min":0.68200000000000005},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94099999999999995,"5min":1.111,"15min":1.111},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91100000000000003,"5min":3.444,"15min":3.444},"last":0.73499999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.83299999999999996,"15min":0.85799999999999998},"min":{"1min":0.67100000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.878,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.84199999999999997,"15min":0.86599999999999999},"min":{"1min":0.65800000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97899999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":0.76100000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72699999999999998,"15min":0.71899999999999997},"min":{"1min":0.60899999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.86899999999999999,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.67400000000000004,"15min":0.64500000000000002},"min":{"1min":0.63300000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88800000000000001,"5min":1.087,"15min":1.087},"last":0.72199999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.624,"15min":0.61899999999999999},"min":{"1min":0.42999999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89800000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.52900000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81499999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.45700000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.52100000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78200000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.52800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.89000000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.67200000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72499999999999998,"15min":0.73499999999999999},"min":{"1min":0.55800000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80500000000000005,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.71299999999999997,"15min":0.71899999999999997},"min":{"1min":0.54900000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.78900000000000003,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.54100000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297876,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":532480,"data_stored":221055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.56699999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88800000000000001,"5min":1.022,"15min":1.022},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68799999999999994,"15min":0.68100000000000005},"min":{"1min":0.58699999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.879,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.56299999999999994,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98399999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.748},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.67700000000000005,"15min":0.66100000000000003},"min":{"1min":0.57499999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90300000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.61299999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.61199999999999999,"5min":0.497,"15min":0.497},"max":{"1min":0.93100000000000005,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.75700000000000001,"15min":0.78500000000000003},"min":{"1min":0.59599999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91100000000000003,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":0.69099999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.63100000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88300000000000001,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.80900000000000005,"15min":0.84399999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96199999999999997,"5min":3.665,"15min":3.665},"last":0.67000000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.62,"15min":0.63900000000000001},"min":{"1min":0.44500000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.752,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.66700000000000004},"min":{"1min":0.47899999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.76400000000000001,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.627}]},{"osd":6,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66900000000000004,"15min":0.68300000000000005},"min":{"1min":0.48899999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80900000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68100000000000005,"15min":0.69599999999999995},"min":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84899999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.65300000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72699999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.53700000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93000000000000005,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.72999999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542195,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297880,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":532480,"data_stored":221055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67700000000000005,"15min":0.69199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.753,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.441,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.85699999999999998,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.63100000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81100000000000005,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.68000000000000005,"15min":0.67400000000000004},"min":{"1min":0.46100000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.88,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.53000000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76000000000000001,"15min":0.75800000000000001},"min":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.53300000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.73599999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90800000000000003,"5min":1.272,"15min":1.272},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.93400000000000005,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.60399999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.61599999999999999,"15min":0.65400000000000003},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68899999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.627,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73799999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.67000000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65000000000000002,"15min":0.66300000000000003},"min":{"1min":0.44400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.81999999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.69699999999999995,"15min":0.73099999999999998},"min":{"1min":0.45900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75700000000000001,"5min":1.018,"15min":1.018},"last":0.69299999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69499999999999995,"15min":0.70699999999999996},"min":{"1min":0.51400000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82199999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.747},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.51400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88500000000000001,"5min":1.004,"15min":1.004},"last":0.65200000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302036,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069804,"statfs":{"total":96636764160,"available":96327479296,"internally_reserved":0,"allocated":532480,"data_stored":221055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66700000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45200000000000001,"15min":0.44},"min":{"1min":0.36699999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70399999999999996,"5min":0.755,"15min":0.755},"last":0.46600000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.59699999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.67500000000000004,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.52800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.54200000000000004},"min":{"1min":0.38900000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73299999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.51200000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.76200000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.61799999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.79800000000000004,"15min":0.79600000000000004},"min":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0409999999999999,"5min":1.173,"15min":1.173},"last":0.86399999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96599999999999997,"5min":1.075,"15min":1.075},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.56299999999999994,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0189999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.88200000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.67400000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.03,"5min":1.179,"15min":1.179},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.78700000000000003,"15min":0.78600000000000003},"min":{"1min":0.53700000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0760000000000001,"5min":1.218,"15min":1.218},"last":0.72199999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79400000000000004,"15min":0.79100000000000004},"min":{"1min":0.58899999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.036,"5min":1.145,"15min":1.145},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.78900000000000003,"15min":0.78200000000000003},"min":{"1min":0.63800000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.0860000000000001,"5min":1.202,"15min":1.202},"last":0.91600000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542195,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302040,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069800,"statfs":{"total":96636764160,"available":96327475200,"internally_reserved":0,"allocated":532480,"data_stored":221055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:31 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.46999999999999997,"15min":0.48199999999999998},"min":{"1min":0.30499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63600000000000001,"5min":1.855,"15min":1.855},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.35899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64300000000000002,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.495}]},{"osd":1,"last update":"Sat Aug 17 02:27:31 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.50800000000000001,"15min":0.54500000000000004},"min":{"1min":0.311,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.746,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.443},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56599999999999995,"15min":0.54000000000000004},"min":{"1min":0.39300000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66700000000000004,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.60299999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:27:31 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.58999999999999997,"15min":0.60399999999999998},"min":{"1min":0.38100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.90200000000000002,"5min":2.302,"15min":2.302},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.64600000000000002,"15min":0.63200000000000001},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77900000000000003,"5min":1.819,"15min":1.819},"last":0.63800000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:27:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79300000000000004,"15min":0.76600000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.91600000000000004,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0409999999999999,"5min":1.732,"15min":1.732},"last":0.755}]},{"osd":5,"last update":"Sat Aug 17 02:27:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.80500000000000005,"15min":0.81999999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.96699999999999997,"5min":1.474,"15min":1.474},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.81499999999999995,"15min":0.83799999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.073,"5min":2.198,"15min":2.198},"last":0.84399999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:27:31 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.85599999999999998,"15min":0.89200000000000002},"min":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1200000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.83399999999999996,"15min":0.82799999999999996},"min":{"1min":0.61199999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.92700000000000005,"5min":1.571,"15min":1.571},"last":0.81899999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:27:31 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.84399999999999997,"15min":0.86299999999999999},"min":{"1min":0.57199999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0880000000000001,"5min":1.675,"15min":1.675},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":0.93300000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0189999999999999,"5min":2.234,"15min":2.234},"last":0.93300000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302036,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069804,"statfs":{"total":96636764160,"available":96327479296,"internally_reserved":0,"allocated":532480,"data_stored":221055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.501,"15min":0.53300000000000003},"min":{"1min":0.31,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55900000000000005,"5min":1.968,"15min":1.968},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.5,"15min":0.497},"min":{"1min":0.34599999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.67300000000000004,"5min":1.28,"15min":1.28},"last":0.505}]},{"osd":2,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.56999999999999995,"15min":0.60699999999999998},"min":{"1min":0.36199999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69299999999999995,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.69899999999999995,"15min":0.753},"min":{"1min":0.38200000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82199999999999995,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":0.53100000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.65600000000000003,"15min":0.69799999999999995},"min":{"1min":0.42599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73099999999999998,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":0.54700000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.85799999999999998,"15min":0.89600000000000002},"min":{"1min":0.53100000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96999999999999997,"5min":2.544,"15min":2.544},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.92900000000000005,"15min":0.98299999999999998},"min":{"1min":0.65000000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0569999999999999,"5min":3.6480000000000001,"15min":3.6480000000000001},"last":0.69999999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80400000000000005,"15min":0.83399999999999996},"min":{"1min":0.63500000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98699999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.84399999999999997,"15min":0.879},"min":{"1min":0.64600000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0800000000000001,"5min":2.4630000000000001,"15min":2.4630000000000001},"last":0.67700000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.88200000000000001,"15min":0.93600000000000005},"min":{"1min":0.66400000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.997,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.85099999999999998,"15min":0.88500000000000001},"min":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.94999999999999996,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":0.74099999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.86699999999999999,"15min":0.89800000000000002},"min":{"1min":0.65600000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.04,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.88300000000000001,"15min":0.92100000000000004},"min":{"1min":0.68000000000000005,"5min":0.502,"15min":0.502},"max":{"1min":1.024,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.76200000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1126400,"data_stored":811423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:27:32 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.44700000000000001,"15min":0.48299999999999998},"min":{"1min":0.30199999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.57299999999999995,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.48999999999999999,"15min":0.52500000000000002},"min":{"1min":0.32300000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65300000000000002,"5min":2.254,"15min":2.254},"last":0.53700000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:27:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55800000000000005,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73399999999999999,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.60399999999999998,"15min":0.64300000000000002},"min":{"1min":0.41099999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.67800000000000005,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.59099999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:27:32 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52600000000000002,"15min":0.55400000000000005},"min":{"1min":0.36199999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.60299999999999998,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.626,"15min":0.64400000000000002},"min":{"1min":0.44400000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.70499999999999996,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":0.621}]},{"osd":4,"last update":"Sat Aug 17 02:27:32 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.755,"15min":0.749},"min":{"1min":0.53200000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.98199999999999998,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76300000000000001,"15min":0.75900000000000001},"min":{"1min":0.59399999999999997,"5min":0.432,"15min":0.432},"max":{"1min":0.998,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:27:32 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81799999999999995,"15min":0.81899999999999995},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":0.999,"5min":1.321,"15min":1.321},"last":0.749},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.57499999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0580000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.79700000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:27:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.56299999999999994,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0049999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.79600000000000004,"15min":0.80700000000000005},"min":{"1min":0.60399999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0760000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.65600000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:27:32 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.62,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.96699999999999997,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80700000000000005,"15min":0.82499999999999996},"min":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97699999999999998,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.77100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:33.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:27:33.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.508+0000 7f535bc00640 1 Processor -- start 2024-08-17T02:27:33.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.508+0000 7f535bc00640 1 -- start start 2024-08-17T02:27:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.509+0000 7f535bc00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f53540ad960 0x7f535415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.509+0000 7f535bc00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53540ca050 0x7f5354156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.509+0000 7f535bc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53540add30 0x7f5354156960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.509+0000 7f535bc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535415b5e0 con 0x7f53540add30 2024-08-17T02:27:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.509+0000 7f535bc00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53540cb160 con 0x7f53540ad960 2024-08-17T02:27:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.509+0000 7f535bc00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53540b0d10 con 0x7f53540ca050 2024-08-17T02:27:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.509+0000 7f5359c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53540add30 0x7f5354156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.509+0000 7f5359c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53540add30 0x7f5354156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34320/0 (socket says 172.21.15.5:34320) 2024-08-17T02:27:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.509+0000 7f5359c00640 1 -- 172.21.15.5:0/2829785168 learned_addr learned my addr 172.21.15.5:0/2829785168 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.509+0000 7f5359200640 1 --2- 172.21.15.5:0/2829785168 >> v2:172.21.15.87:3300/0 conn(0x7f53540ad960 0x7f535415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.510+0000 7f5353e00640 1 --2- 172.21.15.5:0/2829785168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53540ca050 0x7f5354156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.510+0000 7f5359c00640 1 -- 172.21.15.5:0/2829785168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53540ca050 msgr2=0x7f5354156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.510+0000 7f5359c00640 1 --2- 172.21.15.5:0/2829785168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53540ca050 0x7f5354156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.510+0000 7f5359c00640 1 -- 172.21.15.5:0/2829785168 >> v2:172.21.15.87:3300/0 conn(0x7f53540ad960 msgr2=0x7f535415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.510+0000 7f5359c00640 1 --2- 172.21.15.5:0/2829785168 >> v2:172.21.15.87:3300/0 conn(0x7f53540ad960 0x7f535415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.510+0000 7f5359c00640 1 -- 172.21.15.5:0/2829785168 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53540ca550 con 0x7f53540add30 2024-08-17T02:27:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.511+0000 7f5359c00640 1 --2- 172.21.15.5:0/2829785168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53540add30 0x7f5354156960 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f53540cc910 tx=0x7f534c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2020014929e95e5a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.511+0000 7f5353400640 1 -- 172.21.15.5:0/2829785168 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c02ae60 con 0x7f53540add30 2024-08-17T02:27:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.511+0000 7f5353400640 1 -- 172.21.15.5:0/2829785168 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c032440 con 0x7f53540add30 2024-08-17T02:27:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.511+0000 7f5353400640 1 -- 172.21.15.5:0/2829785168 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c0327e0 con 0x7f53540add30 2024-08-17T02:27:33.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.512+0000 7f535bc00640 1 -- 172.21.15.5:0/2829785168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53540add30 msgr2=0x7f5354156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.512+0000 7f535bc00640 1 --2- 172.21.15.5:0/2829785168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53540add30 0x7f5354156960 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f53540cc910 tx=0x7f534c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.512+0000 7f535bc00640 1 -- 172.21.15.5:0/2829785168 shutdown_connections 2024-08-17T02:27:33.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.512+0000 7f535bc00640 1 --2- 172.21.15.5:0/2829785168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53540add30 0x7f5354156960 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.512+0000 7f535bc00640 1 --2- 172.21.15.5:0/2829785168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53540ca050 0x7f5354156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.512+0000 7f535bc00640 1 --2- 172.21.15.5:0/2829785168 >> v2:172.21.15.87:3300/0 conn(0x7f53540ad960 0x7f535415b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.512+0000 7f535bc00640 1 -- 172.21.15.5:0/2829785168 >> 172.21.15.5:0/2829785168 conn(0x7f5354066e60 msgr2=0x7f5354067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.512+0000 7f535bc00640 1 -- 172.21.15.5:0/2829785168 shutdown_connections 2024-08-17T02:27:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.512+0000 7f535bc00640 1 -- 172.21.15.5:0/2829785168 wait complete. 2024-08-17T02:27:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.513+0000 7f535bc00640 1 Processor -- start 2024-08-17T02:27:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.514+0000 7f535bc00640 1 -- start start 2024-08-17T02:27:33.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.514+0000 7f535bc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53540ad960 0x7f535413f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.514+0000 7f535bc00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53540add30 0x7f53540aa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.514+0000 7f535bc00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53540ca050 0x7f53540aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.514+0000 7f535bc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5354140e70 con 0x7f53540ad960 2024-08-17T02:27:33.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.514+0000 7f535bc00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535413ff80 con 0x7f53540ca050 2024-08-17T02:27:33.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.514+0000 7f535bc00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5354140260 con 0x7f53540add30 2024-08-17T02:27:33.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.515+0000 7f5359200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53540ad960 0x7f535413f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.515+0000 7f5359200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53540ad960 0x7f535413f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34330/0 (socket says 172.21.15.5:34330) 2024-08-17T02:27:33.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.515+0000 7f5359200640 1 -- 172.21.15.5:0/687471743 learned_addr learned my addr 172.21.15.5:0/687471743 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:33.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.515+0000 7f5353e00640 1 --2- 172.21.15.5:0/687471743 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53540add30 0x7f53540aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.515+0000 7f5359c00640 1 --2- 172.21.15.5:0/687471743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53540ca050 0x7f53540aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.515+0000 7f5359200640 1 -- 172.21.15.5:0/687471743 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53540add30 msgr2=0x7f53540aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.515+0000 7f5359200640 1 --2- 172.21.15.5:0/687471743 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53540add30 0x7f53540aa650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.515+0000 7f5359200640 1 -- 172.21.15.5:0/687471743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53540ca050 msgr2=0x7f53540aab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.515+0000 7f5359200640 1 --2- 172.21.15.5:0/687471743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53540ca050 0x7f53540aab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.515+0000 7f5359200640 1 -- 172.21.15.5:0/687471743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c009450 con 0x7f53540ad960 2024-08-17T02:27:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.515+0000 7f5359200640 1 --2- 172.21.15.5:0/687471743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53540ad960 0x7f535413f5e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5348009e50 tx=0x7f534800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.516+0000 7f5347e00640 1 -- 172.21.15.5:0/687471743 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534800cd40 con 0x7f53540ad960 2024-08-17T02:27:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.516+0000 7f5347e00640 1 -- 172.21.15.5:0/687471743 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534800f040 con 0x7f53540ad960 2024-08-17T02:27:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.516+0000 7f5347e00640 1 -- 172.21.15.5:0/687471743 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534800cea0 con 0x7f53540ad960 2024-08-17T02:27:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.516+0000 7f535bc00640 1 -- 172.21.15.5:0/687471743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5354140540 con 0x7f53540ad960 2024-08-17T02:27:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.516+0000 7f535bc00640 1 -- 172.21.15.5:0/687471743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5354140b00 con 0x7f53540ad960 2024-08-17T02:27:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.517+0000 7f535bc00640 1 -- 172.21.15.5:0/687471743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5354063fb0 con 0x7f53540ad960 2024-08-17T02:27:33.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.518+0000 7f5347e00640 1 -- 172.21.15.5:0/687471743 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f53480148c0 con 0x7f53540ad960 2024-08-17T02:27:33.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.518+0000 7f5347e00640 1 --2- 172.21.15.5:0/687471743 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5334065150 0x7f5334067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.518+0000 7f5347e00640 1 -- 172.21.15.5:0/687471743 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5348082ca0 con 0x7f53540ad960 2024-08-17T02:27:33.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.519+0000 7f5353e00640 1 --2- 172.21.15.5:0/687471743 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5334065150 0x7f5334067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.519+0000 7f5353e00640 1 --2- 172.21.15.5:0/687471743 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5334065150 0x7f5334067600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f53540cc8c0 tx=0x7f5340008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.523+0000 7f5347e00640 1 -- 172.21.15.5:0/687471743 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5348050f60 con 0x7f53540ad960 2024-08-17T02:27:33.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.703+0000 7f535bc00640 1 -- 172.21.15.5:0/687471743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f53540699b0 con 0x7f53540ad960 2024-08-17T02:27:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.708+0000 7f5347e00640 1 -- 172.21.15.5:0/687471743 <== mon.0 v2:172.21.15.5:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5348050f60 con 0x7f53540ad960 2024-08-17T02:27:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.708+0000 7f5347e00640 1 -- 172.21.15.5:0/687471743 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5348054580 con 0x7f53540ad960 2024-08-17T02:27:33.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.711+0000 7f535bc00640 1 -- 172.21.15.5:0/687471743 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5334065150 msgr2=0x7f5334067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.711+0000 7f535bc00640 1 --2- 172.21.15.5:0/687471743 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5334065150 0x7f5334067600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f53540cc8c0 tx=0x7f5340008040 comp rx=0 tx=0).stop 2024-08-17T02:27:33.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.711+0000 7f535bc00640 1 -- 172.21.15.5:0/687471743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53540ad960 msgr2=0x7f535413f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.711+0000 7f535bc00640 1 --2- 172.21.15.5:0/687471743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53540ad960 0x7f535413f5e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5348009e50 tx=0x7f534800b040 comp rx=0 tx=0).stop 2024-08-17T02:27:33.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.711+0000 7f535bc00640 1 -- 172.21.15.5:0/687471743 shutdown_connections 2024-08-17T02:27:33.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.711+0000 7f535bc00640 1 --2- 172.21.15.5:0/687471743 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7f5334065150 0x7f5334067600 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.711+0000 7f535bc00640 1 --2- 172.21.15.5:0/687471743 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53540add30 0x7f53540aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.711+0000 7f535bc00640 1 --2- 172.21.15.5:0/687471743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53540ca050 0x7f53540aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.711+0000 7f535bc00640 1 --2- 172.21.15.5:0/687471743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53540ad960 0x7f535413f5e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.711+0000 7f535bc00640 1 -- 172.21.15.5:0/687471743 >> 172.21.15.5:0/687471743 conn(0x7f5354066e60 msgr2=0x7f53540b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.711+0000 7f535bc00640 1 -- 172.21.15.5:0/687471743 shutdown_connections 2024-08-17T02:27:33.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.711+0000 7f535bc00640 1 -- 172.21.15.5:0/687471743 wait complete. 2024-08-17T02:27:33.727 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:27:33.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.878+0000 7ff276c00640 1 Processor -- start 2024-08-17T02:27:33.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.878+0000 7ff276c00640 1 -- start start 2024-08-17T02:27:33.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.879+0000 7ff276c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff270158e10 0x7ff270068180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.879+0000 7ff276c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff270068dd0 0x7ff2700cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.879+0000 7ff276c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2700c40a0 con 0x7ff2701591e0 2024-08-17T02:27:33.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.879+0000 7ff276c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2700694e0 con 0x7ff270158e10 2024-08-17T02:27:33.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.879+0000 7ff276c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff270069240 con 0x7ff270068dd0 2024-08-17T02:27:33.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.880+0000 7ff274c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff270068dd0 0x7ff2700cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.880+0000 7ff274c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff270068dd0 0x7ff2700cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.5:34858/0 (socket says 172.21.15.5:34858) 2024-08-17T02:27:33.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.880+0000 7ff274c00640 1 -- 172.21.15.5:0/3280611718 learned_addr learned my addr 172.21.15.5:0/3280611718 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:33.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.880+0000 7ff26fe00640 1 --2- 172.21.15.5:0/3280611718 >> v2:172.21.15.87:3300/0 conn(0x7ff270158e10 0x7ff270068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.880+0000 7ff274c00640 1 -- 172.21.15.5:0/3280611718 >> v2:172.21.15.87:3300/0 conn(0x7ff270158e10 msgr2=0x7ff270068180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.880+0000 7ff274c00640 1 --2- 172.21.15.5:0/3280611718 >> v2:172.21.15.87:3300/0 conn(0x7ff270158e10 0x7ff270068180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.880+0000 7ff274c00640 1 -- 172.21.15.5:0/3280611718 >> v1:172.21.15.87:6789/0 conn(0x7ff2701591e0 legacy=0x7ff2700686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.880+0000 7ff274c00640 1 -- 172.21.15.5:0/3280611718 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2700c3a50 con 0x7ff270068dd0 2024-08-17T02:27:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.881+0000 7ff274c00640 1 --2- 172.21.15.5:0/3280611718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff270068dd0 0x7ff2700cbfd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff268009f20 tx=0x7ff268009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f88c8b91c43614f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.881+0000 7ff26ea00640 1 -- 172.21.15.5:0/3280611718 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff268031400 con 0x7ff270068dd0 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.881+0000 7ff26ea00640 1 -- 172.21.15.5:0/3280611718 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff26802d050 con 0x7ff270068dd0 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.881+0000 7ff26ea00640 1 -- 172.21.15.5:0/3280611718 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2680317f0 con 0x7ff270068dd0 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.882+0000 7ff276c00640 1 -- 172.21.15.5:0/3280611718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff270068dd0 msgr2=0x7ff2700cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.882+0000 7ff276c00640 1 --2- 172.21.15.5:0/3280611718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff270068dd0 0x7ff2700cbfd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff268009f20 tx=0x7ff268009840 comp rx=0 tx=0).stop 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.882+0000 7ff276c00640 1 -- 172.21.15.5:0/3280611718 shutdown_connections 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.882+0000 7ff276c00640 1 --2- 172.21.15.5:0/3280611718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff270068dd0 0x7ff2700cbfd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.882+0000 7ff276c00640 1 --2- 172.21.15.5:0/3280611718 >> v2:172.21.15.87:3300/0 conn(0x7ff270158e10 0x7ff270068180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.882+0000 7ff276c00640 1 -- 172.21.15.5:0/3280611718 >> 172.21.15.5:0/3280611718 conn(0x7ff2700ce590 msgr2=0x7ff2700ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.882+0000 7ff276c00640 1 -- 172.21.15.5:0/3280611718 shutdown_connections 2024-08-17T02:27:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.882+0000 7ff276c00640 1 -- 172.21.15.5:0/3280611718 wait complete. 2024-08-17T02:27:33.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.884+0000 7ff276c00640 1 Processor -- start 2024-08-17T02:27:33.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.884+0000 7ff276c00640 1 -- start start 2024-08-17T02:27:33.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.884+0000 7ff276c00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff270068dd0 0x7ff27016d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.884+0000 7ff276c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff270158e10 0x7ff2700c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.885+0000 7ff276c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2701591e0 0x7ff2701545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.885+0000 7ff276c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2701595b0 con 0x7ff270158e10 2024-08-17T02:27:33.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.885+0000 7ff276c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27016d550 con 0x7ff2701591e0 2024-08-17T02:27:33.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.885+0000 7ff276c00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2700c6000 con 0x7ff270068dd0 2024-08-17T02:27:33.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.885+0000 7ff26f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff270158e10 0x7ff2700c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.885+0000 7ff26f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff270158e10 0x7ff2700c5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34340/0 (socket says 172.21.15.5:34340) 2024-08-17T02:27:33.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.885+0000 7ff26f400640 1 -- 172.21.15.5:0/1007904556 learned_addr learned my addr 172.21.15.5:0/1007904556 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:27:33.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.885+0000 7ff26fe00640 1 --2- 172.21.15.5:0/1007904556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff270068dd0 0x7ff27016d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.885+0000 7ff274c00640 1 --2- 172.21.15.5:0/1007904556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2701591e0 0x7ff2701545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.885+0000 7ff26f400640 1 -- 172.21.15.5:0/1007904556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff270068dd0 msgr2=0x7ff27016d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.885+0000 7ff26f400640 1 --2- 172.21.15.5:0/1007904556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff270068dd0 0x7ff27016d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.885+0000 7ff26f400640 1 -- 172.21.15.5:0/1007904556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2701591e0 msgr2=0x7ff2701545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.885+0000 7ff26f400640 1 --2- 172.21.15.5:0/1007904556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2701591e0 0x7ff2701545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.885+0000 7ff26f400640 1 -- 172.21.15.5:0/1007904556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff268009ae0 con 0x7ff270158e10 2024-08-17T02:27:33.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.886+0000 7ff26f400640 1 --2- 172.21.15.5:0/1007904556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff270158e10 0x7ff2700c5ac0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00c560 tx=0x7ff25c007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.886+0000 7ff267400640 1 -- 172.21.15.5:0/1007904556 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c011590 con 0x7ff270158e10 2024-08-17T02:27:33.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.886+0000 7ff267400640 1 -- 172.21.15.5:0/1007904556 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff25c0116f0 con 0x7ff270158e10 2024-08-17T02:27:33.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.886+0000 7ff267400640 1 -- 172.21.15.5:0/1007904556 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c011ad0 con 0x7ff270158e10 2024-08-17T02:27:33.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.886+0000 7ff276c00640 1 -- 172.21.15.5:0/1007904556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27015c230 con 0x7ff270158e10 2024-08-17T02:27:33.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.886+0000 7ff276c00640 1 -- 172.21.15.5:0/1007904556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff270159aa0 con 0x7ff270158e10 2024-08-17T02:27:33.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.887+0000 7ff276c00640 1 -- 172.21.15.5:0/1007904556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff270063fb0 con 0x7ff270158e10 2024-08-17T02:27:33.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.888+0000 7ff267400640 1 -- 172.21.15.5:0/1007904556 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff25c01b3b0 con 0x7ff270158e10 2024-08-17T02:27:33.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.889+0000 7ff267400640 1 --2- 172.21.15.5:0/1007904556 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff250065150 0x7ff250067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.889+0000 7ff267400640 1 -- 172.21.15.5:0/1007904556 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff25c081670 con 0x7ff270158e10 2024-08-17T02:27:33.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.889+0000 7ff26fe00640 1 --2- 172.21.15.5:0/1007904556 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff250065150 0x7ff250067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.890+0000 7ff26fe00640 1 --2- 172.21.15.5:0/1007904556 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff250065150 0x7ff250067600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff260009d20 tx=0x7ff2600090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:33.893+0000 7ff267400640 1 -- 172.21.15.5:0/1007904556 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff25c04fa60 con 0x7ff270158e10 2024-08-17T02:27:34.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:34.117+0000 7ff276c00640 1 -- 172.21.15.5:0/1007904556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff27006d6b0 con 0x7ff270158e10 2024-08-17T02:27:34.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:34.118+0000 7ff267400640 1 -- 172.21.15.5:0/1007904556 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3520 (secure 0 0 0) 0x7ff25c017dd0 con 0x7ff270158e10 2024-08-17T02:27:34.120 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:27:34.120 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1398504310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1398504310},{"type":"v1","addr":"172.21.15.5:6837","nonce":1398504310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4855,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/1045077639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1045077639},{"type":"v1","addr":"172.21.15.87:6833","nonce":1045077639}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5251,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1624288595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1624288595},{"type":"v1","addr":"172.21.15.87:6835","nonce":1624288595}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/940060904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":940060904},{"type":"v1","addr":"172.21.15.5:6836","nonce":940060904}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[]} 2024-08-17T02:27:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-08-17T02:27:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:34.120+0000 7ff276c00640 1 -- 172.21.15.5:0/1007904556 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff250065150 msgr2=0x7ff250067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:34.120+0000 7ff276c00640 1 --2- 172.21.15.5:0/1007904556 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff250065150 0x7ff250067600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff260009d20 tx=0x7ff2600090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:34.120+0000 7ff276c00640 1 -- 172.21.15.5:0/1007904556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff270158e10 msgr2=0x7ff2700c5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:34.120+0000 7ff276c00640 1 --2- 172.21.15.5:0/1007904556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff270158e10 0x7ff2700c5ac0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00c560 tx=0x7ff25c007e90 comp rx=0 tx=0).stop 2024-08-17T02:27:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:34.120+0000 7ff276c00640 1 -- 172.21.15.5:0/1007904556 shutdown_connections 2024-08-17T02:27:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:34.121+0000 7ff276c00640 1 --2- 172.21.15.5:0/1007904556 >> [v2:172.21.15.5:6832/36852,v1:172.21.15.5:6833/36852] conn(0x7ff250065150 0x7ff250067600 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:34.121+0000 7ff276c00640 1 --2- 172.21.15.5:0/1007904556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2701591e0 0x7ff2701545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:34.121+0000 7ff276c00640 1 --2- 172.21.15.5:0/1007904556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff270158e10 0x7ff2700c5ac0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:34.121+0000 7ff276c00640 1 --2- 172.21.15.5:0/1007904556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff270068dd0 0x7ff27016d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:34.121+0000 7ff276c00640 1 -- 172.21.15.5:0/1007904556 >> 172.21.15.5:0/1007904556 conn(0x7ff2700ce590 msgr2=0x7ff270156e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:34.121+0000 7ff276c00640 1 -- 172.21.15.5:0/1007904556 shutdown_connections 2024-08-17T02:27:34.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:27:34.121+0000 7ff276c00640 1 -- 172.21.15.5:0/1007904556 wait complete. 2024-08-17T02:27:34.138 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:27:34.138 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:27:34.139 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:27:34.139 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:34.152 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:27:34.152 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:27:34.153 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:34.206 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:27:34.207 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:27:34.207 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:34.223 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:27:34.223 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:27:34.223 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:34.279 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:27:34.279 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:27:34.279 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:27:34.280 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:34.324 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:27:34.324 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:27:34.324 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:34.382 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:27:34.383 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:27:34.383 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:34.439 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:27:34.439 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:27:34.439 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:34.490 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:27:34.490 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:27:34.490 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:34.531 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:27:34.532 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:27:34.532 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:34.580 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:27:34.581 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:27:34.581 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:34.643 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:27:34.643 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:27:34.643 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:34.710 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:27:34.710 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:27:34.711 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:27:34.711 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:34.773 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:27:34.773 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:27:34.773 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:34.830 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:27:34.831 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:27:34.831 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:27:34.831 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:34.850 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:27:34.851 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:27:34.851 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:34.869 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:27:34.870 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:27:34.870 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:34.928 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:27:34.928 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:27:34.929 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:27:35.013 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:27:35.014 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:27:35.227 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:27:35.228 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:27:35.341 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:27:35.341 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:27:35.440 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:27:35.441 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:27:35.541 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi087.front.sepia.ceph.com 2024-08-17T02:27:35.542 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:27:35.789 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi087.front.sepia.ceph.com 2024-08-17T02:27:35.789 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:27:35.888 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi087.front.sepia.ceph.com 2024-08-17T02:27:35.888 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:27:35.987 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi087.front.sepia.ceph.com 2024-08-17T02:27:35.987 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:27:36.088 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:27:36.089 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858279/data/mon.a.tgz 2024-08-17T02:27:36.089 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-08-17T02:27:36.126 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.5bHiHdg7mm 2024-08-17T02:27:36.127 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.5bHiHdg7mm 2024-08-17T02:27:36.303 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.5bHiHdg7mm 2024-08-17T02:27:36.397 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.5bHiHdg7mm is 311KB 2024-08-17T02:27:36.489 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.5bHiHdg7mm 2024-08-17T02:27:36.524 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858279/data/mon.b.tgz 2024-08-17T02:27:36.525 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-08-17T02:27:36.560 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.6B4XYGjxi5 2024-08-17T02:27:36.560 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.6B4XYGjxi5 2024-08-17T02:27:36.756 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.6B4XYGjxi5 2024-08-17T02:27:36.849 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.6B4XYGjxi5 is 412KB 2024-08-17T02:27:36.943 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.6B4XYGjxi5 2024-08-17T02:27:36.978 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858279/data/mon.c.tgz 2024-08-17T02:27:36.978 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-08-17T02:27:37.052 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.oHKphlP06Q 2024-08-17T02:27:37.053 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.oHKphlP06Q 2024-08-17T02:27:37.234 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.oHKphlP06Q 2024-08-17T02:27:37.326 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.oHKphlP06Q is 412KB 2024-08-17T02:27:37.416 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.oHKphlP06Q 2024-08-17T02:27:37.451 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:27:37.451 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:27:37.456 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:27:37.546 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:27:37.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:27:37.551 DEBUG:teuthology.orchestra.run.smithi087:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:27:37.612 INFO:teuthology.orchestra.run.smithi087.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:27:37.613 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:27:37.623 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:27:37.625 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858279/remote/smithi005/crash 2024-08-17T02:27:37.625 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:27:37.681 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858279/remote/smithi087/crash 2024-08-17T02:27:37.682 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:27:37.735 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:27:37.735 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:37.739 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:37.846 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:37.901 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:37.956 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:27:37.956 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:27:37.960 DEBUG:teuthology.orchestra.run.smithi087:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:27:38.011 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46981.log 2024-08-17T02:27:38.011 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41592.log 2024-08-17T02:27:38.012 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43626.log 2024-08-17T02:27:38.013 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46981.log.gz 2024-08-17T02:27:38.013 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48439.log 2024-08-17T02:27:38.013 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41592.log.gz 2024-08-17T02:27:38.015 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37487.log 2024-08-17T02:27:38.015 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37567.log 2024-08-17T02:27:38.016 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41370.log 2024-08-17T02:27:38.016 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43626.log.gz 2024-08-17T02:27:38.016 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46009.log 2024-08-17T02:27:38.016 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48439.log.gz 2024-08-17T02:27:38.016 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42881.log 2024-08-17T02:27:38.017 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41370.log.gz 2024-08-17T02:27:38.022 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48793.log 2024-08-17T02:27:38.022 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46009.log.gz 2024-08-17T02:27:38.022 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50451.log 2024-08-17T02:27:38.022 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42881.log.gz 2024-08-17T02:27:38.023 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45437.log 2024-08-17T02:27:38.023 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48793.log.gz 2024-08-17T02:27:38.023 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49918.log 2024-08-17T02:27:38.023 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50451.log.gz 2024-08-17T02:27:38.023 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48017.log 2024-08-17T02:27:38.023 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45437.log.gz 2024-08-17T02:27:38.023 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45395.log 2024-08-17T02:27:38.023 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49918.log.gz 2024-08-17T02:27:38.024 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45757.log 2024-08-17T02:27:38.024 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48017.log.gz 2024-08-17T02:27:38.027 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37316.log 2024-08-17T02:27:38.027 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37487.log.gz 2024-08-17T02:27:38.028 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37567.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:27:38.028 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37567.log.gz 2024-08-17T02:27:38.028 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37316.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37316.log.gz 2024-08-17T02:27:38.028 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37447.log 2024-08-17T02:27:38.028 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37276.log 2024-08-17T02:27:38.028 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37447.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:27:38.028 INFO:teuthology.orchestra.run.smithi087.stderr: 91.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:27:38.028 INFO:teuthology.orchestra.run.smithi087.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37447.log.gz 2024-08-17T02:27:38.028 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37276.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:27:38.029 INFO:teuthology.orchestra.run.smithi087.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37276.log.gz 2024-08-17T02:27:38.029 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:27:38.029 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:27:38.029 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mds.b.log: 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:27:38.029 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42243.log 2024-08-17T02:27:38.029 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:27:38.029 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.1.42243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42243.log.gz 2024-08-17T02:27:38.029 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37367.log 2024-08-17T02:27:38.030 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37407.log 2024-08-17T02:27:38.030 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37367.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:27:38.030 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37367.log.gz 2024-08-17T02:27:38.035 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37407.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:27:38.035 INFO:teuthology.orchestra.run.smithi087.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37407.log.gz 2024-08-17T02:27:38.035 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:27:38.035 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42989.log 2024-08-17T02:27:38.035 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.1.42989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42989.log.gz 2024-08-17T02:27:38.036 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42575.log 2024-08-17T02:27:38.036 INFO:teuthology.orchestra.run.smithi087.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:27:38.036 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37527.log 2024-08-17T02:27:38.042 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.3.42575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42575.log.gz 2024-08-17T02:27:38.042 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:27:38.042 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37527.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37527.log.gz 2024-08-17T02:27:38.042 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:27:38.042 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mds.d.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:27:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42546.log 2024-08-17T02:27:38.043 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45395.log.gz 2024-08-17T02:27:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49088.log 2024-08-17T02:27:38.043 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45757.log.gz 2024-08-17T02:27:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42197.log 2024-08-17T02:27:38.043 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42546.log.gz 2024-08-17T02:27:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46633.log 2024-08-17T02:27:38.043 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49088.log.gz 2024-08-17T02:27:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43458.log 2024-08-17T02:27:38.044 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42197.log.gz 2024-08-17T02:27:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45311.log 2024-08-17T02:27:38.044 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46633.log.gz 2024-08-17T02:27:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49666.log 2024-08-17T02:27:38.044 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43458.log.gz 2024-08-17T02:27:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43848.log 2024-08-17T02:27:38.044 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45311.log.gz 2024-08-17T02:27:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41021.log 2024-08-17T02:27:38.045 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49666.log.gz 2024-08-17T02:27:38.045 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41676.log 2024-08-17T02:27:38.045 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43848.log.gz 2024-08-17T02:27:38.045 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48523.log 2024-08-17T02:27:38.045 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41021.log.gz 2024-08-17T02:27:38.045 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48355.log 2024-08-17T02:27:38.045 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41676.log.gz 2024-08-17T02:27:38.045 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41316.log 2024-08-17T02:27:38.045 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48523.log.gz 2024-08-17T02:27:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41718.log 2024-08-17T02:27:38.046 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48355.log.gz 2024-08-17T02:27:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44807.log 2024-08-17T02:27:38.046 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41316.log.gz 2024-08-17T02:27:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41718.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:27:38.046 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41718.log.gz 2024-08-17T02:27:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42548.log 2024-08-17T02:27:38.047 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44807.log.gz 2024-08-17T02:27:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42540.log 2024-08-17T02:27:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42548.log: 84.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:27:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49508.log 2024-08-17T02:27:38.047 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42548.log.gz 2024-08-17T02:27:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46591.log 2024-08-17T02:27:38.047 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42540.log.gz 2024-08-17T02:27:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50660.log 2024-08-17T02:27:38.047 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49508.log.gz 2024-08-17T02:27:38.048 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46591.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:27:38.048 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46591.log.gz 2024-08-17T02:27:38.048 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49466.log 2024-08-17T02:27:38.048 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50660.log.gz 2024-08-17T02:27:38.048 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43374.log 2024-08-17T02:27:38.052 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49424.log 2024-08-17T02:27:38.052 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49466.log.gz 2024-08-17T02:27:38.052 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45967.log 2024-08-17T02:27:38.052 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43374.log.gz 2024-08-17T02:27:38.052 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47469.log 2024-08-17T02:27:38.052 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49424.log.gz 2024-08-17T02:27:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45967.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45967.log.gz 2024-08-17T02:27:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50002.log 2024-08-17T02:27:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42880.log 2024-08-17T02:27:38.053 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47469.log.gz 2024-08-17T02:27:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47803.log 2024-08-17T02:27:38.053 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50002.log.gz 2024-08-17T02:27:38.053 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49834.log 2024-08-17T02:27:38.053 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42880.log.gz 2024-08-17T02:27:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47803.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47803.log.gz 2024-08-17T02:27:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42879.log 2024-08-17T02:27:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47403.log 2024-08-17T02:27:38.054 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49834.log.gz 2024-08-17T02:27:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48649.log 2024-08-17T02:27:38.054 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42879.log.gz 2024-08-17T02:27:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44178.log 2024-08-17T02:27:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48649.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47403.log.gz 2024-08-17T02:27:38.057 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48649.log.gz 2024-08-17T02:27:38.057 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:27:38.057 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.44178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44178.log.gz 2024-08-17T02:27:38.057 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50536.log 2024-08-17T02:27:38.057 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49004.log 2024-08-17T02:27:38.057 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43248.log 2024-08-17T02:27:38.057 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50536.log.gz 2024-08-17T02:27:38.057 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:27:38.058 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43584.log 2024-08-17T02:27:38.058 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49004.log.gz 2024-08-17T02:27:38.058 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43248.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43248.log.gz 2024-08-17T02:27:38.058 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41904.log 2024-08-17T02:27:38.059 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mon.b.log: 91.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:27:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41506.log 2024-08-17T02:27:38.060 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43584.log.gz 2024-08-17T02:27:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48313.log 2024-08-17T02:27:38.060 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41904.log.gz 2024-08-17T02:27:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41634.log 2024-08-17T02:27:38.061 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41506.log.gz 2024-08-17T02:27:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48313.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.42883.log 2024-08-17T02:27:38.061 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48313.log.gz 2024-08-17T02:27:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41254.log 2024-08-17T02:27:38.062 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41634.log.gz 2024-08-17T02:27:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49708.log 2024-08-17T02:27:38.062 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42883.log.gz 2024-08-17T02:27:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42208.log 2024-08-17T02:27:38.063 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41254.log.gz 2024-08-17T02:27:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49708.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49708.log.gz 2024-08-17T02:27:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46381.log 2024-08-17T02:27:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41946.log 2024-08-17T02:27:38.064 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42208.log.gz 2024-08-17T02:27:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46381.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:27:38.065 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46381.log.gz 2024-08-17T02:27:38.066 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43710.log 2024-08-17T02:27:38.067 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41946.log.gz 2024-08-17T02:27:38.067 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42203.log 2024-08-17T02:27:38.068 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44891.log 2024-08-17T02:27:38.068 INFO:teuthology.orchestra.run.smithi005.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.43710.log.gz 2024-08-17T02:27:38.069 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42212.log 2024-08-17T02:27:38.069 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42203.log.gz 2024-08-17T02:27:38.070 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44891.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44891.log.gz 2024-08-17T02:27:38.070 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37116.log 2024-08-17T02:27:38.071 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49382.log 2024-08-17T02:27:38.072 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42212.log.gz 2024-08-17T02:27:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37116.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37116.log.gz 2024-08-17T02:27:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44585.log 2024-08-17T02:27:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41117.log 2024-08-17T02:27:38.074 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49382.log.gz 2024-08-17T02:27:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44585.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44585.log.gz 2024-08-17T02:27:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46801.log 2024-08-17T02:27:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47023.log 2024-08-17T02:27:38.076 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41117.log.gz 2024-08-17T02:27:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46801.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46801.log.gz 2024-08-17T02:27:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48397.log 2024-08-17T02:27:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46931.log 2024-08-17T02:27:38.078 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47023.log.gz 2024-08-17T02:27:38.079 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48397.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48397.log.gz 2024-08-17T02:27:38.079 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42207.log 2024-08-17T02:27:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46931.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:27:38.080 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46931.log.gz 2024-08-17T02:27:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42207.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42207.log.gz 2024-08-17T02:27:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42211.log 2024-08-17T02:27:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42199.log 2024-08-17T02:27:38.083 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42211.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:27:38.083 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42211.log.gz 2024-08-17T02:27:38.084 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42884.log 2024-08-17T02:27:38.084 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46549.log 2024-08-17T02:27:38.084 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42199.log.gz 2024-08-17T02:27:38.085 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42884.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:27:38.085 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42884.log.gz 2024-08-17T02:27:38.086 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46549.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46549.log.gz 2024-08-17T02:27:38.086 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47361.log 2024-08-17T02:27:38.087 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:27:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47361.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.47361.log.gz 2024-08-17T02:27:38.089 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36850.log 2024-08-17T02:27:38.090 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43668.log 2024-08-17T02:27:38.091 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36850.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:27:38.091 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.36850.log.gz 2024-08-17T02:27:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41988.log 2024-08-17T02:27:38.093 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43668.log.gz 2024-08-17T02:27:38.093 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48691.log 2024-08-17T02:27:38.095 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46507.log 2024-08-17T02:27:38.095 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41988.log.gz 2024-08-17T02:27:38.096 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48691.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48691.log.gz 2024-08-17T02:27:38.097 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46507.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46507.log.gz 2024-08-17T02:27:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47319.log 2024-08-17T02:27:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42797.log 2024-08-17T02:27:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47319.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47933.log 2024-08-17T02:27:38.101 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47319.log.gz 2024-08-17T02:27:38.102 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42797.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42797.log.gz 2024-08-17T02:27:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47933.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47933.log.gz 2024-08-17T02:27:38.104 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49876.log 2024-08-17T02:27:38.105 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48962.log 2024-08-17T02:27:38.106 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47065.log 2024-08-17T02:27:38.106 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49876.log.gz 2024-08-17T02:27:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48962.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48962.log.gz 2024-08-17T02:27:38.109 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47065.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47065.log.gz 2024-08-17T02:27:38.109 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45059.log 2024-08-17T02:27:38.110 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45479.log 2024-08-17T02:27:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50409.log 2024-08-17T02:27:38.112 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45059.log.gz 2024-08-17T02:27:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45479.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45479.log.gz 2024-08-17T02:27:38.114 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50409.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50409.log.gz 2024-08-17T02:27:38.115 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44723.log 2024-08-17T02:27:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46135.log 2024-08-17T02:27:38.118 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48920.log 2024-08-17T02:27:38.118 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44723.log.gz 2024-08-17T02:27:38.119 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46135.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46135.log.gz 2024-08-17T02:27:38.119 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45227.log 2024-08-17T02:27:38.121 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45563.log 2024-08-17T02:27:38.121 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48920.log.gz 2024-08-17T02:27:38.122 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45227.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45227.log.gz 2024-08-17T02:27:38.123 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45563.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45563.log.gz 2024-08-17T02:27:38.124 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47845.log 2024-08-17T02:27:38.125 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50702.log 2024-08-17T02:27:38.127 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44541.log 2024-08-17T02:27:38.127 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47845.log.gz 2024-08-17T02:27:38.128 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42876.log 2024-08-17T02:27:38.128 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50702.log.gz 2024-08-17T02:27:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.2.44541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44541.log.gz 2024-08-17T02:27:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:27:38.131 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46843.log 2024-08-17T02:27:38.131 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42876.log.gz 2024-08-17T02:27:38.132 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47277.log 2024-08-17T02:27:38.133 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46843.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46843.log.gz 2024-08-17T02:27:38.134 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43542.log 2024-08-17T02:27:38.135 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41862.log 2024-08-17T02:27:38.136 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47277.log.gz 2024-08-17T02:27:38.137 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43542.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43542.log.gz 2024-08-17T02:27:38.139 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41862.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41862.log.gz 2024-08-17T02:27:38.139 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45799.log 2024-08-17T02:27:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47761.log 2024-08-17T02:27:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45799.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45799.log.gz 2024-08-17T02:27:38.143 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47761.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47761.log.gz 2024-08-17T02:27:38.144 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41198.log 2024-08-17T02:27:38.145 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49340.log 2024-08-17T02:27:38.146 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41198.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41198.log.gz 2024-08-17T02:27:38.148 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49340.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:27:38.148 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49340.log.gz 2024-08-17T02:27:38.148 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50231.log 2024-08-17T02:27:38.149 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43500.log 2024-08-17T02:27:38.150 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50231.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50231.log.gz 2024-08-17T02:27:38.151 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48059.log 2024-08-17T02:27:38.152 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49130.log 2024-08-17T02:27:38.152 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43500.log.gz 2024-08-17T02:27:38.153 INFO:teuthology.orchestra.run.smithi087.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:27:38.153 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48059.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48059.log.gz 2024-08-17T02:27:38.154 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45101.log 2024-08-17T02:27:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43416.log 2024-08-17T02:27:38.155 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49130.log.gz 2024-08-17T02:27:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44680.log 2024-08-17T02:27:38.156 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45101.log.gz 2024-08-17T02:27:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37235.log 2024-08-17T02:27:38.158 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43416.log.gz 2024-08-17T02:27:38.158 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49214.log 2024-08-17T02:27:38.158 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44680.log.gz 2024-08-17T02:27:38.160 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47674.log 2024-08-17T02:27:38.161 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37235.log.gz 2024-08-17T02:27:38.161 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49214.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49214.log.gz 2024-08-17T02:27:38.161 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48481.log 2024-08-17T02:27:38.163 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.0.47674.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42547.log 0.0% -- replaced with /var/log/ceph/ceph-client.0.47674.log.gz 2024-08-17T02:27:38.163 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-17T02:27:38.164 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48481.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48481.log.gz 2024-08-17T02:27:38.164 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46051.log 2024-08-17T02:27:38.165 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46887.log 2024-08-17T02:27:38.165 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42547.log.gz 2024-08-17T02:27:38.166 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44975.log 2024-08-17T02:27:38.167 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46051.log.gz 2024-08-17T02:27:38.167 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46887.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46887.log.gz 2024-08-17T02:27:38.168 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45269.log 2024-08-17T02:27:38.168 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48229.log 2024-08-17T02:27:38.169 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44975.log.gz 2024-08-17T02:27:38.170 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41412.log 2024-08-17T02:27:38.170 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45269.log.gz 2024-08-17T02:27:38.171 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49172.log 2024-08-17T02:27:38.171 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48229.log.gz 2024-08-17T02:27:38.172 INFO:teuthology.orchestra.run.smithi087.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:27:38.173 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48565.log 2024-08-17T02:27:38.173 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41412.log.gz 2024-08-17T02:27:38.174 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48271.log 2024-08-17T02:27:38.174 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49172.log.gz 2024-08-17T02:27:38.175 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46177.log 2024-08-17T02:27:38.175 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48565.log.gz 2024-08-17T02:27:38.176 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48271.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48271.log.gz 2024-08-17T02:27:38.177 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30784.log 2024-08-17T02:27:38.177 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43332.log 2024-08-17T02:27:38.178 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46177.log.gz 2024-08-17T02:27:38.178 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.tmp-client.admin.30784.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30784.log.gz 2024-08-17T02:27:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42030.log 2024-08-17T02:27:38.180 INFO:teuthology.orchestra.run.smithi087.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:27:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50086.log 2024-08-17T02:27:38.180 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43332.log.gz 2024-08-17T02:27:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42030.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43080.log 2024-08-17T02:27:38.182 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42030.log.gz 2024-08-17T02:27:38.182 INFO:teuthology.orchestra.run.smithi087.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:27:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41803.log 2024-08-17T02:27:38.184 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50086.log.gz 2024-08-17T02:27:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43080.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43080.log.gz 2024-08-17T02:27:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50620.log 2024-08-17T02:27:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41803.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41803.log.gz 2024-08-17T02:27:38.186 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50365.log 2024-08-17T02:27:38.187 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47235.log 2024-08-17T02:27:38.187 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50620.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50620.log.gz 2024-08-17T02:27:38.188 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50365.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50365.log.gz 2024-08-17T02:27:38.188 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43164.log 2024-08-17T02:27:38.190 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47235.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47235.log.gz 2024-08-17T02:27:38.191 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50188.log 2024-08-17T02:27:38.191 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43164.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43164.log.gz 2024-08-17T02:27:38.191 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46465.log 2024-08-17T02:27:38.193 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50494.log 2024-08-17T02:27:38.193 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50188.log.gz 2024-08-17T02:27:38.194 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46219.log 2024-08-17T02:27:38.194 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46465.log.gz 2024-08-17T02:27:38.195 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48607.log 2024-08-17T02:27:38.196 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50494.log.gz 2024-08-17T02:27:38.197 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45017.log 2024-08-17T02:27:38.197 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46219.log.gz 2024-08-17T02:27:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48607.log: gzip -5 --verbose 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48607.log.gz 2024-08-17T02:27:38.198 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.49750.log 2024-08-17T02:27:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45017.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45017.log.gz 2024-08-17T02:27:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49046.log 2024-08-17T02:27:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44627.log 2024-08-17T02:27:38.201 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49750.log.gz 2024-08-17T02:27:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46423.log 2024-08-17T02:27:38.203 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49046.log.gz 2024-08-17T02:27:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44241.log 2024-08-17T02:27:38.204 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44627.log.gz 2024-08-17T02:27:38.204 INFO:teuthology.orchestra.run.smithi005.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:27:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47109.log 2024-08-17T02:27:38.205 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46423.log.gz 2024-08-17T02:27:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44241.log: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50273.log 2024-08-17T02:27:38.206 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44241.log.gz 2024-08-17T02:27:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45521.log 2024-08-17T02:27:38.207 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47109.log.gz 2024-08-17T02:27:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41760.log 2024-08-17T02:27:38.209 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50273.log.gz 2024-08-17T02:27:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47975.log 2024-08-17T02:27:38.209 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45521.log.gz 2024-08-17T02:27:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46093.log 2024-08-17T02:27:38.212 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41760.log.gz 2024-08-17T02:27:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49298.log 2024-08-17T02:27:38.212 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47975.log.gz 2024-08-17T02:27:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46093.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46093.log.gz 2024-08-17T02:27:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49256.log 2024-08-17T02:27:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45715.log 2024-08-17T02:27:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49298.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49298.log.gz 2024-08-17T02:27:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49256.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49256.log.gz 2024-08-17T02:27:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46675.log 2024-08-17T02:27:38.216 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.admin.45715.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47887.log 2024-08-17T02:27:38.217 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45715.log.gz 2024-08-17T02:27:38.217 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46675.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46675.log.gz 2024-08-17T02:27:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49792.log 2024-08-17T02:27:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50578.log 2024-08-17T02:27:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47887.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47887.log.gz 2024-08-17T02:27:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49792.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49792.log.gz 2024-08-17T02:27:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42795.log 2024-08-17T02:27:38.220 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42210.log 2024-08-17T02:27:38.221 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50578.log.gz 2024-08-17T02:27:38.221 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42795.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42795.log.gz 2024-08-17T02:27:38.222 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45185.log 2024-08-17T02:27:38.222 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48836.log 2024-08-17T02:27:38.223 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45185.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42210.log.gz 2024-08-17T02:27:38.223 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45185.log.gz 2024-08-17T02:27:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43206.log 2024-08-17T02:27:38.225 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44765.log 2024-08-17T02:27:38.225 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48836.log.gz 2024-08-17T02:27:38.226 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43206.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43206.log.gz 2024-08-17T02:27:38.226 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41550.log 2024-08-17T02:27:38.227 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45353.log 2024-08-17T02:27:38.227 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44765.log.gz 2024-08-17T02:27:38.228 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47151.log 2024-08-17T02:27:38.228 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41550.log.gz 2024-08-17T02:27:38.229 INFO:teuthology.orchestra.run.smithi087.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:27:38.230 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42544.log 2024-08-17T02:27:38.230 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45353.log.gz 2024-08-17T02:27:38.231 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47151.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47151.log.gz 2024-08-17T02:27:38.231 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46717.log 2024-08-17T02:27:38.232 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42544.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42544.log.gz 2024-08-17T02:27:38.232 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42537.log 2024-08-17T02:27:38.233 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:27:38.234 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46717.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46717.log.gz 2024-08-17T02:27:38.235 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48733.log 2024-08-17T02:27:38.235 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42537.log.gz 2024-08-17T02:27:38.235 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49960.log 2024-08-17T02:27:38.237 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48733.log: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41462.log 2024-08-17T02:27:38.237 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48733.log.gz 2024-08-17T02:27:38.238 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44849.log 2024-08-17T02:27:38.238 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49960.log.gz 2024-08-17T02:27:38.239 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41462.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41462.log.gz 2024-08-17T02:27:38.240 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44933.log 2024-08-17T02:27:38.240 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44849.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44849.log.gz 2024-08-17T02:27:38.241 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50128.log 2024-08-17T02:27:38.242 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43122.log 2024-08-17T02:27:38.243 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44933.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44933.log.gz 2024-08-17T02:27:38.243 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50128.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50128.log.gz 2024-08-17T02:27:38.244 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42535.log 2024-08-17T02:27:38.244 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43122.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43122.log.gz 2024-08-17T02:27:38.246 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45883.log 2024-08-17T02:27:38.246 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42535.log: gzip -5 --verbose 87.4% -- /var/log/ceph/ceph-client.admin.46759.log -- replaced with /var/log/ceph/ceph-client.admin.42535.log.gz 2024-08-17T02:27:38.247 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-17T02:27:38.248 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45143.log 2024-08-17T02:27:38.248 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45883.log.gz 2024-08-17T02:27:38.249 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46759.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46759.log.gz 2024-08-17T02:27:38.249 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47193.log 2024-08-17T02:27:38.250 INFO:teuthology.orchestra.run.smithi087.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:27:38.251 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46261.log 2024-08-17T02:27:38.251 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45143.log.gz 2024-08-17T02:27:38.251 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47193.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47193.log.gz 2024-08-17T02:27:38.252 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50323.log 2024-08-17T02:27:38.252 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46261.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46261.log.gz 2024-08-17T02:27:38.253 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50044.log 2024-08-17T02:27:38.254 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-08-17T02:27:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:real 0m0.260s 2024-08-17T02:27:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:user 0m0.974s 2024-08-17T02:27:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:sys 0m0.163s 2024-08-17T02:27:38.256 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.admin.50323.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45925.log 2024-08-17T02:27:38.256 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50323.log.gz 2024-08-17T02:27:38.256 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50044.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50044.log.gz 2024-08-17T02:27:38.257 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43290.log 2024-08-17T02:27:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45925.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45925.log.gz 2024-08-17T02:27:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42531.log 2024-08-17T02:27:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47719.log 2024-08-17T02:27:38.259 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43290.log.gz 2024-08-17T02:27:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45841.log 2024-08-17T02:27:38.260 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42531.log.gz 2024-08-17T02:27:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47719.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47719.log.gz 2024-08-17T02:27:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48878.log 2024-08-17T02:27:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45841.log: /var/log/ceph/ceph-client.admin.48878.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45841.log.gz 2024-08-17T02:27:38.263 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48878.log.gz 2024-08-17T02:27:38.281 INFO:teuthology.orchestra.run.smithi005.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:27:38.300 INFO:teuthology.orchestra.run.smithi005.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:27:38.311 INFO:teuthology.orchestra.run.smithi005.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:27:38.318 INFO:teuthology.orchestra.run.smithi005.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:27:38.416 INFO:teuthology.orchestra.run.smithi005.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:27:38.419 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-17T02:27:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:real 0m0.430s 2024-08-17T02:27:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:user 0m1.222s 2024-08-17T02:27:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m0.620s 2024-08-17T02:27:38.420 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:27:38.421 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858279/remote/smithi005/log 2024-08-17T02:27:38.422 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:27:38.771 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858279/remote/smithi087/log 2024-08-17T02:27:38.772 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:27:38.946 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:27:38.956 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:27:38.956 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:27:38.960 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:27:39.072 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:27:39.081 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:27:39.081 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:27:39.085 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:27:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:27:39.118 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:27:39.121 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:27:39.121 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-08-17T02:27:39.122 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv01.front.sepia.ceph.com 3 6 377 8 -23us[ -20us] +/- 57ms 2024-08-17T02:27:39.122 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 8 -74us[ -71us] +/- 59ms 2024-08-17T02:27:39.122 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 +205us[ +205us] +/- 90ms 2024-08-17T02:27:39.122 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:27:39.125 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:27:39.125 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-08-17T02:27:39.125 INFO:teuthology.orchestra.run.smithi087.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 -25us[ -13us] +/- 57ms 2024-08-17T02:27:39.125 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 -67us[ -54us] +/- 59ms 2024-08-17T02:27:39.125 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 +207us[ +220us] +/- 90ms 2024-08-17T02:27:39.125 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:27:39.126 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:27:39.135 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:27:39.136 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:27:39.145 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:27:39.282 DEBUG:teuthology.orchestra.run.smithi087:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:27:39.395 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:27:39.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:39.455 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:27:39.515 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:39.516 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:27:39.525 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:27:39.537 INFO:teuthology.task.internal:Duration was 748.492083 seconds 2024-08-17T02:27:39.537 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:27:39.546 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:27:39.546 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:27:39.551 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:27:39.635 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:27:39.637 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:27:40.009 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:27:40.009 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:27:40.009 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:27:40.059 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2024-08-17T02:27:40.060 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:27:40.110 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:27:40.110 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:27:40.114 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:27:40.173 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:27:40.173 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:27:40.177 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:27:40.320 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:27:40.331 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:27:40.331 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:27:40.388 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:27:40.443 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:27:40.453 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:27:40.457 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:27:40.524 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2024-08-17T02:27:40.527 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2024-08-17T02:27:40.557 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:27:40.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:40.590 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:27:40.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:40.624 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:27:40.634 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:27:40.635 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858279/remote/smithi005 2024-08-17T02:27:40.635 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:27:40.699 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858279/remote/smithi087 2024-08-17T02:27:40.699 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:27:40.761 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:27:40.762 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:27:40.766 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:27:40.801 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:27:40.813 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:27:40.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:27:40.822 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:27:40.823 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:27:40.842 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:27:40.873 INFO:teuthology.orchestra.run.smithi005.stdout: 393951 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:27 /home/ubuntu/cephtest 2024-08-17T02:27:40.877 INFO:teuthology.orchestra.run.smithi087.stdout: 393528 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:27 /home/ubuntu/cephtest 2024-08-17T02:27:40.879 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:27:40.889 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:27:40.911 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 client.1-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 748.4920825958252 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=3c92741e63ad496c8d2086d5a2d620d9 status: fail success: false 2024-08-17T02:27:40.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:27:40.996 INFO:teuthology.run:FAIL